Skip to content

Commit

Permalink
Update --using names for reprod Pile
Browse files Browse the repository at this point in the history
  • Loading branch information
leogao2 committed Nov 9, 2020
1 parent 5c387ce commit 63798fd
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion the_pile/pile.py
Original file line number Diff line number Diff line change
Expand Up @@ -364,7 +364,7 @@ def docs_for_dedupe():

print(mk_table(datasets, parse_size(args.read_amount)))

if args.using == 'reprod_pile' or args.using == 'pile_no_cc':
if args.using == 'pile_reprod' or args.using == 'pile_reprod_no_cc':
pile = PileReplication(datasets, parse_size(args.read_amount), profile=args.profile)
elif args.using == 'cc':
pile = CommonCrawlDataset()
Expand Down

0 comments on commit 63798fd

Please sign in to comment.