Commits

Commits on Oct 27, 2023

Add new features for quickly finding potential training data
carlini
committedOct 27, 2023

Commits on Jun 6, 2022

Fix two array out of bounds reads, including google-research#17
carlini
committedJun 6, 2022

Commits on May 1, 2022

Commits on Apr 28, 2022

Merge pull request google-research#13 from alistairewj/master
carlini
committedApr 28, 2022
fix typo in bash call
alistairewj
committedApr 28, 2022
explicitly set multiprocess start method to fork for cross-OS consistency
alistairewj
committedApr 28, 2022

Commits on Apr 15, 2022

Dedup single file will abort early if merge fails (fixes google-research#12 )
carlini
committedApr 15, 2022
Fail early on crashes; purge cache directory on rerun (Fixes google-research#11 )
carlini
committedApr 15, 2022

Commits on Mar 11, 2022

Commits on Mar 8, 2022

Silence last warnings
carlini
committedMar 8, 2022
Spellcheck README
carlini
committedMar 8, 2022
Add dedup single file script
carlini
committedMar 8, 2022
Add single file deduplicator
carlini
committedMar 8, 2022
Update README for wiki40b, and fix minor code bugs
carlini
committedMar 8, 2022

Commits on Mar 7, 2022

Simplify process
carlini
committedMar 7, 2022

Commits on Mar 3, 2022

Commits on Feb 26, 2022

Fill in some TODOs
carlini
committedFeb 26, 2022

Commits on Feb 24, 2022

README typo fixes
carlini
committedFeb 24, 2022
More code commenting and cleanup
carlini
committedFeb 24, 2022
README now is much more readable
carlini
committedFeb 24, 2022
Once upon a time I was told to comment my code
carlini
committedFeb 24, 2022
Better collection
carlini
committedFeb 24, 2022
Add example LM1b dedup writeout script
carlini
committedFeb 24, 2022