Add unsharded .bin in default location to gitignore

EleutherAI · Nov 8, 2023 · 0d77eb8 · 0d77eb8
1 parent 5adc27c
commit 0d77eb8
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/.gitignore b/.gitignore
@@ -132,3 +132,6 @@ dmypy.json
 
 # Batch Viewer saves
 utils/token_indicies/*
+
+# Unsharded megatron data, which we explicitly don't want to track with git.
+/pythia_pile_idxmaps/*