chore(readme): update instruction to set config to load from cache (a…

…xolotl-ai-cloud#1030)
jinwonkim93 · Jan 3, 2024 · b31038a · b31038a
1 parent c75f916
commit b31038a
Showing 1 changed file with 3 additions and 2 deletions.
diff --git a/README.md b/README.md
@@ -935,8 +935,9 @@ accelerate launch -m axolotl.cli.train your_config.yml
 You can optionally pre-tokenize dataset with the following before finetuning.
 This is recommended for large datasets.
 
-- Set `push_dataset_to_hub: hf_user/repo` to push it to Huggingface.
-- Use `--debug` to see preprocessed examples.
+- Set `dataset_prepared_path:` to a local folder for saving and loading pre-tokenized dataset.
+- (Optional): Set `push_dataset_to_hub: hf_user/repo` to push it to Huggingface.
+- (Optional): Use `--debug` to see preprocessed examples.
 
 ```bash
 python -m axolotl.cli.preprocess your_config.yml