Skip to content

Commit

Permalink
Fix training command of Gemma in Readme
Browse files Browse the repository at this point in the history
  • Loading branch information
khatwanimohit committed Mar 12, 2024
1 parent 287b973 commit 68ac7bb
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion getting_started/Run_Gemma.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,9 @@ python MaxText/decode.py MaxText/configs/base.yml tokenizer_path=$CHKPT_BUCKET/t

### MaxText supports fine-tuning with high performance.

Command for training Gemma-2b from scratch on 1 slice of v5e-256.
```
python MaxText/train.py MaxText/configs/base.yml base_output_directory=gs:https://runner-maxtext-logs model_name=gamma-2b dataset_path=gs:https://maxtext-dataset enable_checkpointing=false assets_path=gs:https://maxtext-gamma/gamma steps=10 ici_fsdp_transpose_parallelism=16 ici_fsdp_parallelism=4 per_device_batch_size=2 remat_policy=minimal max_target_length=8192
python MaxText/train.py MaxText/configs/base.yml base_output_directory=$BASE_OUTPUT_DIR model_name=gemma-2b dataset_path=$DATASET_PATH enable_checkpointing=false tokenizer_path=$CHKPT_BUCKET/tokenizer.model steps=10 ici_fsdp_transpose_parallelism=16 per_device_batch_size=2 remat_policy=minimal max_target_length=8192
```

### Performance
Expand Down

0 comments on commit 68ac7bb

Please sign in to comment.