Commits

Commits on May 31, 2024

fix OUTPUT_PATH in v5e/128b.sh
ZhiyuLi-goog
committedMay 31, 2024

Commits on May 2, 2024

fix norm sharding
ZhiyuLi-goog
committedMay 2, 2024

Commits on Apr 30, 2024

loosen tolerance in assert_params_sufficiently_sharded
ZhiyuLi-goog
committedApr 30, 2024

Commits on Apr 26, 2024

change norm sharding
ZhiyuLi-goog
committedApr 26, 2024

Commits on Mar 25, 2024

[airflow] new support to read in run_name from env
ZhiyuLi-goog
committedMar 25, 2024

Commits on Mar 12, 2024

fix dtype bug in adam_pax
ZhiyuLi-goog
committedMar 12, 2024

Commits on Mar 6, 2024

Add new remat policies
ZhiyuLi-goog
committedMar 6, 2024

Commits on Feb 29, 2024

fix gpt3 conversion script
ZhiyuLi-goog
committedFeb 29, 2024

Commits on Feb 27, 2024

Copybara import of the project:

ZhiyuLi-goog
authored and
maxtext authors
committedFeb 27, 2024

Commits on Feb 15, 2024

fix gpt3 e2e test
ZhiyuLi-goog
committedFeb 15, 2024

Commits on Feb 13, 2024

add gpt3 6b
ZhiyuLi-goog
committedFeb 13, 2024
[MLPerf GPT3] add c4_mlperf input pipeline and eval step
ZhiyuLi-goog
committedFeb 13, 2024

Commits on Jan 29, 2024

[MLPerf GPT3] Model Migration
ZhiyuLi-goog
committedJan 29, 2024

Commits on Nov 14, 2023

Maximize MFU by updating per_device_batch_size and remat_policy in 512b config
ZhiyuLi-goog
committedNov 14, 2023
Maximize per_device_batch_size in 1024b config
ZhiyuLi-goog
committedNov 14, 2023

Commits on Nov 8, 2023

Add the 1024B config (#248 )
ZhiyuLi-goog
committedNov 8, 2023