Commits

History for

Commits on Jun 17, 2024

Merge pull request #701 from google:mattdavidow-pipeline-circular
maxtext authors
committedJun 17, 2024
Account for new mesh axes for llama2-7b, and llama2-70b on GPUs.

golechwierowicz
authored and
maxtext authors
committedJun 17, 2024
base.yml changes
gobbleturk
committedJun 17, 2024

Commits on Jun 13, 2024

Merge pull request #695 from google:raymondzou-llama2-70b-config
maxtext authors
committedJun 13, 2024
Merge pull request #692 from google:zijun/inference-profiler
maxtext authors
committedJun 13, 2024
Add llama2 70b training config for v5e
raymondzouu
committedJun 13, 2024

Commits on Jun 12, 2024

Add vanilla megablox to MoE
RissyRan
committedJun 12, 2024
Add profiler flags to JetStream server
JoeZijunZhou
committedJun 12, 2024
reshape q
morgandu
committedJun 12, 2024
Merge pull request #691 from google:mattdavidow-pipeline-linear
maxtext authors
committedJun 12, 2024
Turn on layer scanning for llama2-7b on GPU.

golechwierowicz
authored and
maxtext authors
committedJun 12, 2024
Pipeline parallelism support (linear only)
gobbleturk
committedJun 12, 2024

Commits on Jun 11, 2024

Merge pull request #680 from google:aireen/grain_improve
maxtext authors
committedJun 11, 2024

Commits on Jun 7, 2024

Add gpt3 175b on v5e config
raymondzouu
committedJun 7, 2024

Commits on Jun 6, 2024

refactor data input pipeline and add perf data
aireenmei
committedJun 6, 2024

Commits on Jun 5, 2024

Merge pull request #684 from google:yooh/a3plus-flags
maxtext authors
committedJun 5, 2024
Merge pull request #685 from google:fix_matmul_scale
maxtext authors
committedJun 5, 2024
Set additional flags for a3 and a3plus
michelle-yooh
committedJun 5, 2024
Change norm sharding for llama2-7b to fsdp.

golechwierowicz
authored and
maxtext authors
committedJun 5, 2024
Removed unused Pallas import from layers/attentions.py

superbobry
authored and
maxtext authors
committedJun 5, 2024
Fix MoE matmul scale issue
RissyRan
committedJun 5, 2024

Commits on Jun 3, 2024

Metrics bug: server_lib should be config_lib
Bslabe123
committedJun 3, 2024
Internal change only.
maxtext authors
committedJun 3, 2024
Enable kv cache layout control
morgandu
committedJun 3, 2024

Commits on May 31, 2024

Update flops calculation to active experts in moe
RissyRan
committedMay 31, 2024
squash
Bslabe123
committedMay 31, 2024
fix OUTPUT_PATH in v5e/128b.sh
ZhiyuLi-goog
committedMay 31, 2024

Commits on May 30, 2024

Add MoE matmul implementation
RissyRan
committedMay 30, 2024

Commits on May 29, 2024

Integrate nsys profiler
michelle-yooh
committedMay 29, 2024
Don't clip fp8 stats
anfals
committedMay 29, 2024

Commits on May 25, 2024

Merge branch 'main' into inference-microbenchmark-fix
jwyang-google
committedMay 25, 2024

Commits on May 24, 2024

fix OOM issue running inference microbenchmark with llama13b on v5e4
jwyang-google
committedMay 24, 2024
add single controller flag
sadikneipp
committedMay 24, 2024

Commits on May 22, 2024

Fix prefill assertion
RissyRan
committedMay 22, 2024
fix hf input pipeline
aireenmei
committedMay 22, 2024