Commits

Commits on Jul 11, 2024

Merge pull request AFDWang#6 from Fizzmy/main
AFDWang
committedJul 11, 2024

Commits on Jul 10, 2024

Fix script
Fizzmy
committedJul 10, 2024
Adapt to fa models
Fizzmy
committedJul 10, 2024
Merge pull request AFDWang#5 from Fizzmy/main
AFDWang
committedJul 10, 2024
Modify script
Fizzmy
committedJul 10, 2024
Modify config
Fizzmy
committedJul 10, 2024

Commits on Jul 9, 2024

Align llama & gpt, fix search engine
Fizzmy
committedJul 9, 2024

Commits on Jun 6, 2024

Merge pull request #3 from Fizzmy/main
AFDWang
committedJun 6, 2024
Support vocab parallel(gpt_hf)
Fizzmy
committedJun 6, 2024
Support Megatron-SP & Adapt to llama_hf, gpt_hf
Fizzmy
committedJun 6, 2024
add llama_hf & modify llama_fa
Fizzmy
committedJun 6, 2024
Update megatron version.
Fizzmy
committedJun 6, 2024

Commits on May 13, 2024

Merge pull request #2 from Fizzmy/patch-1
AFDWang
committedMay 13, 2024

Commits on Apr 12, 2024

Update search engine(chunk) & fix bug
Fizzmy
committedApr 12, 2024

Commits on Apr 1, 2024

Fix a bug of nopipeline
Fizzmy
committedApr 1, 2024
fix no pipeline bug
Fizzmy
committedApr 1, 2024

Commits on Mar 25, 2024

Merge pull request #1 from Fizzmy/main
AFDWang
committedMar 25, 2024

Commits on Mar 24, 2024

Update requirements.txt
Fizzmy
committedMar 24, 2024
Update requirements.txt
Fizzmy
committedMar 24, 2024
fix gpipe
Fizzmy
committedMar 24, 2024

Commits on Mar 21, 2024

adapt PyTorch > 2.0 & grad accumulate
Fizzmy
committedMar 21, 2024

Commits on Nov 30, 2023

Update README.
AFDWang
committedNov 30, 2023
Update README.
AFDWang
committedNov 30, 2023
Update README.
AFDWang
committedNov 30, 2023
Release Galvatron-2
AFDWang
committedNov 30, 2023
Initial commit
AFDWang
committedNov 30, 2023