Commits

History for

Commits on Apr 18, 2024

Fix the performance table of flash checkpoint in Meagtron-LM experiments. (intelligent-machine-learning#1084 )
workingloong
committedApr 18, 2024
Add the commit link of Megatron-LM in the benchmark of flash checkpoint. (intelligent-machine-learning#1083 )
workingloong
committedApr 18, 2024

Commits on Apr 17, 2024

Save the FSDP checkpoint with full state dict. (intelligent-machine-learning#1078 )
workingloong
committedApr 17, 2024

Commits on Apr 2, 2024

Fix the image path of elasticjob architecture. (intelligent-machine-learning#1062 )
workingloong
committedApr 2, 2024

Commits on Mar 26, 2024

Fix the typo error in a figure. (intelligent-machine-learning#1050 )
workingloong
committedMar 26, 2024

Commits on Mar 11, 2024

Implement the scripts to check node for different AI chips. (intelligent-machine-learning#1023 )
workingloong
committedMar 11, 2024

Commits on Mar 6, 2024

Update figures.
workingloong
committedMar 6, 2024
Fix by comments.
workingloong
committedMar 6, 2024
Polish
workingloong
committedMar 6, 2024
Polish the blog to introduce the fault-tolerance of DLRover.
workingloong
committedMar 6, 2024
Set the link of the script to check node. (intelligent-machine-learning#1018 )
workingloong
committedMar 6, 2024

Commits on Mar 1, 2024

Update the Flash Checkpoint APIs for Megatron in blogs. (intelligent-machine-learning#1012 )
workingloong
committedMar 1, 2024

Commits on Feb 29, 2024

Blogs to introduce saving/loading Megatron-LM checkpoint. (intelligent-machine-learning#1009 )
workingloong
committedFeb 29, 2024

Commits on Feb 1, 2024

Polish the annotation of Megatron-LM. (intelligent-machine-learning#988 )
workingloong
committedFeb 1, 2024

Commits on Jan 30, 2024

Note the Megatron-LM version. (intelligent-machine-learning#979 )
workingloong
committedJan 30, 2024

Commits on Jan 15, 2024

Doc has bug:dir path not corect (intelligent-machine-learning#952 )
SchopenhauerZhang
committedJan 15, 2024

Commits on Jan 9, 2024

Rename WORKER_NUM to NODE_NUM
workingloong
committedJan 9, 2024

Commits on Jan 7, 2024

Fix the doc of ckpt. (intelligent-machine-learning#931 )
youxingling
committedJan 7, 2024

Commits on Jan 5, 2024

Commits on Jan 4, 2024

Fix by comments.
workingloong
committedJan 4, 2024

Commits on Jan 3, 2024

Polish
workingloong
committedJan 3, 2024
Format markdown
workingloong
committedJan 3, 2024
Fix figures layout.
workingloong
committedJan 3, 2024
Fix the figure size.
workingloong
committedJan 3, 2024
Fix the figure titles.
workingloong
committedJan 3, 2024
Fix the position of figure title.
workingloong
committedJan 3, 2024
Fix title
workingloong
committedJan 3, 2024
A blog to introduce the performance of Flash Checkpoint.
workingloong
committedJan 3, 2024

Commits on Dec 31, 2023

A tutorial to find slow/fault nodes. (intelligent-machine-learning#922 )
workingloong
committedDec 31, 2023

Commits on Oct 30, 2023

Rename the chinses blog with _cn suffix.
workingloong
committedOct 30, 2023

Commits on Oct 24, 2023

OSPP开源之夏结项报告-兰霆峰 (intelligent-machine-learning#742 )
Antlera
committedOct 24, 2023

Commits on Sep 13, 2023

Update stabilize_llm_training_cn.md
skydoorkai
committedSep 13, 2023