Commits

History for

Commits on Jul 4, 2024

Jsonl support (#9611 )
adityavavre
committedJul 4, 2024

Commits on May 23, 2024

Refactor Sequence Packing Script (#9271 )
cuichenx
committedMay 23, 2024

Commits on Apr 25, 2024

Fix import in lora merge script (#9032 )

committedApr 25, 2024

Commits on Apr 18, 2024

PP support in LoRA merge script (#8934 )

committedApr 18, 2024

Commits on Apr 12, 2024

Adding distributed checkpointing for bert (#8650 )

committedApr 12, 2024

Commits on Apr 8, 2024

LoRA merge script clean up (#8834 )

cuichenx
and
pre-commit-ci[bot]
committedApr 8, 2024

Commits on Mar 19, 2024

Unify HF converter scripts and arguments (#8435 )

committedMar 19, 2024

Commits on Mar 18, 2024

Chatglm pr update (#8686 )

committedMar 18, 2024

Commits on Mar 16, 2024

Add script for packed sequence data preparation (#8682 )

cuichenx
and
pre-commit-ci[bot]
committedMar 16, 2024

Commits on Mar 9, 2024

Fixes gpt mcore conversion to account for _extra_state that may be present (#8618 )
terrykong
committedMar 9, 2024

Commits on Mar 8, 2024

Upgrade to PTL 2.1 and 2.2 (#8030 )

committedMar 8, 2024

Commits on Mar 4, 2024

Yttm deprecation (#8322 )

AlexGrinch
and
pre-commit-ci[bot]
committedMar 4, 2024

Commits on Feb 29, 2024

Fix nemo_llama_to_hf conversion (#8000 )

committedFeb 29, 2024

Commits on Feb 27, 2024

Handle in HF AutoTokenizer with pad_token=None (#8068 )

HuiyingLi
and
yaoyu-33
committedFeb 27, 2024
Add Gemma Support and Conversion Scripts (#8468 )

committedFeb 27, 2024

Commits on Feb 23, 2024

Jiaqiz/option to disable adapters & merge all lora layers (#8029 )

committedFeb 23, 2024
Add Baichuan2 support (#8282 )

committedFeb 23, 2024

Commits on Feb 21, 2024

Add LoRA support to all linear layers (#7988 )

committedFeb 21, 2024

Commits on Feb 20, 2024

NeMo-Mistral to HF converter bugfix. (#8353 ) (#8442 )

github-actions[bot]
and
akoumpa
committedFeb 20, 2024

Commits on Feb 12, 2024

Fixes for MoE parameter passing & use of AutoTokenizer/Model for mistral. (#8272 ) (#8342 )

github-actions[bot]
and
akoumpa
committedFeb 12, 2024

Commits on Jan 31, 2024

Add Bert HF checkpoint converter (#8088 )

committedJan 31, 2024

Commits on Jan 27, 2024

Mixtral to NeMo conversion script. (#8155 )

committedJan 27, 2024

Commits on Jan 25, 2024

Mistral 7b conversion script (#8052 )

committedJan 25, 2024

Commits on Jan 19, 2024

Fix CPU Initialization and TP>1 for LoRA Merge Script (#8199 )

cuichenx
and
pre-commit-ci[bot]
committedJan 19, 2024
[NLP] Improve and unify loading state_dict for community models (#7977 )

janekl
and
pre-commit-ci[bot]
committedJan 19, 2024

Commits on Jan 11, 2024

fix TP>1 issue for conversion script (#8144 )
cuichenx
committedJan 11, 2024

Commits on Jan 3, 2024

fix lora merge script (#8113 )

cuichenx
and
arendu
committedJan 3, 2024

Commits on Dec 29, 2023

Change the megatron config lr scheduler default and fix to change partitions script (#8094 )
shan18
committedDec 29, 2023

Commits on Dec 15, 2023

Support Falcon Variants (7B/40B/180B) in Mcore NeMo (#7666 )

committedDec 15, 2023

Commits on Dec 13, 2023

Add All Multimodal Source Code (#7791 )

committedDec 13, 2023

Commits on Dec 12, 2023

Fix crash when converting to mcore a model using rotary embeddings (#7998 )

odelalleau
and
cuichenx
committedDec 12, 2023

Commits on Dec 8, 2023

Fixing conversion script to work for code llama (#7997 )

committedDec 8, 2023

Commits on Dec 7, 2023

Remove replace_sampler_ddp (deprecated in Trainer) (#7981 )
janekl
committedDec 7, 2023
Resolve dtype with utils_funcs.py (#7979 )
janekl
committedDec 7, 2023
Minor fixes (#7978 )
janekl
committedDec 7, 2023