You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
MNTP training (#15)
* first iteration of script ,TODO: save properly
* model class loading
* bf16 flash attn
* ignore wandb
* added dependencies for running mlm training
* revert custom local change
* peft loading and saving
* remove unused functions
* all configs
* minor formatting changes
* flash attention needs no-build-isolation