Commits

Commits on Sep 25, 2023

Merge pull request #56 from AGI-Collective/floatingbigcat-patch-1
floatingbigcat
authoredSep 25, 2023
Update tokenizer.py
floatingbigcat
authoredSep 25, 2023

Commits on Sep 22, 2023

Merge pull request #43 from AGI-Collective/text-generation
kshitijkg
authoredSep 22, 2023

Commits on Sep 17, 2023

Merge pull request #51 from AGI-Collective/config
kshitijkg
authoredSep 17, 2023

Commits on Sep 16, 2023

Config changes
Daniel Kaplan
committedSep 16, 2023

Commits on Sep 4, 2023

Fixed cosine decay
kshitijkg
committedSep 4, 2023

Commits on Aug 8, 2023

support geneare from input file
floatingsnake
committedAug 8, 2023

Commits on Aug 7, 2023

Merge pull request #40 from EleutherAI/summit-neox-v2.0
kshitijkg
authoredAug 7, 2023
Fixed AnnealingLR Class and Cosine Decay Schedule
kshitijkg
committedAug 7, 2023

Commits on Aug 4, 2023

Merge pull request #37 from AGI-Collective/user-agnostic
Rabbidon
authoredAug 4, 2023
Added better job file
Rabbidon
committedAug 4, 2023
add image on the inference
floatingsnake
committedAug 4, 2023

Commits on Aug 3, 2023

removed debug print statements
Rabbidon
committedAug 3, 2023
Added user-agnostic config reading
Rabbidon
committedAug 3, 2023

Commits on Jun 15, 2023

Merge pull request #19 from AGI-Collective/support_multiple_datasets
floatingbigcat
authoredJun 15, 2023
weight_decay
Kshitij Gupta
committedJun 15, 2023
config update
Kshitij Gupta
committedJun 15, 2023
new configs
Kshitij Gupta
committedJun 15, 2023
fixed megatron config bug
Kshitij Gupta
committedJun 15, 2023
magma410M training
Kshitij Gupta
committedJun 15, 2023

Commits on Jun 13, 2023

Merge pull request #20 from floatingsnake/magma
kshitijkg
authoredJun 13, 2023
temp_commit
Kshitij Gupta
committedJun 13, 2023

Commits on Jun 12, 2023

Added support when resampled=True
Kshitij Gupta
committedJun 12, 2023
Merge pull request #9 from floatingsnake/fix-tokenizer
kshitijkg
authoredJun 12, 2023

Commits on Jun 10, 2023

Merge branch 'magma' into fix-tokenizer
floatingbigcat
authoredJun 10, 2023

Commits on Jun 9, 2023

add pad token
floatingsnake
committedJun 9, 2023

Commits on Jun 7, 2023

Merge pull request #14 from floatingsnake/fix-maskpad
kshitijkg
authoredJun 7, 2023
add mask for pad token
floatingsnake
committedJun 7, 2023
rm eod token for hfgpt2tokenizer
floatingsnake
committedJun 7, 2023

Commits on Jun 2, 2023

add 70mOpenclipH model config for summit
floatingsnake
committedJun 2, 2023

Commits on May 31, 2023

Merge pull request #10 from floatingsnake/neox_checkpoint_loading
floatingbigcat
authoredMay 31, 2023
Script to convert GPT Neox Checkpoint for magma
Kshitij Gupta
committedMay 31, 2023
Add support to HFTokenzer
floatingsnake
committedMay 31, 2023
fix name in prepare_image_prefix.py
floatingsnake
committedMay 31, 2023
add small model config for summit
floatingsnake
committedMay 31, 2023