Commits

History for

Commits on Sep 21, 2022

Add deepspeed_slurm config, update config README, and run pre-commit
dashstander
committedSep 21, 2022

Commits on Sep 12, 2022

Bug Fix: Test Metrics Overwrite Validation Metrics
pwstegman
committedSep 12, 2022

Commits on Mar 17, 2022

fix: gpu tests, disable failing ones (for now)
Mistobaan
committedMar 17, 2022

Commits on Feb 23, 2022

Add codespell
Mistobaan
committedFeb 23, 2022

Commits on Feb 12, 2022

Add black code formatting to CI (EleutherAI#530 )
Mistobaan
committedFeb 12, 2022

Commits on Feb 9, 2022

Fix pp generation (EleutherAI#505 )
sdtblck
committedFeb 9, 2022

Commits on Jan 31, 2022

report eval harness version and do bootstrapping (EleutherAI#498 )
leogao2
committedJan 31, 2022

Commits on Dec 20, 2021

Improve Eval Harness (EleutherAI#471 )
sdtblck
committedDec 20, 2021

Commits on Oct 24, 2021

Added bitsandbytes Adam optimizer
Quentin-Anthony
committedOct 24, 2021

Commits on Sep 8, 2021

Merge pull request EleutherAI#398 from EleutherAI/soft_prompt_2
StellaAthena
committedSep 8, 2021

Commits on Aug 31, 2021

Merge branch 'main' into gen_docs
sdtblck
committedAug 31, 2021
Merge branch 'main' into soft_prompt_2
StellaAthena
committedAug 31, 2021
Char level ppl (EleutherAI#400 )

sdtblck
and
StellaAthena
committedAug 31, 2021
Merge pull request EleutherAI#367 from EleutherAI/eval_harness_update
StellaAthena
committedAug 31, 2021
add char level perplexity
sdtblck
committedAug 31, 2021

Commits on Aug 30, 2021

replace init_from_vocab option with init_string
sdtblck
committedAug 30, 2021
add soft prompt tuning
sdtblck
committedAug 30, 2021

Commits on Aug 25, 2021

get rid of reset_position_ids / reset_attention_mask (never used...)
sdtblck
committedAug 25, 2021

Commits on Jul 30, 2021

Fix bug with number of evaluation steps (EleutherAI#384 )
sdtblck
committedJul 30, 2021

Commits on Jun 24, 2021

cleanup imports + change print string
sdtblck
committedJun 24, 2021
fix logging
sdtblck
committedJun 24, 2021
run eval harness during training
sdtblck
committedJun 24, 2021

Commits on Jun 20, 2021

Merge branch 'main' into _bf16
StellaAthena
committedJun 20, 2021

Commits on Jun 10, 2021

Lm eval harness (EleutherAI#357 )

sdtblck
and
Samuel Weinbach
committedJun 10, 2021

Commits on May 19, 2021

Add GMLP (EleutherAI#339 )
sdtblck
committedMay 19, 2021

Commits on May 14, 2021

Merge branch 'main' into _bf16
sdtblck
committedMay 14, 2021

Commits on May 13, 2021

Checkpoint validation (EleutherAI#324 )

sweinbach
and
Samuel Weinbach
committedMay 13, 2021

Commits on May 12, 2021

Increase test coverage (EleutherAI#289 )

committedMay 12, 2021

Commits on May 11, 2021

Add blended datasets
sdtblck
committedMay 11, 2021
fix layernorm + get basics working
StellaAthena
committedMay 11, 2021

Commits on May 10, 2021

Merge remote-tracking branch 'origin/bf16' into zero-3
StellaAthena
committedMay 10, 2021

Commits on May 9, 2021

reinstate timers
sdtblck
committedMay 9, 2021
fix g.a.s / resuming with pp=0
sdtblck
committedMay 9, 2021

Commits on May 8, 2021

Fix dataloader start iter when resuming with gas > 1
alexandonian
committedMay 8, 2021

Commits on May 7, 2021

fix imports
Samuel Weinbach
committedMay 7, 2021