Commits

History for

Commits on Jan 4, 2024

Fix repo for CI (EleutherAI#1106 )
yang
committedJan 4, 2024

Commits on Dec 23, 2023

Lm eval 0.4.0 support (EleutherAI#1101 )

committedDec 23, 2023

Commits on Feb 3, 2023

Default use_cache=False in eval harness integration (EleutherAI#774 )

committedFeb 3, 2023

Commits on Dec 6, 2022

Slurm Fix and formatting (EleutherAI#729 )

committedDec 6, 2022

Commits on Dec 2, 2022

Update __init__.py
StellaAthena
committedDec 2, 2022
Update eval_adapter.py
StellaAthena
committedDec 2, 2022

Commits on Nov 24, 2022

Allow wildcard-style Eval Harness task selection (EleutherAI#719 )

committedNov 24, 2022

Commits on Sep 21, 2022

Add deepspeed_slurm config, update config README, and run pre-commit
dashstander
committedSep 21, 2022

Commits on Jul 22, 2022

Correct use of eot_token_id in eval_adapter
richhankins
committedJul 22, 2022

Commits on Apr 9, 2022

Add config field to the results dict

jon-tow
authored and
jon-tow
committedApr 9, 2022

Commits on Apr 8, 2022

Trim trailing whitespace
jon-tow
committedApr 8, 2022
Update eval_adapter to conform to lm_eval's BaseLM
jon-tow
committedApr 8, 2022

Commits on Feb 9, 2022

Fix pp generation (EleutherAI#505 )
sdtblck
committedFeb 9, 2022

Commits on Jan 31, 2022

report eval harness version and do bootstrapping (EleutherAI#498 )
leogao2
committedJan 31, 2022

Commits on Dec 20, 2021

Improve Eval Harness (EleutherAI#471 )
sdtblck
committedDec 20, 2021

Commits on Nov 7, 2021

Eval harness fix (EleutherAI#457 )
sdtblck
committedNov 7, 2021

Commits on Oct 19, 2021

Delete run.py
StellaAthena
committedOct 19, 2021

Commits on Aug 31, 2021

Char level ppl (EleutherAI#400 )

sdtblck
and
StellaAthena
committedAug 31, 2021
Update adaptor.py
sdtblck
committedAug 31, 2021

Commits on Jun 24, 2021

cleanup imports
sdtblck
committedJun 24, 2021
run eval harness during training
sdtblck
committedJun 24, 2021

Commits on Jun 17, 2021

cleanup
Samuel Weinbach
committedJun 17, 2021
fix jit typing
Samuel Weinbach
committedJun 17, 2021

Commits on Jun 16, 2021

fix results dict
Samuel Weinbach
committedJun 16, 2021
move patch to top of adaptor.py
Samuel Weinbach
committedJun 16, 2021
add stop tokens
Samuel Weinbach
committedJun 16, 2021
add easier inference mode for neox
Samuel Weinbach
committedJun 16, 2021

Commits on Jun 15, 2021

add greedy_until
Samuel Weinbach
committedJun 15, 2021
fix microbatching + add parameters for evaluation
Samuel Weinbach
committedJun 15, 2021

Commits on Jun 10, 2021

Lm eval harness (EleutherAI#357 )

sdtblck
and
Samuel Weinbach
committedJun 10, 2021

Loading