Commits

Commits on Jun 3, 2023

Add EletherAI folder in elk-reporters with pythia-70m-deduped results
RohanSubramani
committedJun 3, 2023

Commits on May 31, 2023

Add support for Pythia models
michaelbyun
committedMay 31, 2023

Commits on May 24, 2023

Merge remote-tracking branch 'upstream/main'
michaelbyun
committedMay 24, 2023

Commits on Apr 21, 2023

Support non-fast tokenizers like LLaMA (EleutherAI#202 )
norabelrose
committedApr 21, 2023

Commits on Apr 20, 2023

Merge pull request EleutherAI#205 from EleutherAI/revert-184-spar_mt_prompt_invar
lauritowal
committedApr 20, 2023
Revert "spar mt prompt invar"
norabelrose
committedApr 20, 2023
Merge pull request EleutherAI#184 from EleutherAI/spar_mt_prompt_invar
lauritowal
committedApr 20, 2023
Update README.md
lauritowal
committedApr 20, 2023
fix ds_name bug
ChristyKoh
committedApr 20, 2023

Commits on Apr 19, 2023

add ccs csv eval
michaelbyun
committedApr 19, 2023
Cluster bootstrap for metrics; refactor metric computations into evaluate_preds (EleutherAI#197 )
norabelrose
committedApr 19, 2023
Merge branch 'spar_mt_prompt_invar' of github.com:EleutherAI/elk into spar_mt_prompt_invar
ChristyKoh
committedApr 19, 2023
define ds_name
ChristyKoh
committedApr 19, 2023
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committedApr 19, 2023
Merge branch 'eval_dirs' into spar_mt_prompt_invar, separate combining logic into functions
ChristyKoh
committedApr 19, 2023
Merge branch 'main' into eval_dirs
ChristyKoh
committedApr 19, 2023
Merge branch 'main' of github.com:EleutherAI/elk into main
ChristyKoh
committedApr 19, 2023
Make Classifier great again (with better hparams)
norabelrose
committedApr 19, 2023

Commits on Apr 18, 2023

Balanced sampler again
norabelrose
committedApr 18, 2023
Actually use BalancedSampler again
norabelrose
committedApr 18, 2023
Delete requirements.txt (EleutherAI#201 )
thejaminator
committedApr 18, 2023
Remove vestigial label_column rename
norabelrose
committedApr 18, 2023
Make load_prompts actually use label_column and num_classes args
norabelrose
committedApr 18, 2023

Commits on Apr 17, 2023

Fix accuracy computation in Reporter (EleutherAI#195 )
AlexTMallen
committedApr 17, 2023

Commits on Apr 16, 2023

Merge pull request EleutherAI#194 from EleutherAI/fix-calibration-update
AlexTMallen
committedApr 16, 2023
Blazing fast bootstrap stderrs for AUROC (EleutherAI#190 )
norabelrose
committedApr 16, 2023
fix swapped labels and probs
AlexTMallen
committedApr 16, 2023
unmodified CCS run
michaelbyun
committedApr 16, 2023
Support multiple choice datasets (EleutherAI#179 )
norabelrose
committedApr 16, 2023
Sweep MVP (EleutherAI#191 )
norabelrose
committedApr 16, 2023

Commits on Apr 14, 2023

Multiple datasets refactor (EleutherAI#189 )

norabelrose
and
AlexTMallen
committedApr 14, 2023

Commits on Apr 13, 2023

add combine_evals flag to differentiate a multi dataset eval from a batch of single-dataset evals
ChristyKoh
committedApr 13, 2023
bugfix to run eval separately on each dataset
ChristyKoh
committedApr 13, 2023
Merge remote-tracking branch 'origin/main' into eval_dirs
ChristyKoh
committedApr 13, 2023

Commits on Apr 12, 2023

assert datasettemplates type
ChristyKoh
committedApr 12, 2023