Commits

Commits on Apr 18, 2023

Balanced sampler again
norabelrose
committedApr 18, 2023
Actually use BalancedSampler again
norabelrose
committedApr 18, 2023
Delete requirements.txt (EleutherAI#201 )
thejaminator
committedApr 18, 2023
Remove vestigial label_column rename
norabelrose
committedApr 18, 2023
Make load_prompts actually use label_column and num_classes args
norabelrose
committedApr 18, 2023

Commits on Apr 17, 2023

Fix accuracy computation in Reporter (EleutherAI#195 )
AlexTMallen
committedApr 17, 2023

Commits on Apr 16, 2023

Merge pull request EleutherAI#194 from EleutherAI/fix-calibration-update
AlexTMallen
committedApr 16, 2023
Blazing fast bootstrap stderrs for AUROC (EleutherAI#190 )
norabelrose
committedApr 16, 2023
fix swapped labels and probs
AlexTMallen
committedApr 16, 2023
Support multiple choice datasets (EleutherAI#179 )
norabelrose
committedApr 16, 2023
Sweep MVP (EleutherAI#191 )
norabelrose
committedApr 16, 2023

Commits on Apr 14, 2023

Multiple datasets refactor (EleutherAI#189 )

norabelrose
and
AlexTMallen
committedApr 14, 2023

Commits on Apr 12, 2023

Prevent invalidation of the hidden state cache when num_gpus changes (EleutherAI#182 )
norabelrose
committedApr 12, 2023
fix label assignment causing multiclass bug (EleutherAI#183 )
ChristyKoh
committedApr 12, 2023
Add portuguese templates for boolq, ag_news, imdb (EleutherAI#181 )

committedApr 12, 2023

Commits on Apr 11, 2023

Merge pull request EleutherAI#178 from EleutherAI/pre-commit-ci-update-config
thejaminator
committedApr 11, 2023

Commits on Apr 10, 2023

Store final layer LM output and record AUROC and acc (EleutherAI#165 )

committedApr 10, 2023
save eval runs to separate subfolders by target dataset (EleutherAI#174 )

ChristyKoh
and
pre-commit-ci[bot]
committedApr 10, 2023
[pre-commit.ci] pre-commit autoupdate
pre-commit-ci[bot]
committedApr 10, 2023

Commits on Apr 9, 2023

Merge pull request EleutherAI#177 from EleutherAI/spawn
Kyle1668
committedApr 9, 2023

Commits on Apr 8, 2023

Force spawn start method
norabelrose
committedApr 8, 2023

Commits on Apr 7, 2023

Commits on Apr 5, 2023

Turn on import sorting (EleutherAI#168 )
norabelrose
committedApr 5, 2023
[pre-commit.ci] pre-commit autoupdate (EleutherAI#162 )
pre-commit-ci[bot]
committedApr 5, 2023
Replace flake with ruff (EleutherAI#154 )

thejaminator
and
pre-commit-ci[bot]
committedApr 5, 2023

Commits on Apr 4, 2023

Create devcontainer (EleutherAI#150 )
derpyplops
committedApr 4, 2023

Commits on Mar 31, 2023

Merge pull request EleutherAI#160 from EleutherAI/fix-max-examples
AlexTMallen
committedMar 31, 2023

Commits on Mar 30, 2023

Merge pull request EleutherAI#156 from EleutherAI/lauritowal-patch-4
AlexTMallen
committedMar 30, 2023
split max_examples between processes
AlexTMallen
committedMar 30, 2023

Commits on Mar 28, 2023

Merge pull request EleutherAI#123 from EleutherAI/multi-datasets
lauritowal
committedMar 28, 2023
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committedMar 28, 2023
fix pre-commit errors
lauritowal
committedMar 28, 2023
Update prompt_loading.py
lauritowal
committedMar 28, 2023