Skip to content

Pull requests: EleutherAI/elk

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Sort

Pull requests list

Add data_dir to PromptDataset
#138 by norabelrose was merged Mar 20, 2023 Loading…
Go back to using 1000 datapoints as the default
#139 by norabelrose was merged Mar 18, 2023 Loading…
Update README to say CRC instead of CCS
#145 by norabelrose was merged Mar 23, 2023 Loading…
Store final layer LM output and record AUROC and acc
#165 by norabelrose was merged Apr 10, 2023 Loading…
Turn on import sorting
#168 by norabelrose was merged Apr 5, 2023 Loading…
Force spawn start method
#177 by norabelrose was merged Apr 9, 2023 Loading…
Support multiple choice datasets
#179 by norabelrose was merged Apr 16, 2023 Loading…
Blazing fast bootstrap stderrs for AUROC
#190 by norabelrose was merged Apr 16, 2023 Loading…
Support non-fast tokenizers like LLaMA
#202 by norabelrose was merged Apr 21, 2023 Loading…
Revert "spar mt prompt invar"
#205 by norabelrose was merged Apr 20, 2023 Loading…
testing 123
#206 by norabelrose was closed Apr 21, 2023 Loading…
Turn off variance by default
#224 by norabelrose was merged Apr 29, 2023 Loading…
Lots of simplification and refactoring
#226 by norabelrose was merged Apr 30, 2023 Loading…
Support extraction in 8 bit with bitsandbytes
#227 by norabelrose was merged Apr 30, 2023 Loading…
Load fp32 models in bfloat16 when possible
#231 by norabelrose was merged May 3, 2023 Loading…
CCS results now as expected
#232 by norabelrose was merged May 2, 2023 Loading…
burns shortcut dataset in sweep
#236 by norabelrose was merged May 2, 2023 Loading…
Don't left truncate stuff anymore
#239 by norabelrose was merged May 3, 2023 Loading…
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.