Skip to content

Pull requests: EleutherAI/elk

New pull request New
Clear current search query, filters, and sorts
10 Open 199 Closed
10 Open 199 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Use model name and dataset to organize reporters in elicit
#175 by norabelrose was merged Apr 7, 2023 Loading…
save eval runs to separate subfolders by target dataset
#174 by ChristyKoh was merged Apr 10, 2023 Loading…
1
2
Make normalization a property of Reporter; support eval with only one split
#170 by AlexTMallen was closed Apr 18, 2023 Loading…
1
Turn on import sorting
#168 by norabelrose was merged Apr 5, 2023 Loading…
1
Added confidence, invariance, consistency metrics
#167 by ss-waree was merged Apr 7, 2023 Loading…
4
Store final layer LM output and record AUROC and acc
#165 by norabelrose was merged Apr 10, 2023 Loading…
14
Refactor & rename lanczos_eigsh for convergence, correctness, & speed
#164 by norabelrose was merged Apr 7, 2023 Loading…
[pre-commit.ci] pre-commit autoupdate
#162 by pre-commit-ci bot was merged Apr 5, 2023 Loading…
split max_examples between processes bug Something isn't working
#160 by AlexTMallen was merged Mar 31, 2023 Loading…
update README.md
#156 by lauritowal was merged Mar 30, 2023 Loading…
Create dataclasses for writing to CSV, refactor CSV logging, fix eval CSV columns
#155 by thejaminator was merged Mar 26, 2023 Loading…
10
Replace flake with ruff
#154 by thejaminator was merged Apr 5, 2023 Loading…
1
8
Smoke tests with tiny gpt2, fix CCSReporter
#149 by thejaminator was merged Mar 24, 2023 Loading…
7
select_usable_gpus will now wait for gpus to have min memory available
#148 by AlexTMallen was merged Mar 24, 2023 Loading…
2
Update README to say CRC instead of CCS
#145 by norabelrose was merged Mar 23, 2023 Loading…
fix: reporter.score(...) takes three arguments
#141 by lauritowal was merged Mar 19, 2023 Loading…
Go back to using 1000 datapoints as the default
#139 by norabelrose was merged Mar 18, 2023 Loading…
1
Add data_dir to PromptDataset
#138 by norabelrose was merged Mar 20, 2023 Loading…
Custom PyTorch implementation of eigsh
#137 by norabelrose was merged Mar 18, 2023 Loading…
1
Use CuPy sparse eigsh when available
#136 by norabelrose was closed Mar 17, 2023 Loading…
Support L2 regularization & cross validation for Classifier
#135 by norabelrose was merged Mar 19, 2023 Loading…
1
Replace held_out_split with select_train_val_splits
#133 by norabelrose was merged Mar 17, 2023 Loading…
3
Fix broken handling of splits
#132 by norabelrose was merged Mar 16, 2023 Loading…
add support for piqa and super_glue copa
#131 by AlexTMallen was merged Mar 16, 2023 Loading…
1
add @torch.no_grad to extract_hiddens
#130 by AlexTMallen was merged Mar 15, 2023 Loading…
ProTip! Filter pull requests by the default branch with base:main.