Skip to content

Pull requests: EleutherAI/elk

New pull request New
Clear current search query, filters, and sorts
1 Open 71 Closed
1 Open 71 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Cluster bootstrap for metrics; refactor metric computations into evaluate_preds
#197 by norabelrose was merged Apr 19, 2023 Loading…
1
Sweep MVP
#191 by norabelrose was merged Apr 16, 2023 Loading…
3
Blazing fast bootstrap stderrs for AUROC
#190 by norabelrose was merged Apr 16, 2023 Loading…
Multiple datasets refactor
#189 by norabelrose was merged Apr 14, 2023 Loading…
1
18
Prevent invalidation of the hidden state cache when num_gpus changes
#182 by norabelrose was merged Apr 12, 2023 Loading…
1
1
Support multiple choice datasets
#179 by norabelrose was merged Apr 16, 2023 Loading…
2
Force spawn start method
#177 by norabelrose was merged Apr 9, 2023 Loading…
1
Use model name and dataset to organize reporters in elicit
#175 by norabelrose was merged Apr 7, 2023 Loading…
Turn on import sorting
#168 by norabelrose was merged Apr 5, 2023 Loading…
1
Store final layer LM output and record AUROC and acc
#165 by norabelrose was merged Apr 10, 2023 Loading…
14
Refactor & rename lanczos_eigsh for convergence, correctness, & speed
#164 by norabelrose was merged Apr 7, 2023 Loading…
Update README to say CRC instead of CCS
#145 by norabelrose was merged Mar 23, 2023 Loading…
Set --balance to True by default
#144 by norabelrose was closed Apr 5, 2023 Loading…
1
Go back to using 1000 datapoints as the default
#139 by norabelrose was merged Mar 18, 2023 Loading…
1
Add data_dir to PromptDataset
#138 by norabelrose was merged Mar 20, 2023 Loading…
Custom PyTorch implementation of eigsh
#137 by norabelrose was merged Mar 18, 2023 Loading…
1
Use CuPy sparse eigsh when available
#136 by norabelrose was closed Mar 17, 2023 Loading…
Support L2 regularization & cross validation for Classifier
#135 by norabelrose was merged Mar 19, 2023 Loading…
1
Replace held_out_split with select_train_val_splits
#133 by norabelrose was merged Mar 17, 2023 Loading…
3
Fix broken handling of splits
#132 by norabelrose was merged Mar 16, 2023 Loading…
Add a calibration error statistic
#126 by norabelrose was merged Mar 16, 2023 Loading…
7
EigenReporter and VINC algorithm
#124 by norabelrose was merged Mar 15, 2023 Loading…
22
PCA init MVP enhancement New feature or request
#117 by norabelrose was merged Mar 8, 2023 Loading…
3
Factor out pseudo-classifier into Reporter method
#115 by norabelrose was merged Mar 8, 2023 Loading…
1
Switch back to imap_unordered in training while ensuring CSV is still sorted enhancement New feature or request
#114 by norabelrose was merged Mar 8, 2023 Loading…
1
ProTip! Add no:assignee to see everything that’s not assigned.