Skip to content

Pull requests: EleutherAI/elk

New pull request New
Clear current search query, filters, and sorts
1 Open 32 Closed
1 Open 32 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Bug/more than one variant
#105 by AlexTMallen was merged Mar 6, 2023 Loading… updated Mar 6, 2023
3
Prompt var loss
#107 by AlexTMallen was merged Mar 7, 2023 Loading… updated Mar 7, 2023
1
add pseudo_val_labels
#108 by AlexTMallen was merged Mar 7, 2023 Loading… updated Mar 7, 2023
Max examples arg
#109 by AlexTMallen was merged Mar 7, 2023 Loading… updated Mar 7, 2023
1
Custom loss
#111 by AlexTMallen was merged Mar 7, 2023 Loading… updated Mar 7, 2023
1
2
rename math
#112 by AlexTMallen was merged Mar 8, 2023 Loading… updated Mar 8, 2023
Support boolq inference
#121 by AlexTMallen was merged Mar 10, 2023 Loading… updated Mar 10, 2023
1
Fix: PromptDataset inserting fake labels into its output bug Something isn't working
#127 by AlexTMallen was merged Mar 15, 2023 Loading… updated Mar 15, 2023
1
add @torch.no_grad to extract_hiddens
#130 by AlexTMallen was merged Mar 15, 2023 Loading… updated Mar 15, 2023
add support for piqa and super_glue copa
#131 by AlexTMallen was merged Mar 16, 2023 Loading… updated Mar 16, 2023
1
Sort outputs by variant id during extraction
#122 by AlexTMallen was merged Mar 17, 2023 Loading… updated Mar 17, 2023
3
More datasets
#140 by AlexTMallen was merged Mar 20, 2023 Loading… updated Mar 20, 2023
8
select_usable_gpus will now wait for gpus to have min memory available
#148 by AlexTMallen was merged Mar 24, 2023 Loading… updated Mar 24, 2023
2
split max_examples between processes bug Something isn't working
#160 by AlexTMallen was merged Mar 31, 2023 Loading… updated Mar 31, 2023
Fix swapped labels and probs in calibration error metric update bug Something isn't working
#194 by AlexTMallen was merged Apr 16, 2023 Loading… updated Apr 16, 2023
Fix accuracy computation in Reporter
#195 by AlexTMallen was merged Apr 17, 2023 Loading… updated Apr 17, 2023
Fix acc for supervised (in the same way as #195)
#196 by AlexTMallen was closed Apr 17, 2023 Loading… updated Apr 17, 2023
1
Make normalization a property of Reporter; support eval with only one split
#170 by AlexTMallen was closed Apr 18, 2023 Loading… updated Apr 18, 2023
1
Raw extraction
#200 by AlexTMallen was closed Apr 21, 2023 Loading… updated Apr 21, 2023
1
Update Python versions in Readme
#214 by AlexTMallen was merged Apr 25, 2023 Loading… updated Apr 25, 2023
Fix num_variants and num_shots arg bug Something isn't working
#229 by AlexTMallen was merged May 1, 2023 Loading… updated May 1, 2023
1
add post_init checking for at least one dataset
#237 by AlexTMallen was merged May 2, 2023 Loading… updated May 2, 2023
Reduce VINC reporter file size by >1000x
#219 by AlexTMallen was merged May 3, 2023 Loading… updated May 3, 2023
3
check is streamable
#166 by AlexTMallen was closed May 3, 2023 Loading… updated May 3, 2023
7
log eval stats on train
#240 by AlexTMallen was merged May 4, 2023 Loading… updated May 4, 2023
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.