Skip to content

Issues: EleutherAI/pythia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
18 Open 82 Closed
18 Open 82 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Training order and memorization feature request New feature or request
#6 by StellaAthena was closed Dec 27, 2022
@StellaAthena @uSaiPrashanth
👀 1
Does memorization in small models predict memorization in large models? good first issue Good for newcomers help wanted This issue needs assistance
#19 by uSaiPrashanth was closed Mar 21, 2023
@lintangsutawika
3
Train models
#3 by StellaAthena was closed Dec 15, 2022
@StellaAthena @ShivanshuPurohit
Comparing the Logit Lens to Example Difficulty feature request New feature or request
#4 by StellaAthena was closed Dec 15, 2022
@igor-krawczuk
Social bias and knowledge of social bias feature request New feature or request
#5 by StellaAthena was closed Jan 30, 2023
@haileyschoelkopf @aflah02
12
Train Pythia model suite
#8 by StellaAthena was closed Nov 23, 2022 Pythia Suite Release
@StellaAthena @ShivanshuPurohit @haileyschoelkopf
1
Convert model suite to HF
#9 by haileyschoelkopf was closed Nov 23, 2022 Pythia Suite Release
@haileyschoelkopf
1
Pythia experiment 2: Memorization
#10 by haileyschoelkopf was closed Dec 27, 2022
@uSaiPrashanth
1
Improve Pythia repository documentation
#11 by haileyschoelkopf was closed Dec 15, 2022
4 tasks done
@StellaAthena @haileyschoelkopf
Host pythia suite
#12 by haileyschoelkopf was closed Dec 13, 2022
@haileyschoelkopf
2
Pythia experiment 1: Grammar trajectories / BLiMP
#13 by haileyschoelkopf was closed Jan 30, 2023
3 tasks
1
Pythia Experiment 3: Gender bias
#14 by haileyschoelkopf was closed Jan 30, 2023
1 of 6 tasks
@haileyschoelkopf
2
The Grammar Learning Trajectories of Large Language Models feature request New feature or request
#1 by StellaAthena was closed Jan 30, 2023
General zero and few-shot evaluations on model suite
#16 by StellaAthena was closed Dec 31, 2022
10 tasks
1
@Kyle1668 @haileyschoelkopf
3
Survival model analysis help wanted This issue needs assistance
#20 by StellaAthena was closed Mar 21, 2023
@Quentin-Anthony
3
Does training order effect memorization?
#21 by StellaAthena was closed Mar 21, 2023
@uSaiPrashanth
Run a Komogorov Smirnov test to see if the fully memorized points are uniformly distributed
#22 by StellaAthena was closed Mar 21, 2023
@StellaAthena @uSaiPrashanth
Fit the exponential decay curve to accuracy distribution good first issue Good for newcomers help wanted This issue needs assistance
#23 by StellaAthena was closed Feb 13, 2023
@norabelrose
3
Host Deduped Pile raw jsonls
#27 by haileyschoelkopf was closed Dec 22, 2022
5
Complete evaluation of models in pythia suite
#28 by StellaAthena was closed Mar 21, 2023
@uSaiPrashanth
Does early memorization predict late memorization? good first issue Good for newcomers help wanted This issue needs assistance
#29 by StellaAthena was closed Mar 21, 2023
@lintangsutawika
11
Will there going to be checkpoints for masked language models?
#34 by luffycodes was closed Mar 25, 2023
1
Data viewing / Batch Reconstruction utility feature request New feature or request
#35 by haileyschoelkopf was closed Feb 3, 2023
5 of 6 tasks
@haileyschoelkopf
1
Reshape error in batch viewer
#158 by activatedgeek was closed May 11, 2024
1
Host Pile pretokenized .bin and .idx megatron files?
#15 by haileyschoelkopf was closed Jan 2, 2023
1
7
ProTip! What’s not been updated in a month: updated:<2024-05-22.