Skip to content

Issues: EleutherAI/pythia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
25 Open 84 Closed
25 Open 84 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Pythia experiment 1: Grammar trajectories / BLiMP
#13 by haileyschoelkopf was closed Jan 30, 2023
3 tasks
1
Will there going to be checkpoints for masked language models?
#34 by luffycodes was closed Mar 25, 2023
1
Does early memorization predict late memorization? good first issue Good for newcomers help wanted This issue needs assistance
#29 by StellaAthena was closed Mar 21, 2023
@lintangsutawika
11
Complete evaluation of models in pythia suite
#28 by StellaAthena was closed Mar 21, 2023
@uSaiPrashanth
Host Deduped Pile raw jsonls
#27 by haileyschoelkopf was closed Dec 22, 2022
5
Fit the exponential decay curve to accuracy distribution good first issue Good for newcomers help wanted This issue needs assistance
#23 by StellaAthena was closed Feb 13, 2023
@norabelrose
3
Run a Komogorov Smirnov test to see if the fully memorized points are uniformly distributed
#22 by StellaAthena was closed Mar 21, 2023
@StellaAthena @uSaiPrashanth
Does training order effect memorization?
#21 by StellaAthena was closed Mar 21, 2023
@uSaiPrashanth
Survival model analysis help wanted This issue needs assistance
#20 by StellaAthena was closed Mar 21, 2023
@Quentin-Anthony
3
Does memorization in small models predict memorization in large models? good first issue Good for newcomers help wanted This issue needs assistance
#19 by uSaiPrashanth was closed Mar 21, 2023
@lintangsutawika
3
General zero and few-shot evaluations on model suite
#16 by StellaAthena was closed Dec 31, 2022
10 tasks
1
@Kyle1668 @haileyschoelkopf
3
The Grammar Learning Trajectories of Large Language Models feature request New feature or request
#1 by StellaAthena was closed Jan 30, 2023
Pythia Experiment 3: Gender bias
#14 by haileyschoelkopf was closed Jan 30, 2023
1 of 6 tasks
@haileyschoelkopf
2
Can't find the index file
#180 by jaydeepborkar was closed Nov 4, 2024
1
Host pythia suite
#12 by haileyschoelkopf was closed Dec 13, 2022
@haileyschoelkopf
2
Improve Pythia repository documentation
#11 by haileyschoelkopf was closed Dec 15, 2022
4 tasks done
@StellaAthena @haileyschoelkopf
Pythia experiment 2: Memorization
#10 by haileyschoelkopf was closed Dec 27, 2022
@uSaiPrashanth
1
Convert model suite to HF
#9 by haileyschoelkopf was closed Nov 23, 2022 Pythia Suite Release
@haileyschoelkopf
1
Train Pythia model suite
#8 by StellaAthena was closed Nov 23, 2022 Pythia Suite Release
@StellaAthena @ShivanshuPurohit @haileyschoelkopf
1
Training order and memorization feature request New feature or request
#6 by StellaAthena was closed Dec 27, 2022
@StellaAthena @uSaiPrashanth
Social bias and knowledge of social bias feature request New feature or request
#5 by StellaAthena was closed Jan 30, 2023
@haileyschoelkopf @aflah02
12
Comparing the Logit Lens to Example Difficulty feature request New feature or request
#4 by StellaAthena was closed Dec 15, 2022
@igor-krawczuk
Train models
#3 by StellaAthena was closed Dec 15, 2022
@StellaAthena @ShivanshuPurohit
Finalize configs for model suite
#2 by StellaAthena was closed Nov 15, 2022
@StellaAthena
Host Pile pretokenized .bin and .idx megatron files?
#15 by haileyschoelkopf was closed Jan 2, 2023
1
7
ProTip! Exclude everything labeled bug with -label:bug.