Skip to content

Issues: EleutherAI/pythia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
18 Open 82 Closed
18 Open 82 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Bias metrics on selected Pythia models
#51 by haileyschoelkopf was closed Jan 30, 2023
2 tasks
Pythia v.s. GPT-neox
#48 by chuanli11 was closed Jan 2, 2023
2
pythia-13b size mismatch
#41 by ejmichaud was closed Dec 26, 2022
1
Inconsistent batch sizes reported in readme
#39 by langosco was closed Jan 2, 2023
2
Validation Perplexities
#38 by shoaibahmed was closed Dec 31, 2022
5
Fix currently uploaded eval-harness numbers for 1.3B ; 6.7B bug Something isn't working
#37 by haileyschoelkopf was closed Jan 1, 2023
@StellaAthena @haileyschoelkopf
3
EleutherAI/pythia-800m tokenizer adds unusual kwargs, causes a ValueError when evaluating model
#36 by ejmichaud was closed Dec 20, 2022
2
Data viewing / Batch Reconstruction utility feature request New feature or request
#35 by haileyschoelkopf was closed Feb 3, 2023
5 of 6 tasks
@haileyschoelkopf
1
Will there going to be checkpoints for masked language models?
#34 by luffycodes was closed Mar 25, 2023
1
Does early memorization predict late memorization? good first issue Good for newcomers help wanted This issue needs assistance
#29 by StellaAthena was closed Mar 21, 2023
@lintangsutawika
11
Complete evaluation of models in pythia suite
#28 by StellaAthena was closed Mar 21, 2023
@uSaiPrashanth
Host Deduped Pile raw jsonls
#27 by haileyschoelkopf was closed Dec 22, 2022
5
Fit the exponential decay curve to accuracy distribution good first issue Good for newcomers help wanted This issue needs assistance
#23 by StellaAthena was closed Feb 13, 2023
@norabelrose
3
Run a Komogorov Smirnov test to see if the fully memorized points are uniformly distributed
#22 by StellaAthena was closed Mar 21, 2023
@StellaAthena @uSaiPrashanth
Does training order effect memorization?
#21 by StellaAthena was closed Mar 21, 2023
@uSaiPrashanth
Survival model analysis help wanted This issue needs assistance
#20 by StellaAthena was closed Mar 21, 2023
@Quentin-Anthony
3
Does memorization in small models predict memorization in large models? good first issue Good for newcomers help wanted This issue needs assistance
#19 by uSaiPrashanth was closed Mar 21, 2023
@lintangsutawika
3
General zero and few-shot evaluations on model suite
#16 by StellaAthena was closed Dec 31, 2022
10 tasks
1
@Kyle1668 @haileyschoelkopf
3
Host Pile pretokenized .bin and .idx megatron files?
#15 by haileyschoelkopf was closed Jan 2, 2023
1
7
Pythia Experiment 3: Gender bias
#14 by haileyschoelkopf was closed Jan 30, 2023
1 of 6 tasks
@haileyschoelkopf
2
Pythia experiment 1: Grammar trajectories / BLiMP
#13 by haileyschoelkopf was closed Jan 30, 2023
3 tasks
1
Host pythia suite
#12 by haileyschoelkopf was closed Dec 13, 2022
@haileyschoelkopf
2
Improve Pythia repository documentation
#11 by haileyschoelkopf was closed Dec 15, 2022
4 tasks done
@StellaAthena @haileyschoelkopf
Pythia experiment 2: Memorization
#10 by haileyschoelkopf was closed Dec 27, 2022
@uSaiPrashanth
1
Convert model suite to HF
#9 by haileyschoelkopf was closed Nov 23, 2022 Pythia Suite Release
@haileyschoelkopf
1
ProTip! Updated in the last three days: updated:>2024-06-19.