Skip to content

Issues: EleutherAI/pythia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
18 Open 82 Closed
18 Open 82 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Finalize configs for model suite
#2 by StellaAthena was closed Nov 15, 2022 updated Nov 16, 2022
@StellaAthena
Train Pythia model suite
#8 by StellaAthena was closed Nov 23, 2022 updated Nov 23, 2022 Pythia Suite Release
@StellaAthena @ShivanshuPurohit @haileyschoelkopf
1
Convert model suite to HF
#9 by haileyschoelkopf was closed Nov 23, 2022 updated Nov 23, 2022 Pythia Suite Release
@haileyschoelkopf
1
Host pythia suite
#12 by haileyschoelkopf was closed Dec 13, 2022 updated Dec 13, 2022
@haileyschoelkopf
2
Improve Pythia repository documentation
#11 by haileyschoelkopf was closed Dec 15, 2022 updated Dec 15, 2022
4 tasks done
@StellaAthena @haileyschoelkopf
Train models
#3 by StellaAthena was closed Dec 15, 2022 updated Dec 15, 2022
@StellaAthena @ShivanshuPurohit
Comparing the Logit Lens to Example Difficulty feature request New feature or request
#4 by StellaAthena was closed Dec 15, 2022 updated Dec 15, 2022
@igor-krawczuk
EleutherAI/pythia-800m tokenizer adds unusual kwargs, causes a ValueError when evaluating model
#36 by ejmichaud was closed Dec 20, 2022 updated Dec 20, 2022
2
Host Deduped Pile raw jsonls
#27 by haileyschoelkopf was closed Dec 22, 2022 updated Dec 22, 2022
5
pythia-13b size mismatch
#41 by ejmichaud was closed Dec 26, 2022 updated Dec 26, 2022
1
Pythia experiment 2: Memorization
#10 by haileyschoelkopf was closed Dec 27, 2022 updated Dec 27, 2022
@uSaiPrashanth
1
Training order and memorization feature request New feature or request
#6 by StellaAthena was closed Dec 27, 2022 updated Dec 27, 2022
@StellaAthena @uSaiPrashanth
General zero and few-shot evaluations on model suite
#16 by StellaAthena was closed Dec 31, 2022 updated Dec 31, 2022
10 tasks
1
@Kyle1668 @haileyschoelkopf
3
Validation Perplexities
#38 by shoaibahmed was closed Dec 31, 2022 updated Dec 31, 2022
5
Fix currently uploaded eval-harness numbers for 1.3B ; 6.7B bug Something isn't working
#37 by haileyschoelkopf was closed Jan 1, 2023 updated Jan 1, 2023
@StellaAthena @haileyschoelkopf
3
Inconsistent batch sizes reported in readme
#39 by langosco was closed Jan 2, 2023 updated Jan 2, 2023
2
Pythia v.s. GPT-neox
#48 by chuanli11 was closed Jan 2, 2023 updated Jan 2, 2023
2
Host Pile pretokenized .bin and .idx megatron files?
#15 by haileyschoelkopf was closed Jan 2, 2023 updated Jan 2, 2023
1
7
Question about naming convention for models documentation Improvements or additions to documentation
#54 by ejmichaud was closed Jan 23, 2023 updated Jan 23, 2023
@StellaAthena
3
19m param model
#60 by robflynnyh was closed Jan 23, 2023 updated Jan 23, 2023
2
Train M -> F pronoun interventions on selected Pythia models
#52 by haileyschoelkopf was closed Jan 30, 2023 updated Jan 30, 2023
5 tasks
2
Bias metrics on selected Pythia models
#51 by haileyschoelkopf was closed Jan 30, 2023 updated Jan 30, 2023
2 tasks
Social bias and knowledge of social bias feature request New feature or request
#5 by StellaAthena was closed Jan 30, 2023 updated Jan 30, 2023
@haileyschoelkopf @aflah02
12
Pythia experiment 1: Grammar trajectories / BLiMP
#13 by haileyschoelkopf was closed Jan 30, 2023 updated Jan 30, 2023
3 tasks
1
Pythia Experiment 3: Gender bias
#14 by haileyschoelkopf was closed Jan 30, 2023 updated Jan 30, 2023
1 of 6 tasks
@haileyschoelkopf
2
ProTip! What’s not been updated in a month: updated:<2024-05-22.