Skip to content

Issues: EleutherAI/pythia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
25 Open 72 Closed
25 Open 72 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Finalize configs for model suite
#2 by StellaAthena was closed Nov 15, 2022 updated Nov 16, 2022
@StellaAthena
Train Pythia model suite
#8 by StellaAthena was closed Nov 23, 2022 updated Nov 23, 2022 Pythia Suite Release
@StellaAthena @ShivanshuPurohit @haileyschoelkopf
1
Convert model suite to HF
#9 by haileyschoelkopf was closed Nov 23, 2022 updated Nov 23, 2022 Pythia Suite Release
@haileyschoelkopf
1
Host pythia suite
#12 by haileyschoelkopf was closed Dec 13, 2022 updated Dec 13, 2022
@haileyschoelkopf
2
Improve Pythia repository documentation
#11 by haileyschoelkopf was closed Dec 15, 2022 updated Dec 15, 2022
4 tasks done
@StellaAthena @haileyschoelkopf
Train models
#3 by StellaAthena was closed Dec 15, 2022 updated Dec 15, 2022
@StellaAthena @ShivanshuPurohit
EleutherAI/pythia-800m tokenizer adds unusual kwargs, causes a ValueError when evaluating model
#36 by ejmichaud was closed Dec 20, 2022 updated Dec 20, 2022
2
Host Deduped Pile raw jsonls
#27 by haileyschoelkopf was closed Dec 22, 2022 updated Dec 22, 2022
5
pythia-13b size mismatch
#41 by ejmichaud was closed Dec 26, 2022 updated Dec 26, 2022
1
Pythia experiment 2: Memorization
#10 by haileyschoelkopf was closed Dec 27, 2022 updated Dec 27, 2022
@uSaiPrashanth
1
General zero and few-shot evaluations on model suite
#16 by StellaAthena was closed Dec 31, 2022 updated Dec 31, 2022
10 tasks
1
@Kyle1668 @haileyschoelkopf
3
Validation Perplexities
#38 by shoaibahmed was closed Dec 31, 2022 updated Dec 31, 2022
5
Inconsistent batch sizes reported in readme
#39 by langosco was closed Jan 2, 2023 updated Jan 2, 2023
2
Pythia v.s. GPT-neox
#48 by chuanli11 was closed Jan 2, 2023 updated Jan 2, 2023
2
Host Pile pretokenized .bin and .idx megatron files?
#15 by haileyschoelkopf was closed Jan 2, 2023 updated Jan 2, 2023
1
7
19m param model
#60 by robflynnyh was closed Jan 23, 2023 updated Jan 23, 2023
2
Train M -> F pronoun interventions on selected Pythia models
#52 by haileyschoelkopf was closed Jan 30, 2023 updated Jan 30, 2023
5 tasks
2
Bias metrics on selected Pythia models
#51 by haileyschoelkopf was closed Jan 30, 2023 updated Jan 30, 2023
2 tasks
Pythia experiment 1: Grammar trajectories / BLiMP
#13 by haileyschoelkopf was closed Jan 30, 2023 updated Jan 30, 2023
3 tasks
1
Pythia Experiment 3: Gender bias
#14 by haileyschoelkopf was closed Jan 30, 2023 updated Jan 30, 2023
1 of 6 tasks
@haileyschoelkopf
2
pythia ckpts in hf config vocab_size(50304, 70m ckpt) and tokenizer.json(50257) are mismatch
#65 by zhangyichang was closed Feb 6, 2023 updated Feb 6, 2023
2
Generation issues when using KoboldAI
#59 by candymint23 was closed Feb 6, 2023 updated Feb 6, 2023
1
Pythia few shot capabilities
#56 by AdirRahamim was closed Feb 2, 2023 updated Feb 21, 2023
4
Inconsistency in vocab sizes
#68 by nkandpa2 was closed Mar 2, 2023 updated Mar 2, 2023
2
Run a Komogorov Smirnov test to see if the fully memorized points are uniformly distributed
#22 by StellaAthena was closed Mar 21, 2023 updated Mar 21, 2023
@StellaAthena @uSaiPrashanth
ProTip! Exclude everything labeled bug with -label:bug.