Skip to content

Issues: EleutherAI/pythia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
20 Open 82 Closed
20 Open 82 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Weights tying
#117 by link-er was closed Oct 8, 2023
1
Clarification of Pythia tokenizer(s) at different sizes, steps and data preprocessing?
#115 by RylanSchaeffer was closed Aug 3, 2023
1
Can I provide custom data and continue training Pythia on this new data?
#113 by GeorgiAngelov was closed Jul 21, 2023
1
Difference between LFS and HuggingFace datasets?
#112 by eric-mitchell was closed Jul 21, 2023
1
Multiple training runs of same model with different random seed for weight initialisation
#110 by KarolisRam was closed Jun 22, 2023
1
Is there a template poilerplate for the prompt used in C.1 gender bias intervention?
#106 by ruyuan-zuo was closed Jul 21, 2023
1
Train/valid/test split
#102 by choidami was closed May 21, 2023
1
Pythia 6.9B Model Missing Checkpoint
#94 by chujiezheng was closed Apr 24, 2023
1
Fine tune for text generation on custom data
#89 by samarthsarin was closed Apr 18, 2023
1
training logs
#86 by stjaco was closed Apr 15, 2023
1
Mistake in readme
#81 by zplizzi was closed Apr 8, 2023
1
Generation issues when using KoboldAI
#59 by candymint23 was closed Feb 6, 2023
1
pythia-13b size mismatch
#41 by ejmichaud was closed Dec 26, 2022
1
Data viewing / Batch Reconstruction utility feature request New feature or request
#35 by haileyschoelkopf was closed Feb 3, 2023
5 of 6 tasks
@haileyschoelkopf
1
Will there going to be checkpoints for masked language models?
#34 by luffycodes was closed Mar 25, 2023
1
Pythia experiment 1: Grammar trajectories / BLiMP
#13 by haileyschoelkopf was closed Jan 30, 2023
3 tasks
1
Pythia experiment 2: Memorization
#10 by haileyschoelkopf was closed Dec 27, 2022
@uSaiPrashanth
1
Convert model suite to HF
#9 by haileyschoelkopf was closed Nov 23, 2022 Pythia Suite Release
@haileyschoelkopf
1
Train Pythia model suite
#8 by StellaAthena was closed Nov 23, 2022 Pythia Suite Release
@StellaAthena @ShivanshuPurohit @haileyschoelkopf
1
Deduplicated Pile dataset with Domain Attribution
#137 by michaelduan8 was closed Nov 21, 2023
Revamp experiment organization and migrate code when necessary documentation Improvements or additions to documentation
#99 by StellaAthena was closed Jun 4, 2023
3 tasks
1
@StellaAthena
Complete outstanding evals
#70 by haileyschoelkopf was closed Mar 21, 2023
34 of 38 tasks
@uSaiPrashanth @haileyschoelkopf @aviskowron
Bias metrics on selected Pythia models
#51 by haileyschoelkopf was closed Jan 30, 2023
2 tasks
Complete evaluation of models in pythia suite
#28 by StellaAthena was closed Mar 21, 2023
@uSaiPrashanth
Run a Komogorov Smirnov test to see if the fully memorized points are uniformly distributed
#22 by StellaAthena was closed Mar 21, 2023
@StellaAthena @uSaiPrashanth
ProTip! Type g i on any issue or pull request to go back to the issue listing page.