Skip to content

Issues: EleutherAI/pythia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
18 Open 82 Closed
18 Open 82 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

The Grammar Learning Trajectories of Large Language Models feature request New feature or request
#1 by StellaAthena was closed Jan 30, 2023
Finalize configs for model suite
#2 by StellaAthena was closed Nov 15, 2022
@StellaAthena
Train models
#3 by StellaAthena was closed Dec 15, 2022
@StellaAthena @ShivanshuPurohit
Comparing the Logit Lens to Example Difficulty feature request New feature or request
#4 by StellaAthena was closed Dec 15, 2022
@igor-krawczuk
Training order and memorization feature request New feature or request
#6 by StellaAthena was closed Dec 27, 2022
@StellaAthena @uSaiPrashanth
Improve Pythia repository documentation
#11 by haileyschoelkopf was closed Dec 15, 2022
4 tasks done
@StellaAthena @haileyschoelkopf
Does training order effect memorization?
#21 by StellaAthena was closed Mar 21, 2023
@uSaiPrashanth
Run a Komogorov Smirnov test to see if the fully memorized points are uniformly distributed
#22 by StellaAthena was closed Mar 21, 2023
@StellaAthena @uSaiPrashanth
Complete evaluation of models in pythia suite
#28 by StellaAthena was closed Mar 21, 2023
@uSaiPrashanth
Bias metrics on selected Pythia models
#51 by haileyschoelkopf was closed Jan 30, 2023
2 tasks
Complete outstanding evals
#70 by haileyschoelkopf was closed Mar 21, 2023
34 of 38 tasks
@uSaiPrashanth @haileyschoelkopf @aviskowron
Revamp experiment organization and migrate code when necessary documentation Improvements or additions to documentation
#99 by StellaAthena was closed Jun 4, 2023
3 tasks
1
@StellaAthena
Deduplicated Pile dataset with Domain Attribution
#137 by michaelduan8 was closed Nov 21, 2023
Train Pythia model suite
#8 by StellaAthena was closed Nov 23, 2022 Pythia Suite Release
@StellaAthena @ShivanshuPurohit @haileyschoelkopf
1
Convert model suite to HF
#9 by haileyschoelkopf was closed Nov 23, 2022 Pythia Suite Release
@haileyschoelkopf
1
Pythia experiment 2: Memorization
#10 by haileyschoelkopf was closed Dec 27, 2022
@uSaiPrashanth
1
Pythia experiment 1: Grammar trajectories / BLiMP
#13 by haileyschoelkopf was closed Jan 30, 2023
3 tasks
1
Will there going to be checkpoints for masked language models?
#34 by luffycodes was closed Mar 25, 2023
1
Data viewing / Batch Reconstruction utility feature request New feature or request
#35 by haileyschoelkopf was closed Feb 3, 2023
5 of 6 tasks
@haileyschoelkopf
1
pythia-13b size mismatch
#41 by ejmichaud was closed Dec 26, 2022
1
Generation issues when using KoboldAI
#59 by candymint23 was closed Feb 6, 2023
1
Mistake in readme
#81 by zplizzi was closed Apr 8, 2023
1
training logs
#86 by stjaco was closed Apr 15, 2023
1
Fine tune for text generation on custom data
#89 by samarthsarin was closed Apr 18, 2023
1
Pythia 6.9B Model Missing Checkpoint
#94 by chujiezheng was closed Apr 24, 2023
1
ProTip! Add no:assignee to see everything that’s not assigned.