Skip to content

Issues: EleutherAI/pythia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
18 Open 82 Closed
18 Open 82 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

release of checkpoints of different steps
#101 by TobiasLee was closed May 26, 2023
5
Revamp experiment organization and migrate code when necessary documentation Improvements or additions to documentation
#99 by StellaAthena was closed Jun 4, 2023
3 tasks
1
@StellaAthena
Will memorization experimental codes be released?
#98 by chujiezheng was closed May 22, 2023
2
the loss of pythia training
#97 by Wangpeiyi9979 was closed May 1, 2023
3
Fine-tuning recommendations
#96 by RainIwakura was closed Apr 28, 2023
2
Pythia 6.9B Model Missing Checkpoint
#94 by chujiezheng was closed Apr 24, 2023
1
Is there an access to the deduplicated version of the data with meta info?
#92 by Jason3900 was closed Jul 21, 2023
6
Fine tune for text generation on custom data
#89 by samarthsarin was closed Apr 18, 2023
1
Training time or approximation of TFLOPs?
#87 by zetian1025 was closed Apr 13, 2023
2
training logs
#86 by stjaco was closed Apr 15, 2023
1
Are pythia_v0 and the new pythia_v1 models using the same input embedding matrix?
#85 by levmckinney was closed Apr 24, 2023
3
Weights of "step0" and "step1" checkpoints are identical for all pythia models
#83 by byungdoh was closed Apr 20, 2023
6
Mistake in readme
#81 by zplizzi was closed Apr 8, 2023
1
Add more details for reproducing training runs
#79 by zplizzi was closed Apr 18, 2023
5
Ordering of deduplicated datasets?
#76 by zplizzi was closed Mar 20, 2023
4
How was deduplication done?
#75 by theblackcat102 was closed Mar 27, 2023
2
Complete outstanding evals
#70 by haileyschoelkopf was closed Mar 21, 2023
34 of 38 tasks
@uSaiPrashanth @haileyschoelkopf @aviskowron
What tool do you use for your data preprocessing/binarization?
#69 by ajesujoba was closed Apr 18, 2023
9
Inconsistency in vocab sizes
#68 by nkandpa2 was closed Mar 2, 2023
2
pythia ckpts in hf config vocab_size(50304, 70m ckpt) and tokenizer.json(50257) are mismatch
#65 by zhangyichang was closed Feb 6, 2023
2
19m param model
#60 by robflynnyh was closed Jan 23, 2023
2
Generation issues when using KoboldAI
#59 by candymint23 was closed Feb 6, 2023
1
Pythia few shot capabilities
#56 by AdirRahamim was closed Feb 2, 2023
4
Question about naming convention for models documentation Improvements or additions to documentation
#54 by ejmichaud was closed Jan 23, 2023
@StellaAthena
3
Train M -> F pronoun interventions on selected Pythia models
#52 by haileyschoelkopf was closed Jan 30, 2023
5 tasks
2
ProTip! Updated in the last three days: updated:>2024-06-29.