Skip to content

Issues: EleutherAI/pythia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
18 Open 82 Closed
18 Open 82 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

.
#140 by ParthaKrPaul was closed Dec 2, 2023
2
Convert the huggingface checkpoint to GPT-Neox checkpoint
#116 by ZhiYuanZeng was closed Aug 13, 2023
2
Error when running unshard_memmap.py
#114 by ShaneeyS was closed Nov 4, 2023
2
Possible error in Pythia-12B-deduped step 32000
#108 by smahdavi4 was closed Jun 15, 2023
2
pythia-12b checkpoints missing on HuggingFace for step4000 and step32000
#107 by byungdoh was closed Jun 4, 2023
2
Will memorization experimental codes be released?
#98 by chujiezheng was closed May 22, 2023
2
Fine-tuning recommendations
#96 by RainIwakura was closed Apr 28, 2023
2
Training time or approximation of TFLOPs?
#87 by zetian1025 was closed Apr 13, 2023
2
How was deduplication done?
#75 by theblackcat102 was closed Mar 27, 2023
2
Inconsistency in vocab sizes
#68 by nkandpa2 was closed Mar 2, 2023
2
pythia ckpts in hf config vocab_size(50304, 70m ckpt) and tokenizer.json(50257) are mismatch
#65 by zhangyichang was closed Feb 6, 2023
2
19m param model
#60 by robflynnyh was closed Jan 23, 2023
2
Train M -> F pronoun interventions on selected Pythia models
#52 by haileyschoelkopf was closed Jan 30, 2023
5 tasks
2
Pythia v.s. GPT-neox
#48 by chuanli11 was closed Jan 2, 2023
2
Inconsistent batch sizes reported in readme
#39 by langosco was closed Jan 2, 2023
2
EleutherAI/pythia-800m tokenizer adds unusual kwargs, causes a ValueError when evaluating model
#36 by ejmichaud was closed Dec 20, 2022
2
Pythia Experiment 3: Gender bias
#14 by haileyschoelkopf was closed Jan 30, 2023
1 of 6 tasks
@haileyschoelkopf
2
Host pythia suite
#12 by haileyschoelkopf was closed Dec 13, 2022
@haileyschoelkopf
2
Reshape error in batch viewer
#158 by activatedgeek was closed May 11, 2024
1
Is there existing code to resume training from specific checkpoint?
#150 by javirandor was closed Mar 1, 2024
1
Pytia or GPT-neox?
#138 by borgr was closed Dec 12, 2023
1
Replicating the Training Data Order
#136 by prakharg24 was closed Nov 23, 2023
1
The value of weight decay
#132 by yehuitang was closed Nov 9, 2023
1
Model Initialization Question
#129 by yanlai00 was closed Nov 4, 2023
1
The performance about pythia and LLaMA model architecture
#122 by peiyingxin was closed Oct 30, 2023
1
ProTip! no:milestone will show everything without a milestone.