Skip to content

Issues: EleutherAI/pythia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
18 Open 82 Closed
18 Open 82 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Reshape error in batch viewer
#158 by activatedgeek was closed May 11, 2024
1
Is there existing code to resume training from specific checkpoint?
#150 by javirandor was closed Mar 1, 2024
1
Would it be possible to share training loss curves on the original Pythia models?
#145 by itsnamgyu was closed Jan 22, 2024
4
Details about "EleutherAI/pythia-160m-seed*" models
#142 by IanMagnusson was closed Dec 12, 2023
3
Missing / undownloadable checkpoints on huggingface
#141 by mirandrom was closed Jan 30, 2024
@haileyschoelkopf
3
.
#140 by ParthaKrPaul was closed Dec 2, 2023
2
Pytia or GPT-neox?
#138 by borgr was closed Dec 12, 2023
1
Deduplicated Pile dataset with Domain Attribution
#137 by michaelduan8 was closed Nov 21, 2023
Replicating the Training Data Order
#136 by prakharg24 was closed Nov 23, 2023
1
The value of weight decay
#132 by yehuitang was closed Nov 9, 2023
1
Model Initialization Question
#129 by yanlai00 was closed Nov 4, 2023
1
Batch Viewer : Why Sequence Length 2049?
#123 by prakharg24 was closed Nov 2, 2023
12
The performance about pythia and LLaMA model architecture
#122 by peiyingxin was closed Oct 30, 2023
1
Mismatch about the evaluation results
#118 by yuzc19 was closed Oct 30, 2023
11
Weights tying
#117 by link-er was closed Oct 8, 2023
1
Convert the huggingface checkpoint to GPT-Neox checkpoint
#116 by ZhiYuanZeng was closed Aug 13, 2023
2
Clarification of Pythia tokenizer(s) at different sizes, steps and data preprocessing?
#115 by RylanSchaeffer was closed Aug 3, 2023
1
Error when running unshard_memmap.py
#114 by ShaneeyS was closed Nov 4, 2023
2
Can I provide custom data and continue training Pythia on this new data?
#113 by GeorgiAngelov was closed Jul 21, 2023
1
Difference between LFS and HuggingFace datasets?
#112 by eric-mitchell was closed Jul 21, 2023
1
Multiple training runs of same model with different random seed for weight initialisation
#110 by KarolisRam was closed Jun 22, 2023
1
Possible error in Pythia-12B-deduped step 32000
#108 by smahdavi4 was closed Jun 15, 2023
2
pythia-12b checkpoints missing on HuggingFace for step4000 and step32000
#107 by byungdoh was closed Jun 4, 2023
2
Is there a template poilerplate for the prompt used in C.1 gender bias intervention?
#106 by ruyuan-zuo was closed Jul 21, 2023
1
Train/valid/test split
#102 by choidami was closed May 21, 2023
1
ProTip! Follow long discussions with comments:>50.