Skip to content

Issues: EleutherAI/pythia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
18 Open 82 Closed
18 Open 82 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Batch Viewer : Why Sequence Length 2049?
#123 by prakharg24 was closed Nov 2, 2023
12
Social bias and knowledge of social bias feature request New feature or request
#5 by StellaAthena was closed Jan 30, 2023
@haileyschoelkopf @aflah02
12
Mismatch about the evaluation results
#118 by yuzc19 was closed Oct 30, 2023
11
Does early memorization predict late memorization? good first issue Good for newcomers help wanted This issue needs assistance
#29 by StellaAthena was closed Mar 21, 2023
@lintangsutawika
11
What tool do you use for your data preprocessing/binarization?
#69 by ajesujoba was closed Apr 18, 2023
9
Host Pile pretokenized .bin and .idx megatron files?
#15 by haileyschoelkopf was closed Jan 2, 2023
1
7
Is there an access to the deduplicated version of the data with meta info?
#92 by Jason3900 was closed Jul 21, 2023
6
Weights of "step0" and "step1" checkpoints are identical for all pythia models
#83 by byungdoh was closed Apr 20, 2023
6
release of checkpoints of different steps
#101 by TobiasLee was closed May 26, 2023
5
Add more details for reproducing training runs
#79 by zplizzi was closed Apr 18, 2023
5
Validation Perplexities
#38 by shoaibahmed was closed Dec 31, 2022
5
Host Deduped Pile raw jsonls
#27 by haileyschoelkopf was closed Dec 22, 2022
5
Would it be possible to share training loss curves on the original Pythia models?
#145 by itsnamgyu was closed Jan 22, 2024
4
Ordering of deduplicated datasets?
#76 by zplizzi was closed Mar 20, 2023
4
Pythia few shot capabilities
#56 by AdirRahamim was closed Feb 2, 2023
4
Details about "EleutherAI/pythia-160m-seed*" models
#142 by IanMagnusson was closed Dec 12, 2023
3
Missing / undownloadable checkpoints on huggingface
#141 by mirandrom was closed Jan 30, 2024
@haileyschoelkopf
3
the loss of pythia training
#97 by Wangpeiyi9979 was closed May 1, 2023
3
Are pythia_v0 and the new pythia_v1 models using the same input embedding matrix?
#85 by levmckinney was closed Apr 24, 2023
3
Question about naming convention for models documentation Improvements or additions to documentation
#54 by ejmichaud was closed Jan 23, 2023
@StellaAthena
3
Fix currently uploaded eval-harness numbers for 1.3B ; 6.7B bug Something isn't working
#37 by haileyschoelkopf was closed Jan 1, 2023
@StellaAthena @haileyschoelkopf
3
Fit the exponential decay curve to accuracy distribution good first issue Good for newcomers help wanted This issue needs assistance
#23 by StellaAthena was closed Feb 13, 2023
@norabelrose
3
Survival model analysis help wanted This issue needs assistance
#20 by StellaAthena was closed Mar 21, 2023
@Quentin-Anthony
3
Does memorization in small models predict memorization in large models? good first issue Good for newcomers help wanted This issue needs assistance
#19 by uSaiPrashanth was closed Mar 21, 2023
@lintangsutawika
3
General zero and few-shot evaluations on model suite
#16 by StellaAthena was closed Dec 31, 2022
10 tasks
1
@Kyle1668 @haileyschoelkopf
3
ProTip! Updated in the last three days: updated:>2024-06-19.