Skip to content

Pull requests: EleutherAI/gpt-neox

New pull request New
Clear current search query, filters, and sorts
28 Open 268 Closed
28 Open 268 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Create train.sh
#12 by sdtblck was merged Dec 26, 2020 Loading…
1 🎉 1
Add WandB logging to evaluate.py
#693 by haileyschoelkopf was merged Sep 22, 2022 Loading…
🎉 1
Fix Large-BS Dataloader Bug
#835 by Quentin-Anthony was merged Mar 16, 2023 Loading…
1
Lion Optimizer good first issue Good for newcomers help wanted This issue needs assistance
#1012 by adi-kmt was closed Oct 20, 2023 Loading…
1
7
Create CODEOWNERS
#8 by StellaAthena was merged Dec 24, 2020 Loading…
remove enwik8 data from repository
#13 by lucidrains was merged Dec 26, 2020 Loading…
cleanup deepspeed training scripts
#11 by lucidrains was merged Dec 26, 2020 Loading…
1
add sparse attention support, with ability to specify at which layers…
#16 by lucidrains was merged Dec 27, 2020 Loading…
1
Add params & remove gpu_monitor
#14 by sdtblck was merged Dec 27, 2020 Loading…
2
add linear warmup over 5000 steps and gradient clipping
#29 by lucidrains was merged Jan 4, 2021 Loading…
GPT-3 Small Works
#24 by StellaAthena was merged Jan 3, 2021 Loading…
1
Update requirements.txt
#36 by sdtblck was merged Jan 4, 2021 Loading…
1
Automatically download owt2
#33 by steven-mi was merged Jan 4, 2021 Loading…
feedforward GLU on by default
#34 by lucidrains was merged Jan 4, 2021 Loading…
1
Fix error in extracting OWT2 dataset
#35 by steven-mi was merged Jan 4, 2021 Loading…
1
untie classifier weights by default
#30 by lucidrains was merged Jan 4, 2021 Loading…
disable reduce for loss calculation and calculate mean separately
#31 by anthony-dipofi was merged Jan 4, 2021 Loading…
3
Add improved data downloading class / pipeline
#39 by sdtblck was merged Jan 5, 2021 Loading…
3
2
add tfrecords dataset and make minor changes to configs/train script
#17 by sdtblck was merged Dec 28, 2020 Loading…
1
add tensorboard logging
#15 by sdtblck was merged Dec 27, 2020 Loading…
1
add ability to use fused layer norm with use_fused_layernorm=True flag
#18 by lucidrains was merged Dec 28, 2020 Loading…
working minimal GPT
#2 by lucidrains was merged Dec 23, 2020 Loading…
6
Removed errant comma
#78 by StellaAthena was merged Jan 23, 2021 Loading…
1
Create label.yml
#82 by StellaAthena was merged Feb 1, 2021 Loading…
2
Update issue templates
#81 by StellaAthena was merged Jan 23, 2021 Loading…
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.