Skip to content

Pull requests: EleutherAI/gpt-neox

New pull request New
Clear current search query, filters, and sorts
26 Open 722 Closed
26 Open 722 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

add flash_attn_kvpacked
#862 by satpalsr was merged Apr 21, 2023 Loading…
1
@dashstander
16 👍 3
Fixed previous inability to launch single-node training
#859 by curt-tigges was merged Mar 30, 2023 Loading…
2
3 👍 2
Dataload fix
#979 by jahatef was merged Jul 6, 2023 Loading…
@Quentin-Anthony
7 👍 1
Fix typo in preprocess data
#501 by Ghost---Shadow was merged Feb 4, 2022 Loading…
1 👍 1
fixes the use of uninitialized variable
#539 by cloudcell was merged Feb 12, 2022 Loading…
1
8 👍 1
Update text_generation_utils.py
#629 by StellaAthena was merged Jun 8, 2022 Loading…
2 👍 1
Fix learned and sinusoidal embeddings after OPT regression
#722 by Quentin-Anthony was merged Jan 18, 2023 Loading… Release V2
1
2 👍 1
Update neox_args.py
#1107 by StellaAthena was merged Dec 26, 2023 Loading…
👍 1
Add links for *.torrent files, specify download sizes
#551 by depthwise was merged Feb 13, 2022 Loading…
👍 1
Mamba + Tensor Parallel Support
#1184 by haileyschoelkopf was merged Mar 15, 2024 Loading…
2 👍 1
Create CODEOWNERS
#8 by StellaAthena was merged Dec 24, 2020 Loading…
get rid of test file
#10 by sdtblck was merged Dec 26, 2020 Loading…
1
3
cleanup deepspeed training scripts
#11 by lucidrains was merged Dec 26, 2020 Loading…
1
remove enwik8 data from repository
#13 by lucidrains was merged Dec 26, 2020 Loading…
Add params & remove gpu_monitor
#14 by sdtblck was merged Dec 27, 2020 Loading…
2
add sparse attention support, with ability to specify at which layers…
#16 by lucidrains was merged Dec 27, 2020 Loading…
1
add tfrecords dataset and make minor changes to configs/train script
#17 by sdtblck was merged Dec 28, 2020 Loading…
1
add ability to use fused layer norm with use_fused_layernorm=True flag
#18 by lucidrains was merged Dec 28, 2020 Loading…
Add improved data downloading class / pipeline
#39 by sdtblck was merged Jan 5, 2021 Loading…
3
2
Update requirements.txt
#36 by sdtblck was merged Jan 4, 2021 Loading…
1
Add a chat data preprocessing script
#1239 by dmahan93 was merged Jun 25, 2024 Loading…
1
untie classifier weights by default
#30 by lucidrains was merged Jan 4, 2021 Loading…
disable reduce for loss calculation and calculate mean separately
#31 by anthony-dipofi was merged Jan 4, 2021 Loading…
3
Fix error in extracting OWT2 dataset
#35 by steven-mi was merged Jan 4, 2021 Loading…
1
fix small bug where sequence length is not passed into attention class
#21 by lucidrains was merged Jan 1, 2021 Loading…
2
ProTip! Filter pull requests by the default branch with base:main.