Skip to content

Pull requests: EleutherAI/gpt-neox

New pull request New
Clear current search query, filters, and sorts
0 Open 370 Closed
0 Open 370 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Support for LLaMA
#841 by zphang was merged May 2, 2023 Loading…
@Quentin-Anthony
35
Add support for Flash attention
#725 by VHellendoorn was merged Dec 10, 2022 Loading… Release V2
26
Megatron-LM style Sequence Parallel
#1257 by haileyschoelkopf was merged Aug 23, 2024 Loading…
4 tasks done
1
24
align gpt-j layernorm to hf
#481 by sweinbach was merged Dec 6, 2022 Loading…
16
Add Mamba Architecture
#1157 by haileyschoelkopf was merged Mar 10, 2024 Loading…
1
16
Add intermediate_size to GPT-NeoX models
#1212 by dtamayo-nlp was merged Sep 7, 2024 Loading…
@jahatef
15
[bug-fix] enable finetuning option(set optimizer params correctly)
#927 by taegyeongeo was merged May 9, 2023 Loading…
14
fix alibi inference shapes for cached layer_past
#452 by sweinbach was merged Dec 12, 2021 Loading…
12
Extend ci suite
#1080 by mkerin was merged Dec 4, 2023 Loading…
1
@Quentin-Anthony
12
fused layernorm
#1105 by yang was merged Jan 26, 2024 Loading…
12
Monitoring using wandb
#108 by joshlk was merged Feb 1, 2021 Loading…
10
Improve Eval Harness
#471 by sdtblck was merged Dec 20, 2021 Loading…
10
[Bug] Make Configs Consistent
#928 by austinburnett was merged May 9, 2023 Loading…
3 tasks done
10
Adding the possibility of passing a label dataset
#958 by honglu2875 was merged Jun 7, 2023 Loading…
@haileyschoelkopf
10
Draft PR Adding mistral 0.1
#1131 by AIproj was merged Feb 23, 2024 Loading…
10
fixes the use of uninitialized variable
#539 by cloudcell was merged Feb 12, 2022 Loading…
1
8
Add DeepSpeed bf16 configuration
#787 by dashstander was merged May 16, 2023 Loading…
8
Fix flash attention
#910 by liamcli was merged May 9, 2023 Loading…
8
Better deployment
#107 by joshlk was merged Feb 1, 2021 Loading…
7
Fix different positional embeddings clashing
#147 by sdtblck was merged Mar 4, 2021 Loading…
7
Refactor how we configure sparsity
#284 by sdtblck was merged May 2, 2021 Loading…
7
add log_grad_pct_zeros to neox_args
#477 by CoEich was merged Feb 24, 2022 Loading…
7
Lm eval 0.4.0 support
#1101 by haileyschoelkopf was merged Dec 23, 2023 Loading…
7
[AMD] Supporting fused kernels build using JIT
#1188 by R0n12 was merged Apr 1, 2024 Loading…
2 tasks done
7
Lion Optimizer
#1062 by andylolu2 was merged Oct 20, 2023 Loading…
6
ProTip! What’s not been updated in a month: updated:<2024-09-04.