-
Notifications
You must be signed in to change notification settings - Fork 989
Pull requests: EleutherAI/gpt-neox
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Lion Optimizer
good first issue
Good for newcomers
help wanted
This issue needs assistance
#1012
by adi-kmt
was closed Oct 20, 2023
Loading…
add sparse attention support, with ability to specify at which layers…
#16
by lucidrains
was merged Dec 27, 2020
Loading…
add linear warmup over 5000 steps and gradient clipping
#29
by lucidrains
was merged Jan 4, 2021
Loading…
disable reduce for loss calculation and calculate mean separately
#31
by anthony-dipofi
was merged Jan 4, 2021
Loading…
add tfrecords dataset and make minor changes to configs/train script
#17
by sdtblck
was merged Dec 28, 2020
Loading…
add ability to use fused layer norm with use_fused_layernorm=True flag
#18
by lucidrains
was merged Dec 28, 2020
Loading…
Previous Next
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.