Pull requests: EleutherAI/gpt-neox

0 Open 338 Closed

Author

Filter by author

Loading

author:

Filter by this user

Label

Filter by label

Loading

Projects

Filter by project

Loading

Milestones

Filter by milestone

Loading

Reviews

Filter by reviews

No reviews Review required Approved review Changes requested

Assignee

Filter by who’s assigned

Assigned to nobody Loading

assignee:

Filter by this user

Sort

Sort by

Newest Oldest Most commented Least commented Recently updated Least recently updated Best match

Most reactions

👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Improve Conversion Utilities

#1124 by haileyschoelkopf was merged Feb 8, 2024 Loading…

9 tasks done

2

1 🚀 2

[streaming_ds branch] Allow resuming from latest checkpoint when using StreamingDataset

#1163 by LeoGrin was merged Mar 15, 2024 Loading…

2 🚀 2

Add megablocks dropless MoE

#1192 by yang was merged May 4, 2024 Loading…

1 🚀 2

Updating default configs to be less bad

#665 by StellaAthena was merged Nov 18, 2022 Loading…

5 🚀 1

Optimize data preprocessing by using numpy

#771 by zhuzilin was merged Jan 20, 2023 Loading…

2 🚀 1

added a simple script for multi-node data preparation.

#802 by MLRichter was merged Jun 4, 2023 Loading…

3 🚀 1

Extra DeepSpeed Argument Capability

#819 by curt-tigges was merged Mar 26, 2023 Loading…

1

1 🚀 1

Simplify and relax dependencies (Take 2)

#818 by EricHallahan was merged Mar 9, 2023 Loading…

🚀 1

Extend ci suite

#1080 by mkerin was merged Dec 4, 2023 Loading…

1

12 🚀 1

Fused Rotary Embeddings (fixed)

#1108 by yang was merged Jan 5, 2024 Loading…

1

2 🚀 1

Make rotary freqs buffer non-persistent

#1168 by haileyschoelkopf was merged Mar 4, 2024 Loading…

1

🚀 1

add rwkv support merge-queue This PR is next on the queue to merge

#1198 by jahatef was merged May 6, 2024 Loading…

6 🚀 1

LR scheduler fix no longer breaks inference

#1060 by dashstander was merged Oct 17, 2023 Loading…

1

Lion Optimizer

#1062 by andylolu2 was merged Oct 20, 2023 Loading…

6

PR for Deepspeed Integration

#9 by trisongz was merged Dec 24, 2020 Loading…

1

get rid of test file

#10 by sdtblck was merged Dec 26, 2020 Loading…

1

3

fix small bug where sequence length is not passed into attention class

#21 by lucidrains was merged Jan 1, 2021 Loading…

2

make mask value smaller by factor of 2

#25 by lucidrains was merged Jan 4, 2021 Loading…

2

test

#1 by lucidrains was merged Dec 22, 2020 Loading…

1

Update base_model.json

#93 by srulikbd was merged Jan 26, 2021 Loading…

Implement distributed training using Kubernetes

#77 by leogao2 was merged Jan 23, 2021 Loading…

2

6

Batch size needs to be specified

#87 by joshlk was merged Jan 23, 2021 Loading…

1

Add checkpoint saving / loading

#90 by sdtblck was merged Jan 28, 2021 Loading…

1

5

Remove layer caching

#109 by joshlk was merged Feb 1, 2021 Loading…

Create runmany_k8s.sh

#106 by leogao2 was merged Jan 30, 2021 Loading…