Skip to content

Issues: EleutherAI/oslo

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

TP does not work on Flan-T5
#215 opened Nov 16, 2023 by shreyansh26
To apply FlashAttention
#203 opened Jun 19, 2023 by dyanos
TODO : Zero optimizer deparallel Data Parallelism Data parallelism related
#186 opened May 11, 2023 by hyeinhyun
TODO : Documentation for Expert Parallel Expert Parallelism Expert parallelism related
#175 opened Apr 5, 2023 by scsc0511
TODO: Test Code Enhancement
#165 opened Mar 23, 2023 by bzantium
Fix TP embedding layers
#152 opened Mar 12, 2023 by jason9693
How to pretrain T5
#122 opened Dec 30, 2022 by TristanThrush
TODO: documentation and readme Documentation Documentation related
#102 opened Nov 14, 2022 by hyunwoongko
PatricStar for Zero
#97 opened Nov 6, 2022 by dongsungkim
TODO: Test TP + PP Pipeline Parallelism Pipeline parallelism related Tensor Parallelism Tensor parallelism related
#48 opened Sep 30, 2022 by hyunwoongko
TODO: clean data communication functions for PP Pipeline Parallelism Pipeline parallelism related
#42 opened Sep 26, 2022 by ohwi
wand module not found when running test_mlm.py Bug Something isn't working
#15 opened Aug 30, 2022 by josemlopez
Milestone: Make oslo-examples repository Milestone Milestone related
#6 opened Aug 25, 2022 by hyunwoongko
ProTip! Mix and match filters to narrow down what you’re looking for.