Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ZeRO-Inference refresh #4197

Merged
merged 113 commits into from
Sep 11, 2023
Merged
Changes from 1 commit
Commits
Show all changes
113 commits
Select commit Hold shift + click to select a range
ade9096
INT4 weight only quantization (#479)
donglinz May 5, 2023
2461449
Moving quantization into post_init_method and add int4 dequantization…
donglinz May 17, 2023
8751edf
Refactor: move int4 code to deepspeed/inference (#528)
donglinz Jun 5, 2023
df1859d
zero++ tutorial PR (#3783)
HeyangQin Jun 21, 2023
d81a6ad
[Fix] _conv_flops_compute when padding is a str and stride=1 (#3169)
zhiruiluo Jun 21, 2023
a8c182a
fix interpolate flops compute (#3782)
cli99 Jun 22, 2023
c4c442f
use `Flops Profiler` to test `model.generate()` (#2515)
CaffreyR Jun 22, 2023
fc9e1ee
revert PR #3611 (#3786)
jeffra Jun 22, 2023
40045dc
bump to 0.9.6
jeffra Jun 22, 2023
49a0a1b
ZeRO++ chinese blog (#3793)
HeyangQin Jun 23, 2023
2c62cb4
remove staging trigger (#3792)
jeffra Jun 23, 2023
4dc65f7
DeepSpeed-Triton for Inference (#3748)
stephen-youn Jun 23, 2023
e1119d8
ZeRO++ (#3784)
HeyangQin Jun 23, 2023
01b843a
adding zero++ to navigation panel of deepspeed.ai (#3796)
HeyangQin Jun 23, 2023
319b64e
Add ZeRO++ Japanese blog (#3797)
tohtana Jun 23, 2023
b4a2c0a
Bug Fixes for autotuner and flops profiler (#1880)
cli99 Jun 23, 2023
b7e1010
Missing strided copy for gated MLP (#3788)
cmikeh2 Jun 23, 2023
e5b1ead
Requires grad checking. (#3789)
jomayeri Jun 23, 2023
9c756cf
bump to 0.10.0
jeffra Jun 23, 2023
a204edc
Fix Bug in transform.cu (#3534)
rraminen Jun 23, 2023
f6e2e38
bug fix: triton importing error (#3799)
stephen-youn Jun 23, 2023
c1a7d3c
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 23, 2023
65ed548
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 24, 2023
d7ac329
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 26, 2023
83f1102
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 27, 2023
16555b2
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 27, 2023
9d7b654
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 28, 2023
c121f90
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 29, 2023
f6b2962
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 29, 2023
dd6bb04
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 29, 2023
6e5a1f1
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 29, 2023
1fbbbbf
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 30, 2023
e44eb86
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jun 30, 2023
26d8823
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 1, 2023
83e1752
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 3, 2023
b5446a2
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 4, 2023
7f9b2fa
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 5, 2023
9fb79a3
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 5, 2023
9643da2
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 6, 2023
464f99a
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 6, 2023
fbf5068
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 6, 2023
208870a
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 6, 2023
62b47f3
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 6, 2023
c5f62c3
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 7, 2023
78528ae
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 7, 2023
b52c407
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 8, 2023
dfe3b82
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 10, 2023
f086c39
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 10, 2023
04718e4
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 12, 2023
63db286
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 12, 2023
f32c947
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 13, 2023
3b7c583
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 13, 2023
7963bc7
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 13, 2023
441fffe
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 14, 2023
72f37ab
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 14, 2023
f5eb5df
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 17, 2023
e595621
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 18, 2023
427d9eb
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 19, 2023
e9708d6
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 19, 2023
6da3e48
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 19, 2023
c031179
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 19, 2023
0de04b3
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 20, 2023
a733676
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 20, 2023
fd2ca3a
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 21, 2023
9665c46
Rebase
tjruwase Jul 21, 2023
af181e5
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 21, 2023
68935e8
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 22, 2023
37b7743
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 22, 2023
b8153eb
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 24, 2023
8b9815f
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 25, 2023
79781ef
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 25, 2023
2b3664c
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 25, 2023
f6ded65
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 26, 2023
cea2dd9
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 26, 2023
30626f0
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 27, 2023
ccb6817
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 27, 2023
a20815b
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 28, 2023
2d8c49a
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 28, 2023
762a1bb
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Jul 31, 2023
8ac993f
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 1, 2023
9d054da
Workaround qaunt bug
tjruwase Aug 2, 2023
fabf2c0
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 3, 2023
1bc1af2
Fix dequant bug
tjruwase Aug 3, 2023
cc0b0f1
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 3, 2023
fd1cede
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 5, 2023
f694a93
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 7, 2023
4d29d5e
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 8, 2023
636e5e4
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 9, 2023
a39b6e2
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 9, 2023
de64c54
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 9, 2023
cf479bf
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 9, 2023
df4f25c
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 9, 2023
38bb552
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 10, 2023
e86e1c5
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 11, 2023
ec59340
Address PR feedback
tjruwase Aug 11, 2023
8e19577
Use super() __exit__
tjruwase Aug 14, 2023
704e0f0
Fix unit tests
tjruwase Aug 14, 2023
95643e3
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 15, 2023
19018b6
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 16, 2023
b886682
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 16, 2023
7948971
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 17, 2023
9242d36
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 17, 2023
c51a072
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 18, 2023
c816d50
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 19, 2023
d9b1672
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 21, 2023
a746aca
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 22, 2023
f0afcf3
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 22, 2023
956ed2f
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 22, 2023
e1276ab
Merge branch 'master' of github.com:microsoft/DeepSpeed
jeffra Aug 23, 2023
f940e1e
Rebase
tjruwase Aug 23, 2023
0129db2
Fix rebase conflict
tjruwase Aug 24, 2023
a63e92b
Merge branch 'master' into staging-zero-inference-v1
tjruwase Aug 30, 2023
9723d93
Merge branch 'master' into staging-zero-inference-v1
awan-10 Sep 8, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'master' of github.com:microsoft/DeepSpeed
  • Loading branch information
jeffra committed Jun 23, 2023
commit c1a7d3ccf648c0641548278c52920827a84eae41

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.