Commits

History for

Commits on Mar 28, 2023

Print the hostname to be used in conjunction with --tag-output (mpirun) or --label (srun)
Quentin-Anthony
committedMar 28, 2023

Commits on Nov 23, 2022

Remove mutable default parameter in init_inference() (#2540 )

aphedges
and
mrwyattii
committedNov 23, 2022

Commits on Nov 22, 2022

Make DS-Inference config readable from JSON (#2537 )
mrwyattii
committedNov 22, 2022

Commits on Nov 15, 2022

Update docs to autogenerate pydantic config model docs (#2509 )
mrwyattii
committedNov 15, 2022
DeepSpeed inference config. (#2459 ) (#2472 )

awan-10
and
mrwyattii
committedNov 15, 2022

Commits on Nov 2, 2022

Cache Allocation and Softmax Fixes (#2433 )

committedNov 2, 2022

Commits on Aug 30, 2022

Ds-inference Int8 support through ZeroQuant technology (#2217 )

RezaYazdaniAminabadi
and
jeffra
committedAug 30, 2022

Commits on Jul 30, 2022

[zero-3] shutdown zero.Init from within ds.init (#2150 )
jeffra
committedJul 30, 2022

Commits on Jul 29, 2022

Fix random token-generation issue + MP-checkpoint loading/saving (#2132 )

committedJul 29, 2022

Commits on Jul 18, 2022

Add Inference support for running the BigScience-BLOOM Architecture (#2083 )

committedJul 18, 2022

Commits on Jun 10, 2022

DeepSpeed comm backend v1 (#1985 )

committedJun 10, 2022

Commits on May 17, 2022

Enabling CUDA-graph for the bert-type models (#1952 )

committedMay 17, 2022

Commits on May 11, 2022

Fairseq support (#1915 )
jeffra
committedMay 11, 2022

Commits on Apr 26, 2022

Inference PP changes for neox (#1899 )

committedApr 26, 2022

Commits on Jan 19, 2022

MoE inference + PR-MoE model support (#1705 )

committedJan 19, 2022

Commits on Nov 19, 2021

Several fixes for our read-the-docs build (#1579 )
jeffra
committedNov 19, 2021

Commits on Nov 12, 2021

Tensor-Parallelism general support (#1512 )

committedNov 12, 2021

Commits on Nov 1, 2021

Bfloat16 zero2 (#1398 )

raamjad
and
tjruwase
committedNov 1, 2021

Commits on Aug 25, 2021

Support Callable type for client optimizer and lr_scheduler (#1316 )
tjruwase
committedAug 25, 2021

Commits on May 24, 2021

Quantization + inference release (#1091 )

committedMay 24, 2021

Commits on May 19, 2021

ZeRO stage 1 refresh (#1042 )
jeffra
committedMay 19, 2021

Commits on Apr 29, 2021

Refactor param_dict to config (#1008 )

Sean Naren
and
jeffra
committedApr 29, 2021

Commits on Mar 16, 2021

Allow args to be optional in deepspeed.initialize (#825 )
jeffra
committedMar 16, 2021

Commits on Mar 8, 2021

ZeRO 3 Offload (#834 )

committedMar 8, 2021

Commits on Jan 14, 2021

Validate consistent ckpt tags across ranks (#667 )
jeffra
committedJan 14, 2021

Commits on Dec 18, 2020

Ability to initialize distributed backend outside deepspeed runtime (#608 )
jeffra
committedDec 18, 2020

Commits on Nov 19, 2020

backwards compatability w. v020 ckpts, fix issue with zero-1 ckpts (#543 )
jeffra
committedNov 19, 2020

Commits on Nov 12, 2020

DeepSpeed JIT op + PyPI support (#496 )

committedNov 12, 2020

Commits on Oct 30, 2020

Add CPUAdam optimizer for zero-offload in deepspeed engine (#484 )

RezaYazdaniAminabadi
and
jeffra
committedOct 30, 2020

Commits on Sep 10, 2020

Pipeline parallel training engine. (#392 )

Shaden Smith
and
jeffra
committedSep 10, 2020
ZeRO-Offload release (#391 )

committedSep 10, 2020

Commits on Sep 2, 2020

Sparse attn + ops/runtime refactor + v0.3.0 (#343 )

jeffra
and
arashashari
committedSep 2, 2020

Commits on Jun 4, 2020

Add log util (#230 )
chunyang-wen
committedJun 4, 2020

Commits on May 29, 2020

Transformer kernel release (#242 )

committedMay 29, 2020

Commits on May 19, 2020

ZeRO-2 (#217 )

committedMay 19, 2020