Commits

History for

Commits on Mar 9, 2023

[zero] prevent poor configs from running w. zero-offload (microsoft#2971 )
jeffra
committedMar 9, 2023

Commits on Feb 27, 2023

add missing license info to top of all source code (microsoft#2889 )

committedFeb 27, 2023

Commits on Jan 9, 2023

[fp16] lower initial_scale_power (microsoft#2663 )

stas00
and
tjruwase
committedJan 9, 2023

Commits on Dec 13, 2022

DeepSpeed Data Efficiency Library (microsoft#2585 )

conglongli
and
jeffra
committedDec 13, 2022

Commits on Nov 28, 2022

Adding Gradient Accumulation Data Type Config (microsoft#2512 )

jomayeri
and
tjruwase
committedNov 28, 2022

Commits on Oct 24, 2022

Fix Bug microsoft#2319 (microsoft#2438 )

jomayeri
and
jeffra
committedOct 24, 2022

Commits on Oct 21, 2022

parallelize writing of layer checkpoint files across data parallel instances (microsoft#1419 )

adammoody
and
tjruwase
committedOct 21, 2022

Commits on Jul 30, 2022

enable fp16 input autocasting (microsoft#2158 )
jeffra
committedJul 30, 2022

Commits on Jul 20, 2022

Checkpoint reshaping (microsoft#1953 )

tjruwase
and
jeffra
committedJul 20, 2022

Commits on Jul 19, 2022

Adding DeepSpeed Compression Composer (microsoft#2105 )

committedJul 19, 2022

Commits on Jun 16, 2022

DeepSpeed Monitor Module (Master) (microsoft#2013 )

Quentin-Anthony
and
jeffra
committedJun 16, 2022

Commits on Apr 19, 2022

bf16+pipeline parallelism (microsoft#1801 )

tjruwase
and
jeffra
committedApr 19, 2022

Commits on Feb 7, 2022

Move param_shapes to model files (microsoft#1732 )

tjruwase
and
jeffra
committedFeb 7, 2022

Commits on Jan 21, 2022

Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support) (microsoft#1453 )

committedJan 21, 2022

Commits on Jan 14, 2022

[ZeRO] Default disable elastic ckpt in stage 1+2 and reduce CPU memory overhead during ckpt load (microsoft#1525 )

jeffra
and
tjruwase
committedJan 14, 2022

Commits on Nov 26, 2021

allreduce_always_fp16 (microsoft#1487 )

committedNov 26, 2021

Commits on Nov 1, 2021

Bfloat16 zero2 (microsoft#1398 )

raamjad
and
tjruwase
committedNov 1, 2021

Commits on Sep 1, 2021

Added drop_last to DeepSpeedDataLoader (microsoft#1321 )

committedSep 1, 2021

Commits on Aug 17, 2021

DeepSpeed MoE (microsoft#1310 )

committedAug 17, 2021

Commits on Aug 16, 2021

Curriculum learning (microsoft#1307 )

conglongli
and
jeffra
committedAug 16, 2021

Commits on May 24, 2021

Quantization + inference release (microsoft#1091 )

committedMay 24, 2021

Commits on Jan 14, 2021

Validate consistent ckpt tags across ranks (microsoft#667 )
jeffra
committedJan 14, 2021

Commits on Dec 18, 2020

Ability to initialize distributed backend outside deepspeed runtime (microsoft#608 )
jeffra
committedDec 18, 2020

Commits on Nov 10, 2020

PLD release (microsoft#513 )

committedNov 10, 2020

Commits on Sep 10, 2020

ZeRO-Offload release (microsoft#391 )

committedSep 10, 2020

Commits on Sep 5, 2020

fixed a typo; this was fixed before but seems like it has been lost in the refactor (microsoft#364 )
arashashari
committedSep 5, 2020

Commits on Sep 2, 2020

Sparse attn + ops/runtime refactor + v0.3.0 (microsoft#343 )

jeffra
and
arashashari
committedSep 2, 2020

Loading