ZeRO 2+3 memory estimators - #965

Merged

jeffra merged 12 commits into

deepspeedai:masterfrom

stas00:mem-estimation-utils

Jun 23, 2021

Commits on Apr 16, 2021

memory estimators
stas00
committed
d94bde1
wip
stas00
committed
d6c2336
better in GBs
stas00
committed
9d4dd5a

Commits on Apr 17, 2021

rework the code
stas00
committed
1d323cc

Commits on Jun 4, 2021

Merge remote-tracking branch 'origin/master' into mem-estimation-utils
stas00
committed
80f8932
add zero2 estimators and full docs
stas00
committed
956b2d2
style
stas00
committed
f0c7c16
cleanup
stas00
committed
bdda561
add API; add examples
stas00
committed
ad4b144

Commits on Jun 21, 2021

Merge branch 'master' into mem-estimation-utils
samyam
authored
0dd406d
more intuitive naming
stas00
committed
5336cd0

Commits on Jun 23, 2021

Merge branch 'master' into mem-estimation-utils
jeffra
authored
e076659