Support loading and saving ZeRO checkpoints with changing DP degree - #240

Merged

tjruwase merged 20 commits into

olruwase/zero_checkpoints

Jul 14, 2020

Commits on May 27, 2020

Support saving and loading ZeRO checkpoints on different data
tjruwase
committed
5ef1108
Merge branch 'master' of github.com:microsoft/DeepSpeed into olruwase/zero_checkpoints
tjruwase
committed
133ece6
Fix formatting
tjruwase
committed
1c68304

Commits on May 28, 2020

Commits on May 30, 2020

Merge branch 'master' into olruwase/zero_checkpoints
jeffra
authored
51dc5e2

Commits on Jun 11, 2020

Support checkpoint with varying GPU count in ZeRO stage 1
tjruwase
committed
e6fda66
Merge branch 'olruwase/zero_checkpoints' of github.com:microsoft/DeepSpeed into olruwase/zero_checkpoints
tjruwase
committed
b19e5b4
Fix formatting
tjruwase
committed
9727736
Formatting fixes
tjruwase
committed
44576a8
Update model tests
tjruwase
committed
181e42b
Merge with master
tjruwase
committed
ed5443c
Remove pprint
tjruwase
committed
6e8d90a

Commits on Jun 12, 2020

Minor fix
tjruwase
committed
f9e06a9
Merge branch 'master' into olruwase/zero_checkpoints
tjruwase
authored
fc31c81

Commits on Jul 13, 2020