Simplify data structures, add uniform approximation, fix mem leak (#63162)
authorAndrew Gu <andgu@fb.com>
Fri, 13 Aug 2021 15:19:23 +0000 (08:19 -0700)
committerFacebook GitHub Bot <facebook-github-bot@users.noreply.github.com>
Fri, 13 Aug 2021 15:20:59 +0000 (08:20 -0700)
commitbd81c9178a82f967e14aa0b4cc3e97dac10d8f85
tree1f48de660bcb6af3a32eb53c523aef8e1158d453
parent75f198d48d62823fa1f57d34df49a6fb1bade2bb
Simplify data structures, add uniform approximation, fix mem leak (#63162)

Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/63162

Test Plan: Imported from OSS

Reviewed By: mrshenli

Differential Revision: D30284617

Pulled By: andwgu

fbshipit-source-id: 9bd9e5f89abcc0d3dac56b85d55cc88e843baa9f
test/distributed/optim/test_zero_redundancy_optimizer.py
torch/distributed/algorithms/ddp_comm_hooks/ddp_zero_hook.py
torch/distributed/optim/zero_redundancy_optimizer.py
torch/distributed/optim/zero_redundancy_optimizer.pyi