Revert D30745960: [DDP] Remove SPMD from self.modules_buffers
authorHoward Huang <howardhuang@fb.com>
Thu, 9 Sep 2021 15:20:40 +0000 (08:20 -0700)
committerFacebook GitHub Bot <facebook-github-bot@users.noreply.github.com>
Thu, 9 Sep 2021 15:22:12 +0000 (08:22 -0700)
commitf1aaf8afcd7cc9ed8745aba48d091d0638d4afe3
tree165c182f90804c6989676a04adc6896435701953
parent3bf93d769cdc39a0228b28b06b7742430e282b14
Revert D30745960: [DDP] Remove SPMD from self.modules_buffers

Test Plan: revert-hammer

Differential Revision:
D30745960 (https://github.com/pytorch/pytorch/commit/15532595209d2daf34d35e10f8d3d3b64966aea2)

Original commit changeset: 66a8f9847e9f

fbshipit-source-id: d3f3fb813c45ac1b0ff15c6154b2e99e5dbab433
torch/nn/parallel/distributed.py