Back out "Revert D30745960: [DDP] Remove SPMD from self.modules_buffers" (#64778)
authorRohan Varma <rvarm1@fb.com>
Fri, 17 Sep 2021 19:23:09 +0000 (12:23 -0700)
committerFacebook GitHub Bot <facebook-github-bot@users.noreply.github.com>
Fri, 17 Sep 2021 19:28:36 +0000 (12:28 -0700)
commit45bd0f61818cd41f9f5548d3120640986a1b9165
treebb60413f5d019f52e830dc3173a6bf53dda02fd6
parent70f286c1e2ec6fda8b1765d77a6dafeb7c8b0add
Back out "Revert D30745960: [DDP] Remove SPMD from self.modules_buffers" (#64778)

Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/64778

Original commit changeset: d3f3fb813c45
ghstack-source-id: 138326910

Test Plan: ci

Reviewed By: H-Huang

Differential Revision: D30849443

fbshipit-source-id: 15dab8a959a29d2e2fefac6ad52b8d8168eacc02
torch/nn/parallel/distributed.py