Highlight NCCL all_reduce and all_gather requirements (#18741)
authorShen Li <shenli@fb.com>
Wed, 3 Apr 2019 16:06:09 +0000 (09:06 -0700)
committerFacebook Github Bot <facebook-github-bot@users.noreply.github.com>
Wed, 3 Apr 2019 16:50:29 +0000 (09:50 -0700)
commitc0ad6747a9b3d011ef5d1b44d08a065188a4ee19
tree52dd53c6302b677d60efc6034164615c0aedf981
parent2658190deff472418028309bf6b3bc0f26c8d528
Highlight NCCL all_reduce and all_gather requirements (#18741)

Summary:
See #18689
Pull Request resolved: https://github.com/pytorch/pytorch/pull/18741

Differential Revision: D14726874

Pulled By: mrshenli

fbshipit-source-id: a92404c653e3c62fc23fa3ccacfb3b2959b2e307
torch/distributed/distributed_c10d.py