Enhance cpu support on gloo based multi-nodes mode. (#11330)
authorShane Li <shane.li@intel.com>
Tue, 15 Jan 2019 19:07:55 +0000 (11:07 -0800)
committerFacebook Github Bot <facebook-github-bot@users.noreply.github.com>
Tue, 15 Jan 2019 19:47:10 +0000 (11:47 -0800)
commit620ff25bdb2b01d87e8f3f3838c862f361a16f8a
tree8a6db601116fc0d433d19b010f38bc31864e0f53
parent7d601715e5ca21cd15319d06a2f52aca77e60f9b
Enhance cpu support on gloo based multi-nodes mode. (#11330)

Summary:
1. Add some gloo communication operators into related fallback list;
2. Work around to avoid compiling errors while using fallback operator whose CPU operator inherits from 'OperatorBase' directly like PrefetchOperator;
3. Add new cpu context support for some python module files and resnet50 training example file.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/11330

Reviewed By: yinghai

Differential Revision: D13624519

Pulled By: wesolwsk

fbshipit-source-id: ce39d57ddb8cd7786db2e873bfe954069d972f4f
caffe2/ideep/operators/operator_fallback_ideep.cc
caffe2/ideep/operators/operator_fallback_ideep.h
caffe2/image/image_input_op.cc
caffe2/python/data_parallel_model.py
caffe2/python/examples/resnet50_trainer.py
caffe2/python/predictor/predictor_exporter.py
cmake/Dependencies.cmake