Collective Ops Part 1
authorA. Unique TensorFlower <gardener@tensorflow.org>
Thu, 29 Mar 2018 00:06:44 +0000 (17:06 -0700)
committerTensorFlower Gardener <gardener@tensorflow.org>
Thu, 29 Mar 2018 00:09:25 +0000 (17:09 -0700)
commita0e0685ca974e484de9200caf8c414dcb55277bb
tree2ff0a5f2eaac3e83efab335d7f5946e9087b9aa3
parent108178da2a20ea2d3899417ee932d46ba1a5c652
Collective Ops Part 1

The basic interface definitions, local-only versions of remote-access,
param-resolution, device-resolution and mgr.

A collective op is able to execute synchronously across devices
and across separate graphs. Collective ops to be introduced eventually
include broadcast and all-reduce.  This change is part of a series of
changes that will introduce the necessary infrastructure then the
initial op implementations.

PiperOrigin-RevId: 190860248
19 files changed:
tensorflow/core/BUILD
tensorflow/core/common_runtime/buf_rendezvous.cc [new file with mode: 0644]
tensorflow/core/common_runtime/buf_rendezvous.h [new file with mode: 0644]
tensorflow/core/common_runtime/buf_rendezvous_test.cc [new file with mode: 0644]
tensorflow/core/common_runtime/collective_executor_mgr.cc [new file with mode: 0644]
tensorflow/core/common_runtime/collective_executor_mgr.h [new file with mode: 0644]
tensorflow/core/common_runtime/collective_executor_mgr_test.cc [new file with mode: 0644]
tensorflow/core/common_runtime/collective_param_resolver_local.cc [new file with mode: 0644]
tensorflow/core/common_runtime/collective_param_resolver_local.h [new file with mode: 0644]
tensorflow/core/common_runtime/collective_param_resolver_local_test.cc [new file with mode: 0644]
tensorflow/core/common_runtime/collective_rma_local.cc [new file with mode: 0644]
tensorflow/core/common_runtime/collective_rma_local.h [new file with mode: 0644]
tensorflow/core/common_runtime/collective_rma_local_test.cc [new file with mode: 0644]
tensorflow/core/common_runtime/device_resolver_local.cc [new file with mode: 0644]
tensorflow/core/common_runtime/device_resolver_local.h [new file with mode: 0644]
tensorflow/core/common_runtime/device_resolver_local_test.cc [new file with mode: 0644]
tensorflow/core/framework/collective.cc [new file with mode: 0644]
tensorflow/core/framework/collective.h [new file with mode: 0644]
tensorflow/core/framework/op_kernel.h