Add tf.contrib.distribute, which defines classes DistributionStrategy
authorA. Unique TensorFlower <gardener@tensorflow.org>
Thu, 29 Mar 2018 22:28:24 +0000 (15:28 -0700)
committerTensorFlower Gardener <gardener@tensorflow.org>
Thu, 29 Mar 2018 22:32:01 +0000 (15:32 -0700)
commit6f5d7a97cd2c0741ddfa756853ce5321377b5d53
treee79afd91cd68bc9ed75bfe278511312da3918fe6
parent40f8291db5c0b05b31d7bbe23b847cdbb2408718
Add tf.contrib.distribute, which defines classes DistributionStrategy
and MirroredStrategy, and related functionality.

Also add tf.contrib.optimizer_v2, an update to the Optimizer API.

RELNOTES: Can now pass tf.contrib.distribute.MirroredStrategy() to
tf.estimator.RunConfig() to run an Estimator model on multiple GPUs
on one machine.
PiperOrigin-RevId: 190996247
50 files changed:
tensorflow/contrib/BUILD
tensorflow/contrib/__init__.py
tensorflow/contrib/cmake/python_modules.txt
tensorflow/contrib/distribute/BUILD [new file with mode: 0644]
tensorflow/contrib/distribute/__init__.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/BUILD [new file with mode: 0644]
tensorflow/contrib/distribute/python/combinations.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/combinations_test.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/cross_tower_ops.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/cross_tower_ops_test.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/cross_tower_utils.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/minimize_loss_test.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/mirrored_strategy.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/mirrored_strategy_multigpu_test.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/mirrored_strategy_test.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/monitor.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/monitor_test.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/one_device_strategy.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/one_device_strategy_test.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/optimizer_v2_test.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/prefetching_ops_v2.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/prefetching_ops_v2_test.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/shared_variable_creator.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/shared_variable_creator_test.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/simple_estimator_example.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/single_loss_example.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/step_fn.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/step_fn_test.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/strategy_test_lib.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/values.py [new file with mode: 0644]
tensorflow/contrib/distribute/python/values_test.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/BUILD [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/adadelta.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/adadelta_test.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/adagrad.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/adagrad_test.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/adam.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/adam_test.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/checkpointable_utils_test.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/gradient_descent.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/gradient_descent_test.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/momentum.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/momentum_test.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/optimizer_v2.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/optimizer_v2_symbols.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/optimizer_v2_test.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/rmsprop.py [new file with mode: 0644]
tensorflow/contrib/optimizer_v2/rmsprop_test.py [new file with mode: 0644]
tensorflow/python/training/distribute.py
tensorflow/tools/docs/generate_lib.py