projects / platform / upstream / tensorflow.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: d2a78f9) | patch
K-FAC: Cross Replica Mean for TPU
authorA. Unique TensorFlower <gardener@tensorflow.org>
Wed, 20 Dec 2017 00:31:31 +0000 (16:31 -0800)
committerTensorFlower Gardener <gardener@tensorflow.org>
Wed, 20 Dec 2017 02:14:09 +0000 (18:14 -0800)
commit1ddb0530771849540fc2b96c976cf24480b02c01
tree79becfe3b66cfea005ac0d8274d4273fa5f57ac2tree | snapshot
parentd2a78f91991060f4dab74bad95a09cc01bd1fac3commit | diff
K-FAC: Cross Replica Mean for TPU

Adds an op for taking the average of a Tensor across all TPU cores, and uses it
before updating covariance statistics. This is a no-op if TPUs aren't used.

PiperOrigin-RevId: 179620193
tensorflow/contrib/kfac/python/kernel_tests/BUILD diff | blob | history
tensorflow/contrib/kfac/python/kernel_tests/utils_test.py diff | blob | history
tensorflow/contrib/kfac/python/ops/BUILD diff | blob | history
tensorflow/contrib/kfac/python/ops/fisher_factors.py diff | blob | history
tensorflow/contrib/kfac/python/ops/utils.py diff | blob | history
Domain: Machine Learning / ML Framework;