Amit Patankar [Sun, 4 Feb 2018 02:16:24 +0000 (18:16 -0800)]
Update BUILD
Amit Patankar [Sun, 4 Feb 2018 01:24:29 +0000 (17:24 -0800)]
Making the for_canonicalization_test only for py2
http://ci.tensorflow.org/view/Release/job/release-matrix-cpu/TF_BUILD_CONTAINER_TYPE=CPU,TF_BUILD_IS_PIP=PIP,TF_BUILD_PYTHON_VERSION=PYTHON3,label=mac-slave/239/consoleFull
Rohin Mohanadas [Sat, 3 Feb 2018 23:22:48 +0000 (00:22 +0100)]
change to hyper link (#16690)
MandarJKulkarni [Sat, 3 Feb 2018 23:22:22 +0000 (04:52 +0530)]
Fixed a couple of typos (#16731)
Fixed a couple of typos
Amit Patankar [Sat, 3 Feb 2018 19:00:37 +0000 (11:00 -0800)]
Merge pull request #16729 from jhseu/bug_fixes
Fix the Windows GPU build
Jonathan Hseu [Sat, 3 Feb 2018 17:46:13 +0000 (09:46 -0800)]
Delete device_functions.h include.
Frank Chen [Sat, 3 Feb 2018 17:38:43 +0000 (09:38 -0800)]
Merge pull request #16726 from jhseu/branch_184376425
Branch
184376425
Jonathan Hseu [Sat, 3 Feb 2018 13:38:13 +0000 (05:38 -0800)]
Merge commit for internal changes
A. Unique TensorFlower [Sat, 3 Feb 2018 07:02:16 +0000 (23:02 -0800)]
[XLA] Add tests for Clamp with scalars S32 and U32.
PiperOrigin-RevId:
184376425
Yu-Cheng Ling [Sat, 3 Feb 2018 06:39:45 +0000 (22:39 -0800)]
Fix breakage: Can't build TFLite with Bazel for Mac / iOS.
PiperOrigin-RevId:
184375534
A. Unique TensorFlower [Sat, 3 Feb 2018 03:40:30 +0000 (19:40 -0800)]
A more efficient implementation of the Op using batch operations.
PiperOrigin-RevId:
184367562
Mingsheng Hong [Sat, 3 Feb 2018 03:10:39 +0000 (19:10 -0800)]
Extended TFE_OpSetDevice() with the ability to set an op device from non-GPU back to GPU.
Added unit testing, and also refined unit test logic for checking the presence
of a GPU device. The latter is needed when we add XLA device support.
PiperOrigin-RevId:
184366172
Justin Lebar [Sat, 3 Feb 2018 02:57:10 +0000 (18:57 -0800)]
[XLA] Minor cleanups related to multi-output fusion.
- Add some comments about preexisting invariants, and add some CHECKs.
- In the LoopEmitter constructor, materialize the given
ArraySlice<IrArray> to a vector, so we don't rely on the given
ArraySlice having any particular lifetime.
- Add the invariant that the LoopEmitter constructor which takes a
list of IrArrays is only for multi-output fusion. Previously it said:
If you only pass one array, then treat it as regular fusion. But this
results in an LLVM type mismatch, because the given
target_element_generator should be passing a struct with one element.
PiperOrigin-RevId:
184365310
A. Unique TensorFlower [Sat, 3 Feb 2018 02:03:11 +0000 (18:03 -0800)]
Propagate outfeed sharding, if specified from TensorFlow.
PiperOrigin-RevId:
184361221
Anna R [Sat, 3 Feb 2018 01:59:16 +0000 (17:59 -0800)]
Automated g4 rollback of changelist
184347012
PiperOrigin-RevId:
184360818
Jonathan Hseu [Sat, 3 Feb 2018 01:40:59 +0000 (17:40 -0800)]
Merge pull request #16715 from jhseu/branch_184352399
Branch
184352399
Derek Murray [Sat, 3 Feb 2018 01:09:59 +0000 (17:09 -0800)]
[tf.data] Add public header "tensorflow/core/framework/dataset.h".
This adds the ability to create a custom C++ Dataset implementation
without linking it statically into the TensorFlow library. Note that
this internal API is experimental and subject to change between
versions of TensorFlow.
Fixes #16682.
PiperOrigin-RevId:
184356318
Derek Murray [Sat, 3 Feb 2018 01:09:16 +0000 (17:09 -0800)]
Check that the type of an implicitly dereferenced tensor matches the expected input type.
The dtype of a tensor reference can change between the point when it is "produced" by an
operation and consumed by the next operation. This evades checks in the executor that the
type of tensor on each edge matches the type signatures of the producing and consuming operation, which could lead to undefined behavior. Although there is no existing operation that changes the type of a tensor reference, it is possible to use the OpKernelContext API to do so, so we add a further check in the runtime to defend against operations that might be added in the future.
PiperOrigin-RevId:
184356242
Jonathan Hseu [Sat, 3 Feb 2018 00:55:56 +0000 (16:55 -0800)]
Merge commit for internal changes
DosLin [Sat, 3 Feb 2018 00:39:18 +0000 (08:39 +0800)]
Fix docs (#16653)
Jonathan Hseu [Sat, 3 Feb 2018 00:35:10 +0000 (16:35 -0800)]
Update global_step by default if the user specifies a host_call.
PiperOrigin-RevId:
184352399
ManHyuk [Sat, 3 Feb 2018 00:38:55 +0000 (09:38 +0900)]
fix typo (#16679)
Yong Tang [Sat, 3 Feb 2018 00:37:50 +0000 (16:37 -0800)]
Convert unicode to six.string_types for python 3 (#16676)
In Python 3, there is no unicode type. This fix converts
unicode to use six.string_types instead, while maintaining
python 2/3 compatibility.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
Yong Tang [Sat, 3 Feb 2018 00:36:41 +0000 (16:36 -0800)]
Fix a broken link in regression_examples.md (#16685)
This fix fixes a broken link in regression_examples.md
Chris Drake [Sat, 3 Feb 2018 00:34:55 +0000 (16:34 -0800)]
Update metric_ops.py (#16712)
A. Unique TensorFlower [Sat, 3 Feb 2018 00:18:59 +0000 (16:18 -0800)]
Tpu cluster resolver only returns TF server addresses for 'HEALTHY' tpu nodes.
PiperOrigin-RevId:
184350480
Alexandre Passos [Sat, 3 Feb 2018 00:02:22 +0000 (16:02 -0800)]
Replacing _container_prefix with _graph_key to preserve its use in optimizer and deprecate others.
PiperOrigin-RevId:
184348303
Alexandre Passos [Fri, 2 Feb 2018 23:52:18 +0000 (15:52 -0800)]
TF_CALL_ALL_TYPES should include variant
PiperOrigin-RevId:
184347081
Alexandre Passos [Fri, 2 Feb 2018 23:51:41 +0000 (15:51 -0800)]
Rollback of recent changes to tensor.{h,cc}
PiperOrigin-RevId:
184347012
Jianwei Xie [Fri, 2 Feb 2018 23:00:17 +0000 (15:00 -0800)]
Adds batch inference support on TPU with TPUEstimator.predict.
PiperOrigin-RevId:
184339842
Eugene Brevdo [Fri, 2 Feb 2018 22:30:50 +0000 (14:30 -0800)]
[TF RNN] Small optimization to rnn: only calculate copy_cond once.
PiperOrigin-RevId:
184335231
Tatiana Shpeisman [Fri, 2 Feb 2018 22:14:13 +0000 (14:14 -0800)]
Changed minimal required version of bleach Python package from 1.5 to 2.0. bleach 1.5 causes problems with Jupyter as reported in #16424
PiperOrigin-RevId:
184332663
Mingsheng Hong [Fri, 2 Feb 2018 21:53:08 +0000 (13:53 -0800)]
A few misc tweaks to TFE APIs.
PiperOrigin-RevId:
184329345
Yu-Cheng Ling [Fri, 2 Feb 2018 21:49:35 +0000 (13:49 -0800)]
TFLite: Conv CBLAS kernel
PiperOrigin-RevId:
184328848
Derek Murray [Fri, 2 Feb 2018 21:39:38 +0000 (13:39 -0800)]
[tf.data] Move framework/dataset.h to framework/dataset_stateful_op_whitelist.h.
This will make way for the move of kernels/data/dataset.h to
framework/dataset.h, while preserving version control history, after
which we might recombine the headers.
PiperOrigin-RevId:
184327481
Joshua V. Dillon [Fri, 2 Feb 2018 21:08:31 +0000 (13:08 -0800)]
Support `float16` `dtype` in `tf.linalg.*`.
Note: not all `LinearOperator` functions will support `float16`. This change
merely enables constructing the `LinearOperator` object(s) using this `dtype`.
PiperOrigin-RevId:
184323477
Joshua V. Dillon [Fri, 2 Feb 2018 21:07:37 +0000 (13:07 -0800)]
Breaking change: Revise HMC interface to accept a list of Tensors representing a partitioning of chain state.
PiperOrigin-RevId:
184323369
Yuefeng Zhou [Fri, 2 Feb 2018 20:46:34 +0000 (12:46 -0800)]
Skip the node that has unexpected number of outputs.
PiperOrigin-RevId:
184320865
Yong Tang [Fri, 2 Feb 2018 20:31:09 +0000 (12:31 -0800)]
Update Eigen library to
2355b229ea4c and fixes conv2d padding issue (#16705)
This fix updates Eigen to
2355b229ea4c, so that the issue raised in
14601 could be fixed.
This fix fixes 14601.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
Sanjoy Das [Fri, 2 Feb 2018 20:23:47 +0000 (12:23 -0800)]
[TF:XLA] Bump open source llvm revision to r324073
PiperOrigin-RevId:
184318036
A. Unique TensorFlower [Fri, 2 Feb 2018 20:19:43 +0000 (12:19 -0800)]
Update ops-related pbtxt files.
PiperOrigin-RevId:
184317521
Kenji [Fri, 2 Feb 2018 20:16:49 +0000 (20:16 +0000)]
Fix "Define the model" link. (#16661)
The link syntax was inverted, that is, round brackets were coming before square brackets, but Markdown doesn't like it.
Amit Patankar [Fri, 2 Feb 2018 19:38:07 +0000 (11:38 -0800)]
Merge pull request #16704 from tensorflow/yifeif-patch-1
Remove all_files rule from com_google_absl.BUILD
Peter Hawkins [Fri, 2 Feb 2018 19:31:06 +0000 (11:31 -0800)]
[TF:XLA] Improve/refactor the handling of resource types/shapes.
Previously we used an xla::Shape to track the shape of a resource (Variable, TensorArray, Stack) shape. The xla::Shape described how the resource was represented to XLA, e.g., as a (buffer, size) pair for a Stack resource.
Instead, separate the TensorFlow abstract shape representation from the XLA shape representation and track it separately. This leads to simpler and more readable code.
PiperOrigin-RevId:
184310694
A. Unique TensorFlower [Fri, 2 Feb 2018 19:24:17 +0000 (11:24 -0800)]
Allow ResizeBilinear to resize the output tensor in Prepare(), if the size tensor is const.
PiperOrigin-RevId:
184309687
Alexandre Passos [Fri, 2 Feb 2018 19:24:11 +0000 (11:24 -0800)]
Register resource_scatter_update for string types.
PiperOrigin-RevId:
184309674
A. Unique TensorFlower [Fri, 2 Feb 2018 19:06:09 +0000 (11:06 -0800)]
Add shape inference for outside_compilation graph rewrite. Pull out enough of the graph to enable inference of the shape of a SendFromHost Op once the shape of corresponding RecvAtHost Ops are known.
END_PUBLIC
Fixed open source build breaks.
BEGIN_PUBLIC
Automated g4 rollback of changelist
184169668
PiperOrigin-RevId:
184306845
A. Unique TensorFlower [Fri, 2 Feb 2018 18:58:12 +0000 (10:58 -0800)]
Register GPU host kernels for Identity and RefIdentity.
PiperOrigin-RevId:
184305574
Amit Patankar [Fri, 2 Feb 2018 19:13:44 +0000 (11:13 -0800)]
Revert "Updating the version to 1.6.0-rc0." (#16700)
A. Unique TensorFlower [Fri, 2 Feb 2018 18:46:34 +0000 (10:46 -0800)]
Automated g4 rollback of changelist
184273245
PiperOrigin-RevId:
184303789
Anna R [Fri, 2 Feb 2018 18:28:20 +0000 (10:28 -0800)]
Remove hidden_ops.txt file. Instead, switch to use visibility attribute in ApiDef proto.
PiperOrigin-RevId:
184301076
Jacques Pienaar [Fri, 2 Feb 2018 18:04:15 +0000 (10:04 -0800)]
Consider beyond immediate neighbors to find exit node.
Most of the exit nodes are immediate neighbors of the switch, except we do have
cases where the switch feeds into an identity that feeds into a exit.
PiperOrigin-RevId:
184297180
Yifei Feng [Fri, 2 Feb 2018 19:02:34 +0000 (11:02 -0800)]
Remove all_files rule from com_google_absl.BUILD
A. Unique TensorFlower [Fri, 2 Feb 2018 18:01:40 +0000 (10:01 -0800)]
Show that we must over reallocate after resizing dynamic tensors.
PiperOrigin-RevId:
184296680
A. Unique TensorFlower [Fri, 2 Feb 2018 17:20:26 +0000 (09:20 -0800)]
Fix latent bug in dependency optimizer.
PiperOrigin-RevId:
184291701
Yao Zhang [Fri, 2 Feb 2018 17:00:41 +0000 (09:00 -0800)]
Disable graph optimizations (CSE) in test so that constant nodes are not deduped.
PiperOrigin-RevId:
184289685
A. Unique TensorFlower [Fri, 2 Feb 2018 16:09:48 +0000 (08:09 -0800)]
[comment-only change]: Fix grammar error.
PiperOrigin-RevId:
184285125
Derek Murray [Fri, 2 Feb 2018 16:09:13 +0000 (08:09 -0800)]
Fix a bug in function inlining when the argument is an implicitly dereferenced ref tensor.
Previously the inliner would add an identity node with an invalid ref-type attr when the actual parameter had ref type. The changed version removes the reference.
PiperOrigin-RevId:
184285084
A. Unique TensorFlower [Fri, 2 Feb 2018 13:38:50 +0000 (05:38 -0800)]
Enabling partitioned variables to work with TPU.
When partitioned variables are used in a TPU training loop,
concat gradient operations get generated for which XLA requires
the concat dimension argument to be a constant (or foldable to a constant).
However since such constant is defined outside of the train while context
an Enter node is generated in order to pass it.
The fix consists in detecting such case, and to duplicate the (scalar) constant
inside the while context, so that XLA can succesfully process the resulting
graph.
PiperOrigin-RevId:
184273245
Gunhan Gulsoy [Fri, 2 Feb 2018 07:47:33 +0000 (23:47 -0800)]
Fix some tf-lite tests
PiperOrigin-RevId:
184247187
A. Unique TensorFlower [Fri, 2 Feb 2018 05:43:12 +0000 (21:43 -0800)]
Fix tolerance too tight for Wasserstein distance test.
PiperOrigin-RevId:
184240222
Gunhan Gulsoy [Fri, 2 Feb 2018 07:47:33 +0000 (23:47 -0800)]
Fix some tf-lite tests
PiperOrigin-RevId:
184247187
A. Unique TensorFlower [Fri, 2 Feb 2018 05:43:12 +0000 (21:43 -0800)]
Fix tolerance too tight for Wasserstein distance test.
PiperOrigin-RevId:
184240222
Justin Lebar [Fri, 2 Feb 2018 05:34:18 +0000 (21:34 -0800)]
Internal change
PiperOrigin-RevId:
184239740
Amit Patankar [Fri, 2 Feb 2018 18:19:24 +0000 (10:19 -0800)]
Merge pull request #16699 from case540/branch_184236409
Branch
184236409
Michael Case [Fri, 2 Feb 2018 16:33:33 +0000 (08:33 -0800)]
Merge commit for internal changes
Amit Patankar [Fri, 2 Feb 2018 08:35:03 +0000 (00:35 -0800)]
Merge pull request #16672 from av8ramit/update_version_16
Updating the version to 1.6.0-rc0.
Yifei Feng [Fri, 2 Feb 2018 06:51:33 +0000 (22:51 -0800)]
Fix sanity build (#16674)
* Fix sanity.
* Add back other sanity tests.
* Add sanity test back.
* Fix build error.
* Add blacklist.
* Add whitelist.
A. Unique TensorFlower [Fri, 2 Feb 2018 04:35:29 +0000 (20:35 -0800)]
Automated g4 rollback of changelist
183874527
PiperOrigin-RevId:
184236409
A. Unique TensorFlower [Fri, 2 Feb 2018 03:50:34 +0000 (19:50 -0800)]
Supporting new saving op structure.
PiperOrigin-RevId:
184233513
Yu-Cheng Ling [Fri, 2 Feb 2018 02:27:31 +0000 (18:27 -0800)]
Add darwin_x86_64 config in TF Lite BUILD file.
PiperOrigin-RevId:
184227786
Benoit Steiner [Fri, 2 Feb 2018 02:05:15 +0000 (18:05 -0800)]
Fixed the description of the fake GPU device to avoid a division by 0
PiperOrigin-RevId:
184225409
Amit Patankar [Fri, 2 Feb 2018 02:58:21 +0000 (18:58 -0800)]
Merge pull request #16680 from yifeif/branch_184220615
Branch
184220615
lissyx [Fri, 2 Feb 2018 02:03:31 +0000 (03:03 +0100)]
Force sorting of CUDA and Python headers to avoid spurious rebuilds (#16586)
If one does try to re-use Bazel cache of a TensorFlow CUDA-enabled or
Python-enabled build, then it might happen that readdir() syscall behind
the use of find in _read_dir() will generate a different ordering of the
very same list of headers. This will make new genrules for symlinking
the CUDA headers and in the end it will result in different actionKey
computed by Bazel, hence invalidating the action cache.
Fixes #16585
Yifei Feng [Fri, 2 Feb 2018 01:58:54 +0000 (17:58 -0800)]
Merge commit for internal changes
Yifei Feng [Fri, 2 Feb 2018 00:27:49 +0000 (16:27 -0800)]
Add whitelist.
Yifei Feng [Thu, 1 Feb 2018 23:45:39 +0000 (15:45 -0800)]
Add blacklist.
Yifei Feng [Thu, 1 Feb 2018 21:23:12 +0000 (13:23 -0800)]
Fix build error.
Yifei Feng [Thu, 1 Feb 2018 19:00:14 +0000 (11:00 -0800)]
Add sanity test back.
Yifei Feng [Thu, 1 Feb 2018 18:59:16 +0000 (10:59 -0800)]
Add back other sanity tests.
Yifei Feng [Thu, 1 Feb 2018 18:57:29 +0000 (10:57 -0800)]
Fix sanity.
Brennan Saeta [Fri, 2 Feb 2018 01:20:11 +0000 (17:20 -0800)]
Fix tests
PiperOrigin-RevId:
184220615
Benoit Steiner [Fri, 2 Feb 2018 01:19:32 +0000 (17:19 -0800)]
Skip unknown devices since we can't optimize for them
PiperOrigin-RevId:
184220515
Andrew Selle [Fri, 2 Feb 2018 00:51:59 +0000 (16:51 -0800)]
Allow reordering of execution order of nodes with indirect execution_plan.
Now whenever we want to operate in dependency order we use execution_plan.
It begins as identity map (0, ..., nodes_size()) but can be changed
in the future. This is the basis for more pluggable delegation.
PiperOrigin-RevId:
184216885
Jacques Pienaar [Fri, 2 Feb 2018 00:29:30 +0000 (16:29 -0800)]
Automated g4 rollback of changelist
184188816
PiperOrigin-RevId:
184213576
Brennan Saeta [Fri, 2 Feb 2018 00:22:24 +0000 (16:22 -0800)]
GCS Throttle: 1 token == 1 Kb
Previously, 1 token was approximately 256 bytes. This is slightly less
intuitive than 1 kb.
PiperOrigin-RevId:
184212503
Raghuraman Krishnamoorthi [Fri, 2 Feb 2018 00:14:51 +0000 (16:14 -0800)]
Add functionality to fold batch norm (supporting both fused and unfused batch norm) to support quantized training. The weights are always now scaled by gamma/sigma, where sigma is the moving standard deviation for stability prior to quantization. For improved performance, the moving means and variances are frozen and the training graph modified accordingly.
An additional parameter freeze_batch_norm_delay is added to foldbatchnorm function to set the delay at which training switches from regular batch norm to frozen mean and variances.
Remove placement options within FoldBatchNorm as this causes folded training to place all ops on a single GPU. The modification now significantly speeds up distributed training.
The tests for folding batch norms are also updated to reflect the additional topological changes to the graph.
PiperOrigin-RevId:
184211434
A. Unique TensorFlower [Thu, 1 Feb 2018 23:32:20 +0000 (15:32 -0800)]
Add iterate_batches arg to Estimator.predict
PiperOrigin-RevId:
184205196
Skye Wanderman-Milne [Thu, 1 Feb 2018 23:11:35 +0000 (15:11 -0800)]
Make jit_test.py work with C API enabled.
PiperOrigin-RevId:
184202470
A. Unique TensorFlower [Thu, 1 Feb 2018 23:11:20 +0000 (15:11 -0800)]
[XLA] add DotGeneral to the local Python XLA client.
PiperOrigin-RevId:
184202425
Nick Felt [Thu, 1 Feb 2018 23:05:41 +0000 (15:05 -0800)]
Revert TensorBoard entry point back to run_main
PiperOrigin-RevId:
184201506
Anna R [Thu, 1 Feb 2018 22:23:29 +0000 (14:23 -0800)]
Internal change.
PiperOrigin-RevId:
184194895
Igor Saprykin [Thu, 1 Feb 2018 22:11:08 +0000 (14:11 -0800)]
Throw an exception when the user's batch size isn't divisible by GPUs.
The alternative to this is to have an adaptive approach that would unevenly split input into per-tower batches. The concern with that was that all towers will be as slow as the one with more input reducing the performance. Batch size seems to be commonly tailored to the available hardware.
PiperOrigin-RevId:
184192793
Benoit Steiner [Thu, 1 Feb 2018 22:11:08 +0000 (14:11 -0800)]
Return an error instead of assertion when processing an ill-formed graph or an
invalid set of fetch nodes
PiperOrigin-RevId:
184192790
Jacques Pienaar [Thu, 1 Feb 2018 21:48:33 +0000 (13:48 -0800)]
[TFXLA] Use data flow to determine switch grouping.
* Change how switch grouping works:
- This is an intermediate step, next is combining
DetermineBranchMapAndFrontier into one traversal.
* Homogeneous the naming (switch_nodes -> switches);
* Change graph dumping to be due to class member - currently still performed when vlog-level is sufficiently high;
* Pass in correct library when dumping graphs;
PiperOrigin-RevId:
184188816
Noah Fiedel [Thu, 1 Feb 2018 21:48:13 +0000 (13:48 -0800)]
Adding documentation on how to load & serve a model with the
TensorFlow Serving Model Server.
PiperOrigin-RevId:
184188752
A. Unique TensorFlower [Thu, 1 Feb 2018 21:33:20 +0000 (13:33 -0800)]
Fixes a type conversion bug in losses.compute_weighted_loss for reduction=SUM_OVER_BATCH_SIZE.
PiperOrigin-RevId:
184186573
A. Unique TensorFlower [Thu, 1 Feb 2018 21:13:12 +0000 (13:13 -0800)]
Fix segfault when Softmax is first in graph
PiperOrigin-RevId:
184183730
A. Unique TensorFlower [Thu, 1 Feb 2018 21:13:10 +0000 (13:13 -0800)]
Verify tensor contents of tflite model
PiperOrigin-RevId:
184183725
Benoit Steiner [Thu, 1 Feb 2018 20:38:55 +0000 (12:38 -0800)]
Made the addn optimization aware of the graph topology
PiperOrigin-RevId:
184179246