cbockman [Thu, 22 Mar 2018 13:42:39 +0000 (06:42 -0700)]
spelling fix (#17911)
ImSheridan [Thu, 22 Mar 2018 11:55:34 +0000 (19:55 +0800)]
Fix the inconsistency in the accepted shape/data_format of Input Tensor to Conv2D in documentation (#17893)
Benoit Steiner [Thu, 22 Mar 2018 01:56:06 +0000 (18:56 -0700)]
Merge pull request #17394 from peterlee0127/master
add support for other cpu type(aarch64) for tensorRT
Benoit Steiner [Thu, 22 Mar 2018 01:52:33 +0000 (18:52 -0700)]
Merge pull request #17551 from lukeiwanski/fix/197
SYCL with ComputeCpp: local_config_sycl has multiple matches
ImSheridan [Thu, 22 Mar 2018 01:22:42 +0000 (09:22 +0800)]
Fix the variable typo in the python api example (#17900)
Sourabh Bajaj [Wed, 21 Mar 2018 22:41:04 +0000 (15:41 -0700)]
Merge pull request #17906 from sb2nov/branch_189962437
Branch
189962437
Sourabh Bajaj [Wed, 21 Mar 2018 22:38:14 +0000 (15:38 -0700)]
Merge pull request #17812 from imsheridan/fix_broken_kernel_tutorial
Fix two external anchor link in kernel method tutorial
Sourabh Bajaj [Wed, 21 Mar 2018 22:38:03 +0000 (15:38 -0700)]
Merge pull request #17808 from imsheridan/fix_broken_rnnquickdraw
Fix broken internal anchor link in rnn quickdraw tutorial
Joel Shor [Wed, 21 Mar 2018 22:11:33 +0000 (00:11 +0200)]
Fix dataset resampling bug introduced by a bug in datasets itself. fixes #16606 (#17896)
* Fixes github issue #16606.
The core issue is that in the case of certain random Tensors, the
following two lines aren't the same:
```
rand_0s_and_1s_ds = ...
gather_ds = rand_0s_and_1s_ds.map(lambda i: tf.gather([0, 1], i))
tup_ds = tf.data.Dataset.zip(gather_ds, rand_0s_and_1s_ds)
```
```
rand_0s_and_1s_ds = ...
tup_ds = rand_0s_and_1s_ds.map(lambda i: (tf.gather([0, 1], i), i))
Note that this does NOT fix the underlying issue of drawing multiple
sampes from the underlying distribution.
```
Tested:
With the new test, bazel test :resample_test fails before and succeeds
after.
* Fixes github issue #16606.
The core issue is that in the case of certain random Tensors, the
following two lines aren't the same:
```
rand_0s_and_1s_ds = ...
gather_ds = rand_0s_and_1s_ds.map(lambda i: tf.gather([0, 1], i))
tup_ds = tf.data.Dataset.zip(gather_ds, rand_0s_and_1s_ds)
```
```
rand_0s_and_1s_ds = ...
tup_ds = rand_0s_and_1s_ds.map(lambda i: (tf.gather([0, 1], i), i))
Note that this does NOT fix the underlying issue of drawing multiple
sampes from the underlying distribution.
```
Tested:
With the new test, bazel test :resample_test fails before and succeeds
after.
* Undo a spurious git-induced change.
* Fix indent issue.
* Fix indent issue.
Sourabh Bajaj [Wed, 21 Mar 2018 21:06:49 +0000 (14:06 -0700)]
Merge commit for internal changes
Shivani Agrawal [Wed, 21 Mar 2018 20:57:29 +0000 (13:57 -0700)]
[docs] Update explicit latest_checkpoint with `path` returned while saving for object-based checkpointing.
PiperOrigin-RevId:
189962437
A. Unique TensorFlower [Wed, 21 Mar 2018 20:46:27 +0000 (13:46 -0700)]
Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId:
189960595
A. Unique TensorFlower [Wed, 21 Mar 2018 20:30:26 +0000 (13:30 -0700)]
Update ops-related pbtxt files.
PiperOrigin-RevId:
189957912
Eugene Brevdo [Wed, 21 Mar 2018 20:28:11 +0000 (13:28 -0700)]
[TF CriticalSection] Bugfix when Execute() inside a while_loop has a dep on a Variable outside of it.
PiperOrigin-RevId:
189957569
A. Unique TensorFlower [Wed, 21 Mar 2018 20:08:02 +0000 (13:08 -0700)]
Make strcat.{h,cc} independent of Eigen.
PiperOrigin-RevId:
189954596
A. Unique TensorFlower [Wed, 21 Mar 2018 19:53:53 +0000 (12:53 -0700)]
Temporarily disable constant folding past Enter, since a few breakages have been observed.
PiperOrigin-RevId:
189952252
Max Galkin [Wed, 21 Mar 2018 19:53:04 +0000 (12:53 -0700)]
Further improve accuracy of op_level_cost_estimator (Gather, GatherV2, Slice).
PiperOrigin-RevId:
189952132
A. Unique TensorFlower [Wed, 21 Mar 2018 19:40:08 +0000 (12:40 -0700)]
[XLA] Adding more tests for ReduceWindow.
PiperOrigin-RevId:
189950361
Sourabh Bajaj [Wed, 21 Mar 2018 19:26:48 +0000 (12:26 -0700)]
Merge pull request #17899 from benoitsteiner/branch_189913309
Branch
189913309
Benoit Steiner [Wed, 21 Mar 2018 19:14:30 +0000 (12:14 -0700)]
Made sure to compare all the attributes when comparing nodes
PiperOrigin-RevId:
189946858
Jacques Pienaar [Wed, 21 Mar 2018 19:07:51 +0000 (12:07 -0700)]
Merge changes from github.
PiperOrigin-RevId:
189945839
Ilya Biryukov [Wed, 21 Mar 2018 19:00:04 +0000 (12:00 -0700)]
Fix compilation error with clang.
Link to breaking CI build:
https://ci.tensorflow.org/view/Nightly/job/nightly-matrix-linux-gpu-clang/232
PiperOrigin-RevId:
189944547
Justin Lebar [Wed, 21 Mar 2018 18:41:12 +0000 (11:41 -0700)]
Don't run data_utils_test without optimizations.
PiperOrigin-RevId:
189941645
Frank Perbet [Wed, 21 Mar 2018 18:40:25 +0000 (11:40 -0700)]
Make the graph_editor C-API friendly: always construct ops with their inputs.
PiperOrigin-RevId:
189941495
A. Unique TensorFlower [Wed, 21 Mar 2018 18:18:02 +0000 (11:18 -0700)]
Update ops-related pbtxt files.
PiperOrigin-RevId:
189937564
A. Unique TensorFlower [Wed, 21 Mar 2018 18:16:13 +0000 (11:16 -0700)]
Allowing dnn tree combined estimator to work with core versions of feature columns and losses
PiperOrigin-RevId:
189937063
Alexandre Passos [Wed, 21 Mar 2018 18:12:28 +0000 (11:12 -0700)]
Moves KernelAndDevice to common_runtime
PiperOrigin-RevId:
189936396
Jiri Simsa [Wed, 21 Mar 2018 18:10:13 +0000 (11:10 -0700)]
Adding `drop_remainder` option for the `map_and_batch` transformation, which allows the user to express whether they wish to drop the last batch if its size is smaller than desired; the default is not to drop the smaller batch.
PiperOrigin-RevId:
189936029
A. Unique TensorFlower [Wed, 21 Mar 2018 18:01:54 +0000 (11:01 -0700)]
Update the doc to reflect the change of replacing std::clock with random::New64() as random number generator seed.
PiperOrigin-RevId:
189934377
Justin Lebar [Wed, 21 Mar 2018 17:47:18 +0000 (10:47 -0700)]
[XLA:GPU] Don't crash if a GTE feeds into a bitcast.
GTE and bitcast are sort of "implicitly fused", so we have to handle
them in this way.
PiperOrigin-RevId:
189931422
Michael Case [Wed, 21 Mar 2018 17:26:49 +0000 (10:26 -0700)]
Fix zipfile path for MacOS builds.
For some reason, the zipfile module on Macs appears to work differently and
complains about the whl file we are trying to extract not being found.
PiperOrigin-RevId:
189928007
Jingyue Wu [Wed, 21 Mar 2018 17:20:25 +0000 (10:20 -0700)]
Collapse adjacent dimensions that have no paddings.
For example,
tf.pad(<4D tensor>, [[0, 0], [0, 0], [0, 0], [0, 1]])
is equivalent to a 2D pad, which is faster.
PiperOrigin-RevId:
189926996
Benoit Steiner [Wed, 21 Mar 2018 16:59:18 +0000 (09:59 -0700)]
Added an option to run shape analysis assuming the shapes of the feed nodes are
valid.
PiperOrigin-RevId:
189923541
A. Unique TensorFlower [Wed, 21 Mar 2018 16:26:16 +0000 (09:26 -0700)]
Deletes sequential_feature_column(|_test).py.
PiperOrigin-RevId:
189919029
Justin Lebar [Wed, 21 Mar 2018 16:20:28 +0000 (09:20 -0700)]
Don't run tensorflow/python:function_test under fastbuild.
It gets flaky timeouts.
PiperOrigin-RevId:
189918276
Benoit Steiner [Wed, 21 Mar 2018 16:19:11 +0000 (09:19 -0700)]
Deleted dead code and fixed compilation warnings
PiperOrigin-RevId:
189918110
Benoit Steiner [Wed, 21 Mar 2018 16:14:40 +0000 (09:14 -0700)]
Merge commit for internal changes
Derek Murray [Wed, 21 Mar 2018 15:45:19 +0000 (08:45 -0700)]
Refactor pruning code to support custom node rewrites for feeds and fetches.
PiperOrigin-RevId:
189913309
Benoit Steiner [Wed, 21 Mar 2018 15:40:35 +0000 (08:40 -0700)]
More accurate shape inference for TensorArrayGatherV3 and TensorArrayScatterV3
PiperOrigin-RevId:
189912762
Eugene Brevdo [Wed, 21 Mar 2018 15:25:34 +0000 (08:25 -0700)]
[tf.contrib CriticalSection] Avoid deadlocks using additional control dependencies on the lock op.
PiperOrigin-RevId:
189910726
A. Unique TensorFlower [Wed, 21 Mar 2018 15:21:28 +0000 (08:21 -0700)]
Automated g4 rollback of changelist
189888700
PiperOrigin-RevId:
189910239
A. Unique TensorFlower [Wed, 21 Mar 2018 14:34:28 +0000 (07:34 -0700)]
Install documentation: adds note for virtual env with fish shell
PiperOrigin-RevId:
189904848
Justin Lebar [Wed, 21 Mar 2018 14:33:03 +0000 (07:33 -0700)]
[XLA] Initialize arrays using cudaMemset when possible.
Previously we were using our own hand-rolled initializer thunk. This
worked OK for reduces, because the amount of data we were initializing
is usually small. But for e.g. select-and-scatter, it's quite slow.
This patch lets us use cudaMemset instead.
PiperOrigin-RevId:
189904720
A. Unique TensorFlower [Wed, 21 Mar 2018 13:57:06 +0000 (06:57 -0700)]
Tensorflow/GCS: Check whether we are running under GCE before trying to obtain auth token from GCE. Before this change, if a process is not running under GCE, the token request to metadata server would time out after 3+ minutes of retry. After this change, the check is bypassed, and we return an empty token to the caller. At that point, the caller's request to read/write a file in GCS would either succeed or fail depending on whether the bucket is publicly accessible.
PiperOrigin-RevId:
189900977
A. Unique TensorFlower [Wed, 21 Mar 2018 12:55:32 +0000 (05:55 -0700)]
Minor cosmetic improvement to error message.
PiperOrigin-RevId:
189895415
A. Unique TensorFlower [Wed, 21 Mar 2018 11:09:32 +0000 (04:09 -0700)]
We were ValueOrDie()ing in one place, and TF_CHECK_OK()ing in another. Both should gracefully return an error condition.
Add some tests to check this.
PiperOrigin-RevId:
189888700
Priya Gupta [Wed, 21 Mar 2018 06:07:37 +0000 (23:07 -0700)]
Make graph's name scope thread local so that two threads opening the same scope don't get nested under each other.
PiperOrigin-RevId:
189865854
Priya Gupta [Wed, 21 Mar 2018 04:39:16 +0000 (21:39 -0700)]
Make variable scope and scope counts local to current thread so that they work correctly in multi-threaded environments.
PiperOrigin-RevId:
189860229
Skye Wanderman-Milne [Wed, 21 Mar 2018 04:30:02 +0000 (21:30 -0700)]
C API: fix device + colocation edge case in import_graph_def
This change makes the C API consistent with the Python API, by making
sure that all nodes in a colocation group have the device of the op
named in the "_class" attr (all other ops' devices are ignored). This
is currently done by preserving the current Python logic for
colocation and devices, which only works if all ops start with no
device set. Without this change, imported nodes would have the device
specified in the GraphDef. This change unsets any device before
running the Python logic.
PiperOrigin-RevId:
189859688
Gunhan Gulsoy [Wed, 21 Mar 2018 03:28:58 +0000 (20:28 -0700)]
Revert "Windows: Enable tensorflow/contrib in Bazel build (#16659)" (#17774)
* Revert "Windows: Enable tensorflow/contrib in Bazel build (#16659)"
This reverts commit
c6a12c77a50778e28de3590f4618bc2b62f3ecab.
* Add kafka back to contrib_py rule.
* Update __init__.py
Gunhan Gulsoy [Wed, 21 Mar 2018 03:28:36 +0000 (20:28 -0700)]
Revert "Fix dataset resampling bug introduced by a bug in datasets itself. fixes #16606 " (#17874)
Smit Hinsu [Wed, 21 Mar 2018 03:25:03 +0000 (20:25 -0700)]
Remove recently introduced LOG INFO statements from AvgPoolingOp
PiperOrigin-RevId:
189856039
A. Unique TensorFlower [Wed, 21 Mar 2018 02:48:18 +0000 (19:48 -0700)]
Add reduce window tests for the cases when the input shape has 1 element.
PiperOrigin-RevId:
189853631
Chris Leary [Wed, 21 Mar 2018 02:14:26 +0000 (19:14 -0700)]
[XLA] Plumb hlo dump options via local client.
PiperOrigin-RevId:
189851211
A. Unique TensorFlower [Wed, 21 Mar 2018 01:45:17 +0000 (18:45 -0700)]
Minor documentation fix
PiperOrigin-RevId:
189848838
A. Unique TensorFlower [Wed, 21 Mar 2018 01:36:33 +0000 (18:36 -0700)]
[XLA] Simpify XlaBuilder: extract common add instruction logic.
PiperOrigin-RevId:
189848174
Benoit Steiner [Wed, 21 Mar 2018 00:09:46 +0000 (17:09 -0700)]
Merge pull request #17871 from benoitsteiner/branch_189819449
Branch
189819449
A. Unique TensorFlower [Wed, 21 Mar 2018 00:00:33 +0000 (17:00 -0700)]
Fixing bug in MultitaskOptimizerWrapper where types of tensors were mismatching.
PiperOrigin-RevId:
189837743
Anjali Sridhar [Tue, 20 Mar 2018 23:32:22 +0000 (16:32 -0700)]
Use softmax_crossentropy_with_logits_v2 in tf.keras since softmax_crossentropy_with_logits is deprecated.
PiperOrigin-RevId:
189833677
A. Unique TensorFlower [Tue, 20 Mar 2018 23:13:58 +0000 (16:13 -0700)]
[XLA] Use IDs instead of names to represent the edges of HLO graph in hlo.proto.
PiperOrigin-RevId:
189831057
Peter Hawkins [Tue, 20 Mar 2018 23:11:23 +0000 (16:11 -0700)]
[XLA] Make HLO memory schedulers pluggable. Introduce a typedef MemorySchedulerAlgorithm which is a function instead of an enum to allow experimentation with non-standard schedulers. Refactoring only; no functional changes to the scheduling itself.
PiperOrigin-RevId:
189830685
Benoit Steiner [Tue, 20 Mar 2018 22:47:20 +0000 (15:47 -0700)]
Merge commit for internal changes
Ankit Gupta [Tue, 20 Mar 2018 22:41:45 +0000 (15:41 -0700)]
LoggingTensorHook to read from runconfig in Estimator (#17157)
* got loggingtensor to read from runconfig
* updated pydoc
Sourabh Bajaj [Tue, 20 Mar 2018 22:19:38 +0000 (15:19 -0700)]
Merge pull request #17866 from sb2nov/branch_189799697
Branch
189799697
Joel Shor [Tue, 20 Mar 2018 22:13:38 +0000 (00:13 +0200)]
Merge pull request #17858 from joel-shor/loader
Fix dataset resampling bug introduced by a bug in datasets itself. fixes #16606
A. Unique TensorFlower [Tue, 20 Mar 2018 22:10:07 +0000 (15:10 -0700)]
Tweak statistical testing test to avoid making a zillion TF session.run calls.
PiperOrigin-RevId:
189819449
joel-shor [Tue, 20 Mar 2018 22:04:13 +0000 (00:04 +0200)]
Really the last indendation bug fix.
Terry Koo [Tue, 20 Mar 2018 21:52:58 +0000 (14:52 -0700)]
Revert "Adds missing protobuf dep to tf.contrib.data ops. (#17840)" (#17864)
* Revert "Adds missing protobuf dep to tf.contrib.data ops. (#17840)"
This reverts commit
36ec749ec79c2313924666a1c5324620e493d0c4.
* Protect lib_proto_parsing dep with if_static().
joel-shor [Tue, 20 Mar 2018 21:46:39 +0000 (23:46 +0200)]
Hopefully final indent fix.
A. Unique TensorFlower [Tue, 20 Mar 2018 21:33:19 +0000 (14:33 -0700)]
[XLA] Simplify the HLO proto: don't nest the fusion computation in an fusion HloInstructionProto.
PiperOrigin-RevId:
189811729
Derek Murray [Tue, 20 Mar 2018 21:30:36 +0000 (14:30 -0700)]
[tf.data] Improve docstring for `tf.contrib.data.Counter`.
PiperOrigin-RevId:
189811108
Anjali Sridhar [Tue, 20 Mar 2018 21:23:39 +0000 (14:23 -0700)]
Internal Change.
PiperOrigin-RevId:
189809845
Piotr Czapla [Tue, 20 Mar 2018 21:20:20 +0000 (22:20 +0100)]
Add training parameter to dropout to make it work (#16133)
* Add training parameter to dropout to make it work
I think that without this parameter set dropout is disabled all the time. At least this is what I read in the documentation, besides adding this improves training.
* Removing redundant if statement around dropout
* Fix linter error: line longer than 80.
joel-shor [Tue, 20 Mar 2018 20:54:22 +0000 (22:54 +0200)]
Fix more lint errors.
Terry Koo [Tue, 20 Mar 2018 20:39:42 +0000 (13:39 -0700)]
Makes protobuf dep in tf.contrib.data conditional using if_static().
In non-monolithic builds, adding it unconditionally would duplicate of protobuf symbols among tf.contrib op libraries. Guarding it with if_static() restricts the dep to monolithic builds, which should be able to dedupe the symbols at link time.
PiperOrigin-RevId:
189800612
A. Unique TensorFlower [Tue, 20 Mar 2018 20:38:09 +0000 (13:38 -0700)]
Build tflite interpreter from buffer in python interface
PiperOrigin-RevId:
189800400
Sourabh Bajaj [Tue, 20 Mar 2018 20:40:19 +0000 (13:40 -0700)]
Merge commit for internal changes
Benoit Steiner [Tue, 20 Mar 2018 20:34:02 +0000 (13:34 -0700)]
Improved the performance of the function optimizer.
PiperOrigin-RevId:
189799697
joel-shor [Tue, 20 Mar 2018 20:12:01 +0000 (22:12 +0200)]
Fix indent mistake.
joel-shor [Tue, 20 Mar 2018 20:09:40 +0000 (22:09 +0200)]
Merge remote-tracking branch 'origin/loader' into loader
joel-shor [Tue, 20 Mar 2018 20:06:21 +0000 (22:06 +0200)]
Adjust indentations to conform to pylint.
A. Unique TensorFlower [Tue, 20 Mar 2018 20:02:36 +0000 (13:02 -0700)]
In allocate_transient_arrays.cc, was not handling the case where the same
array occurs more than once in the list of inputs or outputs of a node.
PiperOrigin-RevId:
189794090
A. Unique TensorFlower [Tue, 20 Mar 2018 19:56:51 +0000 (12:56 -0700)]
TFBT: Pass label_keys to the head class constructor.
PiperOrigin-RevId:
189793004
Mingxing Tan [Tue, 20 Mar 2018 19:54:01 +0000 (12:54 -0700)]
Add broadcasting support for fused add or sub.
PiperOrigin-RevId:
189792542
Sanjoy Das [Tue, 20 Mar 2018 19:51:50 +0000 (12:51 -0700)]
[TF:XLA] Bump open source llvm revision to r327958
PiperOrigin-RevId:
189792132
Sourabh Bajaj [Tue, 20 Mar 2018 19:02:51 +0000 (12:02 -0700)]
Merge pull request #17847 from sb2nov/branch_189641833
Branch
189641833
Max Galkin [Tue, 20 Mar 2018 18:45:23 +0000 (11:45 -0700)]
Improved accuracy of op_level_cost_estimator (QuantizeV2, Dequantize, Gather).
PiperOrigin-RevId:
189779691
A. Unique TensorFlower [Tue, 20 Mar 2018 18:36:07 +0000 (11:36 -0700)]
Don't run tensorflow/python:function_test under asan.
It gets flaky timeouts.
PiperOrigin-RevId:
189777986
A. Unique TensorFlower [Tue, 20 Mar 2018 18:27:54 +0000 (11:27 -0700)]
The Quantized BroadcastSub portion of #17123
PiperOrigin-RevId:
189776376
A. Unique TensorFlower [Tue, 20 Mar 2018 18:21:40 +0000 (11:21 -0700)]
Update version of nsync used by TensorFlow.
The primary change is that on Linux, the C++11 build of nsync will now use
underlying system primitives to implement a semaphore instead of the C++11
primitives, which are currently surprisingly slow on Linux.
PiperOrigin-RevId:
189775201
Sanjoy Das [Tue, 20 Mar 2018 18:13:48 +0000 (11:13 -0700)]
Use 32 bit induction variable in gather expander
Right now this is unconditional (and we fail with Unimplemented() if a 32 bit
induction variable is not large enough), but eventually we may want to be
smarter about this.
PiperOrigin-RevId:
189773581
A. Unique TensorFlower [Tue, 20 Mar 2018 18:12:47 +0000 (11:12 -0700)]
Replace std::clock with random::New64() for setting random seed
PiperOrigin-RevId:
189773399
A. Unique TensorFlower [Tue, 20 Mar 2018 18:04:44 +0000 (11:04 -0700)]
Add support for automatically wrapping NumPy functions based on a whitelist.
PiperOrigin-RevId:
189771575
Sourabh Bajaj [Tue, 20 Mar 2018 18:03:51 +0000 (11:03 -0700)]
Fix BUILD file formatting
Sourabh Bajaj [Tue, 20 Mar 2018 17:39:51 +0000 (10:39 -0700)]
Mark sparse wrap test as no-pip
A. Unique TensorFlower [Tue, 20 Mar 2018 16:27:24 +0000 (09:27 -0700)]
Revise the main API for more consistent notation and add a supplemental shortcut to mark functions as "run in py_func". This is an intermediate step to simplifying the execution of plotting code.
PiperOrigin-RevId:
189753509
Jianwei Xie [Tue, 20 Mar 2018 15:32:30 +0000 (08:32 -0700)]
Fixed the bug that the export code triggers the TPU validation.
PiperOrigin-RevId:
189745966
Shanqing Cai [Tue, 20 Mar 2018 15:08:48 +0000 (08:08 -0700)]
tfdbg: Curses CLI: Fill line-end whitespace with default color pair
to prevent spurious color pairs from appearing in certain text
terminal environments.
RELNOTES: Bug fix: tfdbg curses CLI: fix spurious background colors in some text terminals.
PiperOrigin-RevId:
189742433
A. Unique TensorFlower [Tue, 20 Mar 2018 14:27:16 +0000 (07:27 -0700)]
Drop name_scope from operation names during quantization to avoid doubling it up.
PiperOrigin-RevId:
189737746
A. Unique TensorFlower [Tue, 20 Mar 2018 13:28:09 +0000 (06:28 -0700)]
Make TensorSpec and BoundedTensorSpec serializable.
PiperOrigin-RevId:
189731737