platform/upstream/tensorflow.git
4 years ago[Dist] Disable -lto option. 03/213503/1 accepted/tizen_5.5_unified accepted/tizen_5.5_unified_mobile_hotfix accepted/tizen_5.5_unified_wearable_hotfix tizen_5.5_mobile_hotfix tizen_5.5_tv tizen_5.5_wearable_hotfix accepted/tizen/5.5/unified/20191031.013740 accepted/tizen/5.5/unified/mobile/hotfix/20201027.072606 accepted/tizen/5.5/unified/wearable/hotfix/20201027.105146 accepted/tizen/unified/20190909.050757 submit/tizen/20190906.043004 submit/tizen_5.5/20191031.000008 submit/tizen_5.5_mobile_hotfix/20201026.185108 submit/tizen_5.5_wearable_hotfix/20201026.184308 tizen_5.5.m2_release
MyungJoo Ham [Fri, 6 Sep 2019 04:17:41 +0000 (13:17 +0900)]
[Dist] Disable -lto option.

Some Tizen distributors use -lto, which breaks Tensorflow-Lite.
Override such an option by adding -lno-lto.

Change-Id: Ib3bda7c020be0480d2603b124519a7ebab9904d1
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
4 years ago[Dist] Remove tf-normal dependencies. 48/213448/1
MyungJoo Ham [Thu, 5 Sep 2019 09:39:00 +0000 (18:39 +0900)]
[Dist] Remove tf-normal dependencies.

Enable tf-lite only, remove tf-normal build deps.

Change-Id: I4edcdc644a1ae353215715611a210bdb5b1d44d4
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] Build TF-Lite only sandbox/mzx/tflite-only-1.13 accepted/tizen/unified/20190723.112119 submit/tizen/20190718.103725 submit/tizen/20190722.095424
MyungJoo Ham [Thu, 18 Jul 2019 10:21:21 +0000 (19:21 +0900)]
[Dist] Build TF-Lite only

1. That's what we need in Tizen 5.5 for now.
2. TF CMake Build is too much broken. I've resolved all build & runtime-link errors; however, now I'm seeing much harder runtime memory issues with CMake TF build. Until we get BAZEL+OpenJDK8 in Tizen, let's hold tensorflow.

Change-Id: Iaba1de07f541a603c832ef6ba7a360858e69307a
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist/Debian] Handling double-quote in debian-way sandbox/mzx/1.13.1
MyungJoo Ham [Thu, 18 Jul 2019 06:43:15 +0000 (15:43 +0900)]
[Dist/Debian] Handling double-quote in debian-way

It has a strange parsing rule.

Change-Id: I46ff25d87d85122a8d80839cb1fe3cf03d5f9382
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist/Debian] Add cflags for debian tf-lite build
MyungJoo Ham [Thu, 18 Jul 2019 03:55:25 +0000 (12:55 +0900)]
[Dist/Debian] Add cflags for debian tf-lite build

TF Lite wans some additional build flags.

Change-Id: I32ba9243a42257040c83b9be3b30a14bdd84279c
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist/Debian] Fix incorrect path
MyungJoo Ham [Thu, 18 Jul 2019 02:00:54 +0000 (11:00 +0900)]
[Dist/Debian] Fix incorrect path

Path to neon2sse is incorrect.

Change-Id: Iba6e3c7f49e9d30c3a48f6570db32e49392baa50
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist/Debian] Add -fpermissive
MyungJoo Ham [Thu, 18 Jul 2019 00:30:27 +0000 (09:30 +0900)]
[Dist/Debian] Add -fpermissive

It appears that it does not get flags from command line.

Change-Id: Ic49fc56784a9c65aeac0ea048f51407bd3b5a914
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[CMake] array_ops.h is generated by tf_cc_ops
MyungJoo Ham [Thu, 18 Jul 2019 00:27:05 +0000 (09:27 +0900)]
[CMake] array_ops.h is generated by tf_cc_ops

Add tf_cc_ops in the dependency lists.

Change-Id: Ic491e94d433e0e3ec274cbcf2c15ca343da8cd00
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[CMake] Another array_ops error after shared lib
MyungJoo Ham [Wed, 17 Jul 2019 16:26:07 +0000 (01:26 +0900)]
[CMake] Another array_ops error after shared lib

[ 1814s] /home/abuild/rpmbuild/BUILD/tensorflow-v1.13.1/tensorflow/core/grappler/optimizers/data/vectorization/cwise_op_vectorizer.cc:18:41: fatal error: tensorflow/cc/ops/array_ops.h: No such file or directory
[ 1814s]  #include "tensorflow/cc/ops/array_ops.h"
[ 1814s]                                          ^
[ 1814s] compilation terminated.
[ 1814s] CMakeFiles/tf_core_cpu.dir/build.make:3062: recipe for target 'CMakeFiles/tf_core_cpu.dir/home/abuild/rpmbuild/BUILD/tensorflow-v1.13.1/tensorflow/core/grappler/optimizers/data/vectorization/cwise_op_vectorizer.cc.o' failed
[ 1814s] make[2]: *** [CMakeFiles/tf_core_cpu.dir/home/abuild/rpmbuild/BUILD/tensorflow-v1.13.1/tensorflow/core/grappler/optimizers/data/vectorization/cwise_op_vectorizer.cc.o] Error 1
[ 1814s] make[2]: *** Waiting for unfinished jobs....
[ 1819s] CMakeFiles/Makefile2:2692: recipe for target 'CMakeFiles/tf_core_cpu.dir/all' failed
[ 1819s] make[1]: *** [CMakeFiles/tf_core_cpu.dir/all] Error 2
[ 1819s] Makefile:129: recipe for target 'all' failed
[ 1819s] make: *** [all] Error 2
[ 1819s] error: Bad exit status from /var/tmp/rpm-tmp.38NlR1 (%build)
message("STOPPING
[ 1819s]

Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[CMake] Fix undefined symbol of SessionRef
MyungJoo Ham [Wed, 17 Jul 2019 11:59:35 +0000 (20:59 +0900)]
[CMake] Fix undefined symbol of SessionRef

Fix:
(gst-plugin-scanner:3296): GStreamer-WARNING **: Failed to load plugin '/home/abuild/rpmbuild/BUILD/nnstreamer-0.2.1/build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow.so': /lib64/libpywrap_tensorflow_internal.so: undefined symbol: _ZN10tensorflow10SessionRefC1EPNS_7SessionE

Change-Id: I46762a797798b8415d8f3f6af596904bfb6b6820
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Debian/Ubuntu] Avoid unicode build error
MyungJoo Ham [Wed, 17 Jul 2019 11:35:44 +0000 (20:35 +0900)]
[Debian/Ubuntu] Avoid unicode build error

[ 3752s] /usr/src/packages/BUILD/tensorflow/core/kernels/unicode_ops.cc:65:39: error: invalid conversion from 'const UChar* {aka const short unsigned int*}' to 'const char16_t*' [-fpermissive]
[ 3752s]      const char16_t* buf = in.getBuffer();
[ 3752s]                                        ^
[ 3753s] CMakeFiles/tf_core_kernels.dir/build.make:13670: recipe for target 'CMakeFiles/tf_core_kernels.dir/usr/src/packages/BUILD/tensorflow/core/kernels/unicode_ops.cc.o' failed

Change-Id: Iaaea748380a911a775e5c09fb1fa7a51bf31ecff
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist/Debian] Separate main tensorflow package
MyungJoo Ham [Wed, 17 Jul 2019 11:30:46 +0000 (20:30 +0900)]
[Dist/Debian] Separate main tensorflow package

Separate tensorflow.deb from tensorflow-dev.deb

Change-Id: I3773d89f49469cc868e10a8096d3fefbd4f0403f
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[CMake] Aviod build error after build_shared enable
MyungJoo Ham [Wed, 17 Jul 2019 11:02:35 +0000 (20:02 +0900)]
[CMake] Aviod build error after build_shared enable

[ 1903s] /home/abuild/rpmbuild/BUILD/tensorflow-v1.13.1/tensorflow/core/grappler/optimizers/data/vectorization/cwise_op_vectorizer.cc:18:41: fatal error: tensorflow/cc/ops/array_ops.h: No such file or directory
[ 1903s]  #include "tensorflow/cc/ops/array_ops.h"
[ 1903s]                                          ^
[ 1903s] compilation terminated.

Change-Id: Ic492db50d2d74611bdff955b57678fab96c5505e
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[CMake] TF's .so is missing absl symbols
MyungJoo Ham [Wed, 17 Jul 2019 10:02:10 +0000 (19:02 +0900)]
[CMake] TF's .so is missing absl symbols

Add dependencies to avoid:

(gst-plugin-scanner:29481): GStreamer-WARNING **: Failed to load plugin '/home/abuild/rpmbuild/BUILD/nnstreamer-0.2.1/build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow.so': /lib64/libpywrap_tensorflow_internal.so: undefined symbol: _ZN4absl16variant_internal21ThrowBadVariantAccessEv

Change-Id: Ic1b1fe2ac58537678a6a0c317441497a73423acd
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] Enable shared-lib option of tensorflow
MyungJoo Ham [Wed, 17 Jul 2019 10:00:57 +0000 (19:00 +0900)]
[Dist] Enable shared-lib option of tensorflow

Let's enable shared_lib mode.

Change-Id: I5d41bfd852f94b83dcd28bf29ea5ad2322f118bb
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist/Debian] Fix rule path error
MyungJoo Ham [Wed, 17 Jul 2019 07:04:50 +0000 (16:04 +0900)]
[Dist/Debian] Fix rule path error

There was a missing deliminator, /.

Change-Id: I8ea784929c187ea2947fc9831cda6aeab90386e9
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[CMake] Fix undefined symbol of TFE_OpSetAttrBoolList
MyungJoo Ham [Wed, 17 Jul 2019 07:02:01 +0000 (16:02 +0900)]
[CMake] Fix undefined symbol of TFE_OpSetAttrBoolList

Fix:

(gst-plugin-scanner:2272): GStreamer-WARNING **: Failed to load plugin '/home/abuild/rpmbuild/BUILD/nnstreamer-0.2.1/build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow.so': /lib64/libpywrap_tensorflow_internal.so: undefined symbol: TFE_OpSetAttrBoolList

(gst-plugin-scanner:2272): GStreamer-WARNING **: Failed to load plugin '/home/abuild/rpmbuild/BUILD/nnstreamer-0.2.1/build/gst/nnstreamer/libnnstreamer.so': /lib64/libpywrap_tensorflow_internal.so: undefined symbol: TFE_OpSetAttrBoolList

Change-Id: I78b357d00bbf5d2cd57fb666f9885db9d8d4e965
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist/Debian] Enable debian build for Ubuntu
MyungJoo Ham [Wed, 17 Jul 2019 05:49:50 +0000 (14:49 +0900)]
[Dist/Debian] Enable debian build for Ubuntu

Let it not use systemlib for protobuf/grpc.
Ubuntu xenial/bionic has old versions of them.

Change-Id: Icb3018993f2f54b74226b16c2daea6a7e089e996
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[CMake] Fix regression on non-systemlib build mode for protobuf/grpc
MyungJoo Ham [Wed, 17 Jul 2019 05:49:11 +0000 (14:49 +0900)]
[CMake] Fix regression on non-systemlib build mode for protobuf/grpc

Fix regression on non-systemlib builds.

Change-Id: Ie7912aba09d30bbf14557019d5d56b932fa1161f
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoRevert "[Dist] Remove grpc/protobuf/zlib from dist cache"
MyungJoo Ham [Tue, 16 Jul 2019 06:59:24 +0000 (15:59 +0900)]
Revert "[Dist] Remove grpc/protobuf/zlib from dist cache"

Ubuntu Xeinal/Bionic has older versions of GRPC/Protobuf that are
not compatible with tensorflow 1.13. Use these archives for them.

This reverts commit d5bd25d162d3b0834aaff7b0000963b2416715b0.

5 years ago[Dist] Remove dependency on grpc-static
MyungJoo Ham [Tue, 16 Jul 2019 04:19:40 +0000 (13:19 +0900)]
[Dist] Remove dependency on grpc-static

Let's use shared library of grpc in Tizen.

Change-Id: Ief4cf02f13ab24019a80e137e58cc3dc596d04d9
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[CMake] If GRPC is disabled, don't use it
MyungJoo Ham [Fri, 12 Jul 2019 07:46:16 +0000 (16:46 +0900)]
[CMake] If GRPC is disabled, don't use it

TF_CORE_FRAMEWORK has been keep using it if it's NOT WIN32.

Change-Id: Ia3c9885459a1e906a8bffaad2ebdf0751ca62911
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist/Ubuntu] Fix rule file for pdebuild
MyungJoo Ham [Fri, 12 Jul 2019 07:21:38 +0000 (16:21 +0900)]
[Dist/Ubuntu] Fix rule file for pdebuild

With this update, GRPC dependency is resolved dynamically.
Fixed other potential issues and realigned install scripts.

Change-Id: I798649f1789650c01c64a867c736bf384ab6d16a
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[TFLite/Make] Fix shell portability
MyungJoo Ham [Fri, 12 Jul 2019 07:20:49 +0000 (16:20 +0900)]
[TFLite/Make] Fix shell portability

Explicitly request bash for bash syntax.

Change-Id: I7cb6d0b34c393258059d5ebd56415098ab5f8933
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist/Ubuntu] Disable GRPC in xenial. Update GRPC for bionic
MyungJoo Ham [Fri, 12 Jul 2019 01:45:57 +0000 (10:45 +0900)]
[Dist/Ubuntu] Disable GRPC in xenial. Update GRPC for bionic

GRPC in xenial is too old. Disable it.

Change-Id: Ie9659d76797f468168a18538c052b6751a74d53c
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] Remove grpc/protobuf/zlib from dist cache
MyungJoo Ham [Thu, 11 Jul 2019 03:55:33 +0000 (12:55 +0900)]
[Dist] Remove grpc/protobuf/zlib from dist cache

We now build with system's shared library for grpc/protobuf/zlib.

Change-Id: I9cd999363015f17bdf38d53f0fd1a1d8fd9bf2e4
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] x64/tf-lite breaks nnstreamer
MyungJoo Ham [Thu, 11 Jul 2019 03:35:18 +0000 (12:35 +0900)]
[Dist] x64/tf-lite breaks nnstreamer

There are erros at nnstreamer:

[   15s] c++  -o ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow-lite.so 'ext/nnstreamer/tensor_filter/584bea7@@nnstreamer_filter_tensorflow-lite@sha/tensor_filter_tensorflow_lite.c.o' 'ext/nnstreamer/tensor_filter/584bea7@@nnstreamer_filter_tensorflow-lite@sha/tensor_filter_tensorflow_lite_core.cc.o' -Wl,--no-undefined -Wl,--as-needed -shared -fPIC -Wl,--start-group -Wl,-soname,libnnstreamer_filter_tensorflow-lite.so -O2 -g2 -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector -Wformat-security -fmessage-length=0 -Wl,--as-needed -feliminate-unused-debug-types --param=ssp-buffer-size=4 -fdiagnostics-color=never -m64 -march=nehalem -msse4.2 -mfpmath=sse -fasynchronous-unwind-tables -fno-omit-frame-pointer -g -std=gnu++11 gst/nnstreamer/libnnstreamer.so /usr/lib64/libtensorflow-lite.a -ldl /usr/lib64/libglib-2.0.so /usr/lib64/libgstreamer-1.0.so /usr/lib64/libgobject-2.0.so /usr/lib64/libgstbase-1.0.so /usr/lib64/libgstcontroller-1.0.so /usr/lib64/libgstvideo-1.0.so /usr/lib64/libgstaudio-1.0.so -lm -ldl /usr/lib64/liborc-0.4.so -Wl,--end-group -pthread '-Wl,-rpath,$ORIGIN/../../../gst/nnstreamer' -Wl,-rpath-link,/home/abuild/rpmbuild/BUILD/nnstreamer-0.2.1/build/gst/nnstreamer
[   15s] /usr/lib64/gcc/x86_64-tizen-linux-gnu/6.2.1/../../../../x86_64-tizen-linux-gnu/bin/ld: /usr/lib64/libtensorflow-lite.a(interpreter.o): relocation R_X86_64_32 against `.rodata.str1.8' can not be used when making a shared object; recompile with -fPIC
[   15s] /usr/lib64/gcc/x86_64-tizen-linux-gnu/6.2.1/../../../../x86_64-tizen-linux-gnu/bin/ld: /usr/lib64/libtensorflow-lite.a(register.o): relocation R_X86_64_32 against `.rodata.str1.8' can not be used when making a shared object; recompile with -fPIC

Change-Id: I08b2bcb9920d430171325957ab9f70cabea40ccb
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] Install absl headers. Exclude duplicated.
MyungJoo Ham [Thu, 11 Jul 2019 03:33:45 +0000 (12:33 +0900)]
[Dist] Install absl headers. Exclude duplicated.

TF headers require ABSL headers. Install them.
Exclude duplicated hedares of tf-lite from tf's devel.

Change-Id: I7e4a255383484e886857d2d2e33250cf7f5f42f9
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoCMake Fix for GRPC Shared Build
MyungJoo Ham [Wed, 10 Jul 2019 13:06:57 +0000 (22:06 +0900)]
CMake Fix for GRPC Shared Build

It has other .pc files

Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoWIP: Fix cmake errors at ld step.
MyungJoo Ham [Wed, 10 Jul 2019 11:37:36 +0000 (20:37 +0900)]
WIP: Fix cmake errors at ld step.

Change-Id: Ic1fa92de1cd31d0a06e707042988c277dd69e2df
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoWIP
MyungJoo Ham [Wed, 10 Jul 2019 11:26:17 +0000 (20:26 +0900)]
WIP

Change-Id: Ia9fc23681c675f59a18a6d3309db88a5750d5641
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist/Debian] Add build-deps, use systemlibs.
MyungJoo Ham [Wed, 10 Jul 2019 10:27:39 +0000 (19:27 +0900)]
[Dist/Debian] Add build-deps, use systemlibs.

Apply changes from Tizen build

Change-Id: I7c05a236d0c4a593ad105b3b39db08ab4dc509d4
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] use Tizen's zlib, protobuf, grpc
MyungJoo Ham [Wed, 10 Jul 2019 02:10:49 +0000 (11:10 +0900)]
[Dist] use Tizen's zlib, protobuf, grpc

Let's use the system's protobuf, grpc, and zlib.
And do not export headers of protobuf from tensorflow.

Change-Id: I6ad41fd1a15b6d2651a94f5a098114000520f456
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[CMake] Allow to use pre-installed protobuf
MyungJoo Ham [Wed, 10 Jul 2019 02:07:38 +0000 (11:07 +0900)]
[CMake] Allow to use pre-installed protobuf

If the system already has protobuf, let's use it without
downloading one.

Change-Id: Iaa2e722f0a5e4170422d66579f56be29dee01249
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Pkgconf] Fix nnstreamer-tensorflow build error
MyungJoo Ham [Wed, 10 Jul 2019 00:48:22 +0000 (09:48 +0900)]
[Pkgconf] Fix nnstreamer-tensorflow build error

Let it refer to /usr/include/tensorflow.

Change-Id: I3a4f691cf2a059e4483b8e374125f00b31bd6834
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoCmake/external/png fix install path inconsistency
MyungJoo Ham [Wed, 10 Jul 2019 00:32:11 +0000 (09:32 +0900)]
Cmake/external/png fix install path inconsistency

use the same path for lib install paths

Change-Id: I4fc42af2745c9e3eaeaf628c34b005d686268184
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist/Debian] Enable 1.13 for debian build
MyungJoo Ham [Tue, 9 Jul 2019 10:16:47 +0000 (19:16 +0900)]
[Dist/Debian] Enable 1.13 for debian build

WIP

Change-Id: Ieed6c60cd957d42a5a1229eabe1ea255e9c400fd
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] Update pkgconfig data
MyungJoo Ham [Tue, 9 Jul 2019 09:17:40 +0000 (18:17 +0900)]
[Dist] Update pkgconfig data

Fix pkgconfig data for tensorflow dev users.

Change-Id: I05718d5a733e2628a330a1226df6c74ecaf5b406
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] Tf-lite devel package update
MyungJoo Ham [Tue, 9 Jul 2019 07:30:26 +0000 (16:30 +0900)]
[Dist] Tf-lite devel package update

Fix build errors of nnstreamer/tizen

Change-Id: If561a7b720f874286f3ac4bb52edc04aaa54ae61
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[DIST] Rewrite install scripts for 1.13
MyungJoo Ham [Tue, 9 Jul 2019 06:29:47 +0000 (15:29 +0900)]
[DIST] Rewrite install scripts for 1.13

Tf-lite install checked with i586

Fixes for TF w/ other arch will follow

Change-Id: I1fe831c63373d4bd669dac59231ab0bddd3c52a4
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoFix tensorflow-lite build
MyungJoo Ham [Tue, 9 Jul 2019 01:19:05 +0000 (10:19 +0900)]
Fix tensorflow-lite build

GBS successfully builds tensorflow-lite with this commit

Next TODO: rewrite install scripts for packaging

Change-Id: I3232d291a22ee47892f0a1396422420912da3f14
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] enable i586.
MyungJoo Ham [Mon, 8 Jul 2019 12:14:45 +0000 (21:14 +0900)]
[Dist] enable i586.

TODO: Find out tf-lite only build for 1.13

Change-Id: If751ffc3e2ab1bd1a974506d1c05692385d64b5c
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] remove find -delete, which is no more necessary
MyungJoo Ham [Mon, 8 Jul 2019 11:59:57 +0000 (20:59 +0900)]
[Dist] remove find -delete, which is no more necessary

Change-Id: Iba76d3344c75333fda42b8c84cd04d6e9996adcf
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] Fix libpng link error
MyungJoo Ham [Mon, 8 Jul 2019 11:49:19 +0000 (20:49 +0900)]
[Dist] Fix libpng link error

Fix error with 64bit systems:
[ 1088s] make[2]: *** No rule to make target 'png/install/lib64/libpng16.a', needed by 'proto_text'.  Stop.

Change-Id: Iaff40bd2819b3395939c9601da3cee2190d0e2a3
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoArchive clean up & dep update
MyungJoo Ham [Mon, 8 Jul 2019 11:17:50 +0000 (20:17 +0900)]
Archive clean up & dep update

OPENSSL should not be required; but due to tensorflow
bug (build-related), it still requires openssl/rsa.h

Change-Id: I68a4c808c2c415100498856f2f421d2c09a6d06c
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoCMake: clean up archive files with cmake
MyungJoo Ham [Mon, 8 Jul 2019 10:52:51 +0000 (19:52 +0900)]
CMake: clean up archive files with cmake

There are dirty cmake caches in archives.
Clean them up.

Change-Id: Iafdbe246499afc4e75f920c43a4eaa60e044c91b
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoArchive Update with make clean, removed eigen patch.
MyungJoo Ham [Mon, 8 Jul 2019 10:46:46 +0000 (19:46 +0900)]
Archive Update with make clean, removed eigen patch.

1. Eigen is pre-patched.
2. Archives cleaned up (WIP)

Change-Id: I99d85304957b13250c7ac6b56bedfd130d7f05e7
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoWIP. Experimenting with GBS
MyungJoo Ham [Fri, 28 Jun 2019 13:47:49 +0000 (22:47 +0900)]
WIP. Experimenting with GBS

Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] Added build-dependency on ICU
MyungJoo Ham [Fri, 28 Jun 2019 08:09:20 +0000 (17:09 +0900)]
[Dist] Added build-dependency on ICU

Tensorflow uses ICU for unicode processing.

Change-Id: I3746811b7a3c25205cdcb172055e42fabb09fee7
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoAdded cmake dependency
MyungJoo Ham [Fri, 28 Jun 2019 07:39:19 +0000 (16:39 +0900)]
Added cmake dependency

There was a missing dependency that incurs
build errors stochastically.

tensorflow/core/grappler/optimizers/data/vectorization/cwise_op_vectorizer.cc:18:10: fatal error: tensorflow/cc/ops/array_ops.h: No such file or directory

Change-Id: I91b5923a90aab8080ea9cd559eb66e7c0b62f414
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] Added archive files for tensorflow static build
MyungJoo Ham [Fri, 28 Jun 2019 07:36:05 +0000 (16:36 +0900)]
[Dist] Added archive files for tensorflow static build

Tensorflow still does the primitive and PITA of
downloading all external library source codes
and embeded them statically.

As we don't intend to refactor the whole build
structure of tensorflow, we added the archives.

Change-Id: I7cddfa8bf8b1d191b24ac13554b94ed44ef978f7
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoCMake Build Fixed. It Works!
MyungJoo Ham [Fri, 28 Jun 2019 06:43:10 +0000 (15:43 +0900)]
CMake Build Fixed. It Works!

CMake build success with network support

How to do:
$ pushd build
$ cmake ../tensorflow/contrib/cmake  -Dtensorflow_ENABLE_SSL_SUPPORT=OFF -Deigen_PATCH_FILE=/source/tizen/tensorflow/packaging/eigen.patch; make -j4

TODO
- Archive downloaded packages for GBS
- Package binary files properly
- Code clean and reformulate commits

Change-Id: I1f8d175f0b5518701e1e8c22077f2318e6c6ec58
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoCMake Dependency fix
MyungJoo Ham [Thu, 27 Jun 2019 12:30:32 +0000 (21:30 +0900)]
CMake Dependency fix

Add array_ops dependency, which was missing
Removed a duplicated file inclusion, creating build errors.

Change-Id: I5c7de3d69d1c9d7fd1056f8c170344b42f4b8426
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoLet CMake Load ICU
MyungJoo Ham [Thu, 27 Jun 2019 12:29:07 +0000 (21:29 +0900)]
Let CMake Load ICU

ICU is required by unicode-related codes

Change-Id: Ib01def46bb8318563be0fbfe6d84601f42db369c
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoEigen fix 2
MyungJoo Ham [Thu, 27 Jun 2019 12:28:18 +0000 (21:28 +0900)]
Eigen fix 2

use
build$ cmake ../tensorflow/contrib/cmake  -Dtensorflow_ENABLE_SSL_SUPPORT=OFF -Deigen_PATCH_FILE=${ABSOLUTEPATH}/packaging/eigen.patch

Change-Id: I5e56260e9318f14df72009365b18d9a9870f8f6c
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoUpdate Eigen Fix for Reusability
MyungJoo Ham [Thu, 27 Jun 2019 04:04:47 +0000 (13:04 +0900)]
Update Eigen Fix for Reusability

use
build$ cmake ../tensorflow/contrib/cmake  -Dtensorflow_ENABLE_SSL_SUPPORT=OFF -Deigen_PATCH_FILE=../packaging/eigen.patch

Change-Id: Iaab17b57a3af1737173c306a5351c5972e20450d
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoWIP: Fix Eigen Errors
MyungJoo Ham [Wed, 26 Jun 2019 10:19:06 +0000 (19:19 +0900)]
WIP: Fix Eigen Errors

Apply https://bitbucket.org/eigen/eigen/commits/88fc23324517/

Change-Id: I7ca808e5f91ed7e65d9c1a7d80cb943002c6d682
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoWIP: ABSL Error and Array_ops Error Fixed
MyungJoo Ham [Wed, 26 Jun 2019 09:17:17 +0000 (18:17 +0900)]
WIP: ABSL Error and Array_ops Error Fixed

Change-Id: I0e94da6128d841ca9c86cbbf264006cc2cb7035f
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoWIP2 Fixingup ABSL
MyungJoo Ham [Tue, 18 Jun 2019 09:11:02 +0000 (18:11 +0900)]
WIP2 Fixingup ABSL

Change-Id: Icb539d8789ee87f426e544a248a6ab21d3b1f927
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoWIP
MyungJoo Ham [Tue, 18 Jun 2019 04:11:50 +0000 (13:11 +0900)]
WIP

Change-Id: Ifad90cf9964e63277c57fa9c2fd27c4eab17f4e6
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years ago[Dist] Rebased porting patches for 1.13.1
MyungJoo Ham [Tue, 11 Jun 2019 12:14:15 +0000 (21:14 +0900)]
[Dist] Rebased porting patches for 1.13.1

Selectively rebased and merged.

Change-Id: I77ac6ece2f9496adfa99b6dafa6d3489b828cf93
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
5 years agoImported Upstream version 1.13.1 upstream/1.13.1 upstream/v1.13.1
MyungJoo Ham [Tue, 11 Jun 2019 11:53:48 +0000 (20:53 +0900)]
Imported Upstream version 1.13.1

5 years agoImported Upstream version 1.12.0 upstream/1.12.0
MyungJoo Ham [Tue, 11 Jun 2019 11:49:57 +0000 (20:49 +0900)]
Imported Upstream version 1.12.0

5 years agoImported Upstream version 1.9.0 upstream/1.9.0
MyungJoo Ham [Tue, 11 Jun 2019 11:44:19 +0000 (20:44 +0900)]
Imported Upstream version 1.9.0

6 years agoMerge pull request #20455 from lygztq/r1.9 upstream/v1.9.0
Michael Case [Mon, 9 Jul 2018 20:38:25 +0000 (13:38 -0700)]
Merge pull request #20455 from lygztq/r1.9

fix bug in maxout function

6 years agoMerge branch 'r1.9' into r1.9
Amit Patankar [Fri, 6 Jul 2018 20:11:25 +0000 (13:11 -0700)]
Merge branch 'r1.9' into r1.9

6 years agoMerge pull request #20593 from av8ramit/update_version_final
Gunhan Gulsoy [Fri, 6 Jul 2018 20:10:16 +0000 (13:10 -0700)]
Merge pull request #20593 from av8ramit/update_version_final

Updating the version to 1.9.0 official.

6 years agoMerge branch 'r1.9' into update_version_final
Amit Patankar [Fri, 6 Jul 2018 18:39:59 +0000 (11:39 -0700)]
Merge branch 'r1.9' into update_version_final

6 years agoMerge pull request #20596 from av8ramit/cp_disable_gcp
Gunhan Gulsoy [Fri, 6 Jul 2018 17:35:12 +0000 (10:35 -0700)]
Merge pull request #20596 from av8ramit/cp_disable_gcp

Remove unused gcp and hdfs config flags, as these are on by default now.

6 years agoRemove unused gcp and hdfs config flags, as these are on by default now.
Gunhan Gulsoy [Sat, 30 Jun 2018 05:43:22 +0000 (22:43 -0700)]
Remove unused gcp and hdfs config flags, as these are on by default now.

PiperOrigin-RevId: 202753310

6 years agoMerge pull request #20535 from lamberta/r1.9-cherrypick-docs-no-merge
Gunhan Gulsoy [Fri, 6 Jul 2018 16:41:21 +0000 (09:41 -0700)]
Merge pull request #20535 from lamberta/r1.9-cherrypick-docs-no-merge

r1.9-cherry-pick-request: Docs updates for tutorials, guides, and notebooks

6 years agoMerge branch 'r1.9' into r1.9
Gunhan Gulsoy [Fri, 6 Jul 2018 16:32:55 +0000 (09:32 -0700)]
Merge branch 'r1.9' into r1.9

6 years agoUpdating the version to 1.9.0 official.
Amit Patankar [Fri, 6 Jul 2018 16:27:31 +0000 (09:27 -0700)]
Updating the version to 1.9.0 official.

6 years agofix rc2
Billy Lamberta [Tue, 3 Jul 2018 23:56:01 +0000 (16:56 -0700)]
fix rc2

6 years agoUpdate docs_src in 1.9 to match master
Billy Lamberta [Tue, 3 Jul 2018 23:40:14 +0000 (16:40 -0700)]
Update docs_src in 1.9 to match master

6 years agoUpdate eager notebooks in 1.9 to match master
Billy Lamberta [Tue, 3 Jul 2018 23:17:58 +0000 (16:17 -0700)]
Update eager notebooks in 1.9 to match master

6 years agoMerge pull request #20437 from bhack/patch-1
Amit Patankar [Tue, 3 Jul 2018 18:36:14 +0000 (11:36 -0700)]
Merge pull request #20437 from bhack/patch-1

Advise batch_normalization with model_to_estimator

6 years agoMerge pull request #20489 from tensorflow/yifeif-patch-2
Gunhan Gulsoy [Tue, 3 Jul 2018 05:39:06 +0000 (22:39 -0700)]
Merge pull request #20489 from tensorflow/yifeif-patch-2

Match for -path instead of -name

6 years agoMatch for path instead of name
Yifei Feng [Tue, 3 Jul 2018 00:10:20 +0000 (17:10 -0700)]
Match for path instead of name

6 years agofix bug in maxout function
张天启 [Sun, 1 Jul 2018 14:05:51 +0000 (22:05 +0800)]
fix bug in maxout function

The line "shape[axis] = -1" will make the shape wrong when dealing with batches with arbitrary sizes.

6 years agoAdvise batch_normalization with model_to_estimator
bhack [Sat, 30 Jun 2018 12:54:43 +0000 (14:54 +0200)]
Advise batch_normalization with model_to_estimator

6 years agoExclude test sources from stream executor builds. (#20423)
Michael Case [Fri, 29 Jun 2018 17:19:06 +0000 (10:19 -0700)]
Exclude test sources from stream executor builds. (#20423)

PiperOrigin-RevId: 202423156

6 years agoMerge pull request #20390 from case540/eigen_pip_cherry_pick
Michael Case [Thu, 28 Jun 2018 21:42:25 +0000 (14:42 -0700)]
Merge pull request #20390 from case540/eigen_pip_cherry_pick

Fix install location for Eigen headers in pip build.

6 years agoPotential fix for how pip installs headers used for custom ops.
Michael Case [Thu, 28 Jun 2018 18:24:37 +0000 (11:24 -0700)]
Potential fix for how pip installs headers used for custom ops.

These headers were recently moved from site-packages/external into
site-packages/tensorflow/include/external. Need to update setup.py
to reflect that.

6 years agoMerge pull request #20351 from case540/update_version_19_rc2
Michael Case [Wed, 27 Jun 2018 17:00:59 +0000 (10:00 -0700)]
Merge pull request #20351 from case540/update_version_19_rc2

Update version strings for TF 1.9.0-rc2.

6 years agoMerge pull request #20324 from lamberta/r1.9-cherrypicks
Michael Case [Wed, 27 Jun 2018 16:50:35 +0000 (09:50 -0700)]
Merge pull request #20324 from lamberta/r1.9-cherrypicks

1.9-cherry-pick-request: Doc updates for get_started page and nav

6 years agoUpdate version strings for TF 1.9.0-rc2.
Michael Case [Wed, 27 Jun 2018 16:46:45 +0000 (09:46 -0700)]
Update version strings for TF 1.9.0-rc2.

6 years agoFix checkpoints link in keras guide
Billy Lamberta [Wed, 27 Jun 2018 04:34:07 +0000 (21:34 -0700)]
Fix checkpoints link in keras guide

6 years agoMerge branch 'r1.9' into r1.9-cherrypicks
Billy Lamberta [Wed, 27 Jun 2018 04:06:52 +0000 (21:06 -0700)]
Merge branch 'r1.9' into r1.9-cherrypicks

6 years agoMerge pull request #20323 from case540/statusor_fix
Michael Case [Wed, 27 Jun 2018 02:31:21 +0000 (19:31 -0700)]
Merge pull request #20323 from case540/statusor_fix

Fix XLA header issue for pip build.

6 years agoMerge pull request #20235 from rmlarsen/cherrypicks_5M8WT
Michael Case [Tue, 26 Jun 2018 23:32:39 +0000 (16:32 -0700)]
Merge pull request #20235 from rmlarsen/cherrypicks_5M8WT

Update Eigen version to commit e5e305a158a029f5b5f837bf821411a51439a970.

6 years agoFix leftnav for get_started
Billy Lamberta [Tue, 26 Jun 2018 21:56:57 +0000 (14:56 -0700)]
Fix leftnav for get_started

6 years agoRemove section links that don't go anywhere.
Billy Lamberta [Tue, 26 Jun 2018 18:24:37 +0000 (11:24 -0700)]
Remove section links that don't go anywhere.

6 years agoMerge branch 'r1.9' into cherrypicks_5M8WT
Gunhan Gulsoy [Tue, 26 Jun 2018 22:30:00 +0000 (15:30 -0700)]
Merge branch 'r1.9' into cherrypicks_5M8WT

6 years agoUpdate eigen version to a fixed version for ppc64.
Gunhan Gulsoy [Tue, 26 Jun 2018 22:29:48 +0000 (15:29 -0700)]
Update eigen version to a fixed version for ppc64.

6 years agoFix small typo in RELEASE.md
Michael Case [Tue, 26 Jun 2018 22:07:23 +0000 (15:07 -0700)]
Fix small typo in RELEASE.md

6 years agoMoving StatusOr from XLA to stream_executor.
Michael Case [Tue, 26 Jun 2018 20:05:25 +0000 (13:05 -0700)]
Moving StatusOr from XLA to stream_executor.

PiperOrigin-RevId: 202179928

6 years agoMerge pull request #20310 from petewarden/r1.9
Michael Case [Tue, 26 Jun 2018 17:48:55 +0000 (10:48 -0700)]
Merge pull request #20310 from petewarden/r1.9

 r1.9-rc2 cherry-pick request: Fix for RPi OpenBLAS compile issues, by pinning to known good version

6 years agoMerge pull request #20290 from lamberta/r1.9-cherrypicks
Michael Case [Tue, 26 Jun 2018 16:56:52 +0000 (09:56 -0700)]
Merge pull request #20290 from lamberta/r1.9-cherrypicks

1.9-cherry-pick-request: Docs updates for getting started and guide rename

6 years agoRemoved Python 3.5 updates for RPi
Pete Warden [Tue, 26 Jun 2018 16:36:22 +0000 (09:36 -0700)]
Removed Python 3.5 updates for RPi