Narumol Prangnawarat [Fri, 29 Jan 2021 15:38:54 +0000 (15:38 +0000)]
IVGCVSW-5619 Enable OptimizerOptions for the python external delegate
* Add reduce-fp32-to-fp16, reduce-fp32-to-bf16, debug-data, memory-import
options to external delegate
* Simplify DelegateOptions
* Add test mock models
* Unit tests
* Configure lfs to manage tflite files
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I1e4db468862ba03d4cb031347bc307cf940b3cb1
Nikhil Raj [Tue, 2 Feb 2021 10:07:29 +0000 (10:07 +0000)]
Update ACL pin to
ea857273d8b4a94fb7f1e63ce9068a60259fb9d3
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Id43ff3eb59f8c93cfe9fc4bcd76b8496512e2859
Jan Eilers [Fri, 29 Jan 2021 09:50:36 +0000 (09:50 +0000)]
IVGCVSW-5605 Doxygen: Add PyArmNN to Doxygen docu
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I43082950c55375f62ecd30236d1c475e4ca89faf
Jan Eilers [Thu, 28 Jan 2021 16:00:00 +0000 (16:00 +0000)]
IVGCVSW-5605 Doxygen: Move "OtherTools" to "Software Tools"
* Uses README.md files to reduce duplications
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I2cfcb6cf02ac712656cb8c782c70d002df642b97
Jan Eilers [Thu, 28 Jan 2021 15:38:09 +0000 (15:38 +0000)]
IVGCVSW-5605 Doxygen: Move Converter and Quantizer to Software Tools
* Using README.md files directly to reduce duplications
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I6bd6f6326e608939ac244cc32b329e32bb4802f7
Jan Eilers [Thu, 28 Jan 2021 14:45:09 +0000 (14:45 +0000)]
IVGCVSW-5605 Doxygen: Move Serializer and Deserializer to Software Tools
* Not using the README.md files directly because it doesn't seem to
be possible to get the content of readme.md combined with the content
of the support.md files in one page
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I1e5073761f3af8a8d498385f3f7586334e7b29ec
Jan Eilers [Thu, 28 Jan 2021 09:13:24 +0000 (09:13 +0000)]
IVGCVSW-5605 Doxygen: Integrate parsers into Software Tools section
* Creates new section in doxygen called "Software Tools"
* Moves the Parser page into Software Tools
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I19643074226d7c2e73e560e3abb52f519af1a7b2
Jan Eilers [Wed, 27 Jan 2021 20:04:41 +0000 (20:04 +0000)]
IVGCVSW-5605 Doxygen: Use readme.md as mainpage in doxygen
* Gives the readme file an update
* Removes introduction.dox
* Adds FAQ to doxygen
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: Ibb67e7f2cac7e55556295eb7851c616561b17042
Finn Williams [Tue, 26 Jan 2021 22:30:06 +0000 (22:30 +0000)]
IVGCVSW-5593 Implement Pimpl Idiom for serialization classes
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I01c7bd314219e58f71505dcb787d606dbded914a
Keith Davis [Sun, 31 Jan 2021 18:36:58 +0000 (18:36 +0000)]
IVGCVSW-5374 Provide Android Build for Delegate
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: Ie8c03153f82434d73572278eedb8a4b5b89ed837
Matthew Sloyan [Mon, 18 Jan 2021 16:10:20 +0000 (16:10 +0000)]
IVGCVSW-5484 Add Network loading time to InferenceModel
* Added output log to capture time taken to load network into runtime.
* This time is cut down when loading a cached network.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I043c177f17d01df35fbe0752ec5d77e350749164
Francis Murtagh [Thu, 28 Jan 2021 14:25:15 +0000 (14:25 +0000)]
IVGCVSW-4874 Provide LayerSupportHandle to frontend users
* Add test for new IsBackendRegistered member function of Handle
* Move deprecated messages to new frontend API of LayerSupportHandle
* Update delegate to use dot operator for IsXXXLayerSupported
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: I70d7166e207a10e4b3583a827ca0dda2169bcba1
!android-nn-driver:4940
Keith Davis [Wed, 27 Jan 2021 13:12:03 +0000 (13:12 +0000)]
IVGCVSW-5374 Provide Android Build for Delegate
* Remove double brackets for scalars
* Add in extra location in cmake for tf lite dynamic library
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I31ef9a955d4677faabedc0068ae2cfbfe570b58c
Nikhil Raj [Thu, 28 Jan 2021 10:14:35 +0000 (10:14 +0000)]
Update ACL pin to
4cfab1886549d7582e3867c51278132e5d37681b
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ica17c75dfab52d9b8fada56658b95794d4e58536
Jim Flynn [Thu, 28 Jan 2021 07:01:35 +0000 (07:01 +0000)]
Remove incorrect use of std::vector.reserve
Change-Id: Ic45d4c837eaad8b9f19288d4f3b6e8caa3eaf319
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Sadik Armagan [Wed, 20 Jan 2021 17:48:07 +0000 (17:48 +0000)]
IVGCVSW-5391 'ArmNN TfLiteDelegate: Implement the Space/Depth operators'
* Added DEPTH_TO_SPACE and SPACE_TO_DEPTH operators support
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I2595f759181bd7339127e7b114b850b534210dd5
Sadik Armagan [Fri, 22 Jan 2021 10:53:38 +0000 (10:53 +0000)]
IVGCVSW-5390 'TfLiteDelegate: Implement the Normalisation operators'
* Added L2_NORMALIZATION and LOCAL_RESPONSE_NORMALIZATION opertor support
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Ic9e66879cf6469fa8761fb1c9dd5950771f629b0
Narumol Prangnawarat [Wed, 20 Jan 2021 15:58:29 +0000 (15:58 +0000)]
IVGCVSW-5619 Add OptimizerOptions and NetworkProperties to ArmNN Delegate
* Add OptimizerOptions, NetworkProperties, DebugCallbackFunction
to DelegateOptions
* Enable OptimizerOptions when the network is being optimized
* Enable NetworkProperties when loading network
* Enable DebugCallbackFunction
* Add error message when loading network
* Log warning instead of error when operator is not supported but
could fallback to another backend
* Improve uint16_t CompareData
* Unit tests
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I353035afb442774bfeb1c62570a90755c2ceaf38
Nikhil Raj [Fri, 22 Jan 2021 10:02:38 +0000 (10:02 +0000)]
Update ACL pin to
6a4ebe1305b544aec1ba0bfc67ed65d94fcc8c2e
* Pass in new window parameter to the schedule_op function
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I8579d2d6e55ab9888471bd780628df0f73438498
Francis Murtagh [Mon, 25 Jan 2021 10:18:10 +0000 (10:18 +0000)]
IVGCVSW-5525 Handle Neon optionality on 32 bit linux platforms
* Add neon detection for linux using HWCAPs
* Add test to check for backend throwing BackendUnavailable exception
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: Ib74aeb06abe5f88f21ecdd1edb2a1cd20ee2019d
Sadik Armagan [Fri, 22 Jan 2021 14:25:31 +0000 (14:25 +0000)]
MLCE-335 'DEPTH_TO_SPACE and GATHER operator support in TfLiteParser'
* Added GATHER operator support to TfLiteParser
* Added DEPTH_TO_SPACE operator support to TfLiteParser
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Id5d3b54e2d850eb9f19417029efbeb73a3029e69
Jan Eilers [Tue, 15 Dec 2020 10:42:38 +0000 (10:42 +0000)]
IVGCVSW-5571 Expose the TfLite Delegate to the TfLite python API
* Implemented external delegate adaptor interface for TfLite
* Activated armnn logging for delegate
* Added logging info to indicate if gpu tuning is turned on
* Added pytests to ensure functionality of the external delegate adaptor
* Included the delegate directory into doxygen
* Added documentation on how to use the external delegate in python
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: Id3b4588fb0b9ac7e3f47ba2c19feead7beb58e18
Teresa Charlin [Mon, 18 Jan 2021 18:07:57 +0000 (18:07 +0000)]
IVGCVSW-5616 Don't fuse activation if quantization parameters are different
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I6504e922113aa9e397f53e570ebcf47e1f133945
Sadik Armagan [Wed, 20 Jan 2021 12:17:00 +0000 (12:17 +0000)]
MLCE-336 'TfLite parser and ExecuteNetwork issues'
* Report the error thrown
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: If5e5160f43c11a284b919d76b04d9c4d53e9c56c
Sadik Armagan [Tue, 19 Jan 2021 17:24:21 +0000 (17:24 +0000)]
IVGCVSW-5399 'TfLiteDelegate: Implement the ArgMinMax operators'
* Added ARG_MIN and ARG_MAX support to armnn_delegate
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Ia000c4b64378e28320164edd4df2902ca13dcda6
Sadik Armagan [Wed, 13 Jan 2021 15:06:38 +0000 (15:06 +0000)]
IVGCVSW-4417 'Serialise ArmNN Model on android-nn-driver'
* Added generated schema file to the source tree
* Updated the ANdroid.mk file to pick up the Serializer/Deserializer source
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I12c2bf2ae7aa12374c60e671ff3a97eac5b7f161
Matthew Sloyan [Tue, 12 Jan 2021 16:19:43 +0000 (16:19 +0000)]
IVGCVSW-5644 Add documentation for cache loaded network
* Added ModelOptions documentation to CLBackendModelContext
* Improved options descriptions in ExecuteNetworkProgramOptions.cpp
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I14f0c8bb4f299809b89f49c616b691e2f7956d5b
Nikhil Raj [Tue, 12 Jan 2021 14:29:18 +0000 (14:29 +0000)]
Renaming NEActivationLayerKernel to CpuActivationKernel
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I33dc1127627b4b89c02a3bea246eaf7499e5a780
David Monahan [Tue, 12 Jan 2021 09:11:07 +0000 (09:11 +0000)]
IVGCVSW-5424 TFLite parser not parsing new TransposeConv
* Added support for bias vector in TransposeConv to TfLite parser
* Added UnitTest
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I6483986a9da9216084b4b885b7fd980fc3580fa9
Mike Kelly [Thu, 14 Jan 2021 10:04:56 +0000 (10:04 +0000)]
MLCE-325 ArmnnQuantizer incorrectly Quantizes all DataTypes
* ArmnnQuantizer incorrectly converts boolean or integer DataTypes to quantized
DataTypes. This breaks layers like ArgMinMax where the output contains the
index of an element along an axis.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I272c3d0f48bf884a2480bfa43eb14ec265fcda6b
Sadik Armagan [Thu, 14 Jan 2021 09:32:00 +0000 (09:32 +0000)]
IVGCVSW-5634 'GitHub Contributor Guide Issue'
* Fixed the ContributorGuide display issue
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I7be39cda5682a220dbd3708692230ab7421f80e0
Keith Mok [Mon, 21 Dec 2020 22:28:47 +0000 (14:28 -0800)]
Fix build breaks on file insensitive system
Current we use 'A'rmNNQuantizer name for executable
and 'a'rmNNQuantizer as library name.
Since cmake does not allow same name for executable and library.
The old way is to use a captial letter for the executable name.
But it will create a problem on system (like macosx) that the file
system is case insensitive by default. Since it will create/overwritten
file on the same folder during the cmake build which makes build failed
when BUILD_ARMNN_QUANTIZER is enabled.
Fixed this by using ArmNNQuantizerMain as the executable
name during build, then rename it back to ArmNNQuantizer using
set_target_property OUTPUT_NAME function.
Signed-off-by: Keith Mok <ek9852@gmail.com>
Change-Id: I3e0779770c851c0eb6804e300a24836be955d07a
Matthew Sloyan [Wed, 13 Jan 2021 14:30:19 +0000 (14:30 +0000)]
IVGCVSW-5483 Fix cache loaded network nightly failure
* Fixed issue where nightly job couldn't find flatbuffers import.
* Removed unnecessary commented code.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: If201f3fe54bf3bdd167aaf5d108154165d2a910d
Narumol Prangnawarat [Fri, 18 Dec 2020 16:13:06 +0000 (16:13 +0000)]
IVGCVSW-5625 Add support for Float16 to Delegate
* Float16 unit tests for Reshape
* Remove unsupported data type from Pad
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ib1804bb6e708a0552fb40d05fe8a6511936f9793
Francis Murtagh [Tue, 12 Jan 2021 11:51:09 +0000 (11:51 +0000)]
IVGCVSW-5552 Generalize versions for Debian Packaging installation guide
* Remove need to update the guide for each release
by allowing user to check for newest version
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: Ic6dda46524916762a06f24444bd7368ff1cde159
Francis Murtagh [Tue, 5 Jan 2021 14:42:00 +0000 (14:42 +0000)]
IVGCVSW-5630 Unittest failure on mipsel/s390x/ppc64/powerpc
* Use ECONNREFUSED #define instead for connection refused error no.
* As error code on mips for example is 146
Change-Id: I2c725dc93ab8951d4f42a3ba51e747e01ced3a68
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Matthew Sloyan [Fri, 8 Jan 2021 10:30:51 +0000 (10:30 +0000)]
IVGCVSW-5484 Add CacheLoadedNetwork options to ExecuteNetwork
* Enable ability to save/load ClContext in ExecuteNetwork.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I58c61a53f6713853eb06520cc372ed47baf7f8c4
Matthew Sloyan [Thu, 7 Jan 2021 13:28:47 +0000 (13:28 +0000)]
IVGCVSW-5483 'Implement Loading and Saving to File'
* Implemented Serialization and Deserialization of CLContext.
* Fixed flatbuffers android-nn-driver dependency.
!android-nn-driver:4772
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: If806f050535ffaa70922ba0f1ffe7bb10f902329
Keith Mok [Sun, 20 Dec 2020 08:05:14 +0000 (00:05 -0800)]
Fix mac build breaks
Signed-off-by: Keith Mok <ek9852@gmail.com>
Change-Id: I4b2926342bbf8621f7b7f5695cf1526dd7281bef
Keith Mok [Tue, 22 Dec 2020 01:06:57 +0000 (17:06 -0800)]
Fix build breaks for armnnDeserializer test
On macosx, the section rodata syntax is a
little bit different, add ifdef __MACH__
to fix that.
Signed-off-by: Keith Mok <ek9852@gmail.com>
Change-Id: Ic11d6faf8b8d3f3b521fd4305e6cdc3562a1c8ae
Nikhil Raj [Wed, 6 Jan 2021 16:22:13 +0000 (16:22 +0000)]
Update ACL pin to
b309fc249e4383b4d40ae03e377c3cbad3f9f5f7
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I10e46b3c4b7d69bcb742014cb2633cfc061eb718
Keith Mok [Mon, 21 Dec 2020 03:47:25 +0000 (19:47 -0800)]
Add argmax deconv support for caffe parser
armnn support argmax and deconv , but caffe parser does not.
Add back this feature.
Signed-off-by: Keith Mok <ek9852@gmail.com>
Change-Id: I6b99cc4b58491204c41c6e1d11f583c65c628ee4
Keith Mok [Sun, 20 Dec 2020 21:45:51 +0000 (13:45 -0800)]
Add Caffe Parser Dilation support
Signed-off-by: Keith Mok <ek9852@gmail.com>
Change-Id: I3a85de2d082d489fbf5a775c2ae551080d189294
Teresa Charlin [Mon, 4 Jan 2021 17:17:02 +0000 (17:17 +0000)]
adding BOOST_TEST to EnqueueWorkload in FuseActivation Unit Test
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I6a00045967fa48ec0913c8708ffc146a72ed2b87
Nikhil Raj [Tue, 5 Jan 2021 16:30:43 +0000 (16:30 +0000)]
Update ACL pin to
97b3f11a1655c05bedaf378f85f94cdccb1536ba
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ie4fd3fe2671050537eb0ab85032922f6464c9d24
Nikhil Raj [Fri, 18 Dec 2020 15:00:17 +0000 (15:00 +0000)]
Update ACL pin to
b6869dda4a5bf233df009eaac15cf0c220b653f2
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I1422eab2beb3d59841f827b60d822f987e08f326
Narumol Prangnawarat [Thu, 17 Dec 2020 12:17:58 +0000 (12:17 +0000)]
IVGCVSW-5383 TfLiteDelegate: Implement Pad and PadV2 operators
* Add Pad and PadV2 operators support to Armnn Delegate
* Add dimension check to CompareOutputData test utility
* Unit tests
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I9d00eb08f71e791498908fcbdb9de561e1c01aef
Finn Williams [Mon, 30 Nov 2020 17:43:28 +0000 (17:43 +0000)]
IVGCVSW-5374 Provide an Android build for the delegate
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I33eb8c650be654ad891afd2295f2057f13a9d084
David Monahan [Thu, 3 Dec 2020 11:09:46 +0000 (11:09 +0000)]
IVGCVSW-4625 Add CL Rank Workload
* Added CL implementation of Rank Workload
* Removed references to memcpy_s as it's a windows only function
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: Ia63666b9640d76a775f2ab98b3cd7e9f77b5a507
Nikhil Raj [Thu, 17 Dec 2020 11:01:53 +0000 (11:01 +0000)]
Update ACL pin to
462e75e217a11b92b8df8c3434f2491ef70487e3
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Icd92b46f7dcac091739e8a9b01e5c36bf16b0fcb
Matthew Sloyan [Wed, 16 Dec 2020 12:50:01 +0000 (12:50 +0000)]
IVGCVSW-5614 Enable Hard Swish and Elu activations
* Enabled Hard Swish and Elu in TfLiteDelegate
* Added support for Elu in TfLiteParser
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: If09321b58568a98e14cabce610a1586556da041e
Teresa Charlin [Mon, 30 Nov 2020 17:10:21 +0000 (17:10 +0000)]
IVGCVSW-5532 Adding UnitTest fusing activation
* QASymmS8 and BoundedReLU
* Float16 and ReLU in GpuAcc
* Remove layerName, not needed as 1 test per combination
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I930c7a04d8d904f370f1b40c62cf9311c172bbdf
Narumol Prangnawarat [Fri, 27 Nov 2020 16:57:56 +0000 (16:57 +0000)]
IVGCVSW-5595 Fix incorrect padding value for asymmetric quantized type
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I85f0c30757043f8c27c78d607f0f9dbbdd35b9fb
Nikhil Raj [Wed, 16 Dec 2020 10:50:35 +0000 (10:50 +0000)]
Update ACL pin to
4d9687e70e2d71097cd43929d5f63377c3c44523
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ib6d10096a5348f06d744c5629eb3b41f9c187059
Nikhil Raj [Tue, 15 Dec 2020 10:04:40 +0000 (10:04 +0000)]
Update ACL pin to
aa51a5ba9a3f05be08b94859b53c398edee5d2e3
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ifff69c7ddce967f7a084c26837685e84f680e78a
Matthew Sloyan [Mon, 14 Dec 2020 17:53:20 +0000 (17:53 +0000)]
Update ACL pin to
ec241b48ea7481e797285788fd68e5e1d42382bb
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I28b2eca636b5ca9156865871b60447707bfa8647
Derek Lamberti [Mon, 7 Dec 2020 13:54:12 +0000 (13:54 +0000)]
Sort subgraphview layers on construction
Make it easier for backends to traverse the subgraph during optimization
Change-Id: I140cb11f78bab5f19c801a5b55efffb38c63837f
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Nikhil Raj [Thu, 10 Dec 2020 10:07:46 +0000 (10:07 +0000)]
Update ACL pin to
ec2256b81e6d6f655dcfbc76683738fbfeb82bcc
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Idc5233a19a97a6feb42b6841e6aff9d793a88740
Derek Lamberti [Mon, 7 Dec 2020 13:56:40 +0000 (13:56 +0000)]
Default comparisons-files option to empty vector
Change-Id: Iecd8d9b333fa4456d081b4787c1a5b5d0b4a2b79
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Nikhil Raj [Wed, 9 Dec 2020 10:11:37 +0000 (10:11 +0000)]
Update ACL pin to
98e33b97b92c912f058bfb3295adad1bcad3e80f
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I3c51a9a16908af2b1bc9250ada31b8ca46307fff
James Ward [Wed, 2 Dec 2020 10:20:48 +0000 (10:20 +0000)]
IVGCVSW-5598 ArmNN Doxygen doc needs update
Signed-off-by: James Ward <james.ward@arm.com>
Change-Id: Iac19640fec7aabdfcbb88a0856d4fce3a15d3f27
Matthew Sloyan [Mon, 7 Dec 2020 13:33:24 +0000 (13:33 +0000)]
IVGCVSW-5560 Fix TfLiteDelegate Reshape operator failure
* Fixed issue when running certain models with 2D shape tensor.
* Falls back to inbuilt options if encountered.
* Fixed ExecuteNetwork so that error messages are logged if NULL.
* Updated TfLiteDelegate docs to include Logical Operators.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Signed-off-by: David Monahan <david.monahan@arm.com>
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I5dbaf30351f7fc86e6178a0caf46c152812088d3
James Conroy [Mon, 7 Dec 2020 16:59:03 +0000 (16:59 +0000)]
IVGCVSW-5500 Fix transpose conv InferOutputShape
* Use kernelShape[0] as channels for outputShape.
Signed-off-by: James Conroy <james.conroy@arm.com>
Change-Id: I070c7ff68ae365d9505a5eb28c76f9e52da1e5f9
Nina Drozd [Tue, 1 Dec 2020 11:56:12 +0000 (11:56 +0000)]
Pyarmnn fix - parsers are optional extensions
Signed-off-by: Nina Drozd <nina.drozd@arm.com>
Change-Id: Ic999cb898933fa674f1cd3b4b85ab650154d587d
Teresa Charlin [Mon, 7 Dec 2020 12:56:38 +0000 (12:56 +0000)]
Update ACL pin to
f7c5a41aebf8951ef783aa3d45f0bc4e98656e7b
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ic4c7df887d460fd695ffec822437e0c8a5095baf
Matthew Sloyan [Thu, 26 Nov 2020 10:54:22 +0000 (10:54 +0000)]
IVGCVSW-5381 TfLiteDelegate: Implement the Logical operators
* Implemented Logical AND, NOT and OR operators.
* NOT uses existing ElementwiseUnary VisitLayer function & tests.
* AND/OR uses new LogicalBinary VisitLayer function & tests.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I5e7f1e78b30c36ac7f14c70a712b54f98d664b83
David Monahan [Thu, 3 Dec 2020 09:48:06 +0000 (09:48 +0000)]
IVGCVSW-4626 Add Neon Rank Workload
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I5a85597e75d2b879ae234c6929686fabe99d7bc8
Nikhil Raj [Thu, 3 Dec 2020 11:01:03 +0000 (11:01 +0000)]
Update ACL pin to
96b16b65dd96351b8af1b2a785856ce13cc8ba84
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I2cafcbe087cb55e7252cbba2a7c8b649a98067e1
Nikhil Raj [Thu, 3 Dec 2020 11:25:34 +0000 (11:25 +0000)]
Update TF version in Cross compilation guide
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ic8efc05bfea3ac007aec03b0b6d3edd3a9e18819
Sadik Armagan [Wed, 2 Dec 2020 11:28:58 +0000 (11:28 +0000)]
IVGCVSW-5482 'Add a ClCompileContext parameter to each ClWorkload Constructor'
* Injected CLCompileContext object to each CL workload.
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I4837dbd3d5b56cf743b3b89c944e3cdf8b11a42a
Finn Williams [Wed, 25 Nov 2020 14:32:42 +0000 (14:32 +0000)]
IVGCVSW-5587 Remove Tensorflow requirement from Arm NN TfLite delegate
* Added support for building the delegate with an external armnn path
* Replaced potentially troublesome package manager
* Explicitly set the privacy levels of delegate libraries
* Fixed some error handling in ExecuteNetwork
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I2a7abc099796012cbb043c5b319f81778c9f3b56
Teresa Charlin [Thu, 26 Nov 2020 16:54:15 +0000 (16:54 +0000)]
IVGCVSW-5568 Revert "IVGCVSW-5563 Fix Crash on model with FullyConnected Sigmoid Activation"
* This reverts commit
be25d94aefe53f221304b1f5f344913b708f808b.
* Add Unit Test: any receiver layer + any activation layer in float and QAsymmU8
* Tidy up fuse activation tests
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ie059d03b85cd17eaaafe5188bb173672a1fb9ae0
Keith Davis [Thu, 26 Nov 2020 17:40:35 +0000 (17:40 +0000)]
IVGCVSW-5374 Provide Android Build for Delegate
* Fix Arm Android Compiler errors
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: If5fae0fda08b6102eb46217564a096f87a3b6740
Sadik Armagan [Fri, 27 Nov 2020 12:40:52 +0000 (12:40 +0000)]
IVGCVSW-5393 'TfLiteDelegate: Implement the split operators'
* Added SPLIT and SPLIT_V support to armnn_delegate
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I2def9b8be783b25ef17a997e521c6027553035d3
Teresa Charlin [Mon, 23 Nov 2020 17:27:48 +0000 (17:27 +0000)]
Update ACL pin to
ccff409625cbc721e5fc227b3617ebca01c9f47e
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ifb3369a18c0348dd0cf0c1ce975cc838da87742f
Jim Flynn [Wed, 25 Nov 2020 16:52:52 +0000 (16:52 +0000)]
IVGCVSW-5585 Add LICENSE file to third-party/stb lib
Change-Id: Ifacd03d322284df6a7fa9e4ce5121b16ae8bc99f
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Teresa Charlin [Tue, 24 Nov 2020 15:11:54 +0000 (15:11 +0000)]
IVGCVSW-5499 Missing validation for zero stride
* Convolution
* Depthwise Convolution
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I61b356fbffb176e9a05e08d9b6867d082b6712c8
Teresa Charlin [Wed, 25 Nov 2020 18:22:57 +0000 (18:22 +0000)]
IVGCVSW-5384 TfLiteDelegate: Implement the Gather operator
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Iaf2112363d2b191327711d8e083fee2a751c35c5
Teresa Charlin [Wed, 25 Nov 2020 18:34:51 +0000 (18:34 +0000)]
Bug fix TfLiteDelegate: wrong operator name in FullyConnected activation
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ic52b27d462f498314050576b5195f759f5f00c63
James Ward [Thu, 26 Nov 2020 09:35:49 +0000 (09:35 +0000)]
IVGCVSW-5348 Update Doxygen Docu
* update release version in Doxyfile
Signed-off-by: James Ward <james.ward@arm.com>
Change-Id: Iaaf06059eeba69b66b5ab211692a84c83ace9bb3
Jan Eilers [Wed, 25 Nov 2020 17:17:10 +0000 (17:17 +0000)]
IVGCVSW-5457 Add How-To documentation for the TfLite Delegate
* Add guide.md to the delegate directory
* Mentioned the guide in README.md
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: Iaa373ecf28f57f4d8383489fecf43670ae8ca190
Sadik Armagan [Thu, 26 Nov 2020 10:38:11 +0000 (10:38 +0000)]
IVGCVSW-5481 'Add ClCompileContext to ClWorkloadFactory'
* Introduced CLCompileContext to ClWorkloadFactory
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Ied38f4336210502e5f518b9955ae6a5ba3d242b3
Teresa Charlin [Thu, 26 Nov 2020 10:17:01 +0000 (10:17 +0000)]
Doc update TfLiteDelegate: FullyConnected does not support fused activation
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ie83c3b366214ceff2366c0a20a052582749c4fa4
James Ward [Wed, 25 Nov 2020 16:23:03 +0000 (16:23 +0000)]
Revert "IVGCVSW-5348 Update Doxygen Docu"
This reverts commit
7435eccdf0c207eb4f688d8648a13ad29eec73a1.
Reason for revert: not needed on master branch
Change-Id: I5cf460b8e2db3647d774962e88285930b51903a4
James Ward [Wed, 25 Nov 2020 10:00:28 +0000 (10:00 +0000)]
IVGCVSW-5348 Update Doxygen Docu
* Update Doxygen Documentation for 20.11 release
Signed-off-by: James Ward <james.ward@arm.com>
Change-Id: If717bd580b8a705934b2ce4c06b811195dde7fbc
Narumol Prangnawarat [Tue, 24 Nov 2020 18:40:42 +0000 (18:40 +0000)]
Fix reshape delegate intermittent error
* Make sue that incorrect corrupted data from reshapeOptions is not used
instead of shape from input tensor
* Remove redundant check
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ib30f632b5fdb039a618234c1faae183c98033e57
Jakub Sujak [Tue, 24 Nov 2020 16:39:21 +0000 (16:39 +0000)]
Removing labels and replacing with links to model+labels
Change-Id: Iec6c0b7cf55e0aa3ec1f0013f2da40e93b9bbcfc
Signed-off-by: Jakub Sujak <jakub.sujak@arm.com>
Teresa Charlin [Fri, 20 Nov 2020 13:08:42 +0000 (13:08 +0000)]
IVGCVSW-5347 Update Readme for 20.11
* Adding delegate readme.md and TensorFlowLiteDelegateSupport.md
Change-Id: I1b8012440cf4cd6120902ad69c5b3a2a5e410d71
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Jan Eilers [Fri, 20 Nov 2020 10:57:51 +0000 (10:57 +0000)]
IVGCVSW-5574 Change directory for tensorflow libs for the delegate
* TENSORFLOW_ROOT is already in use with a
different expected value
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I199987989678d8712a1f3e0a79ae066376429eec
Narumol Prangnawarat [Fri, 20 Nov 2020 16:17:48 +0000 (16:17 +0000)]
IVGCVSW-5569 Fix Unittest failure while building using EthosNAcc backend
* Correct the id when EthosN is enable
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I5203e615f809e56c7597ffeeec56b5ad38d4ff17
Narumol Prangnawarat [Fri, 20 Nov 2020 16:17:48 +0000 (16:17 +0000)]
IVGCVSW-5538 Fix delegate DepthwiseConv2d, DIV, Reshape
* Correct filter shape for DepthwiseConv2d
* Remove non-support data type
* Allow check for flatten on Reshape
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ic4be63d7c2f3a2b5e13a1530025a49464c21171b
Finn Williams [Fri, 20 Nov 2020 13:57:53 +0000 (13:57 +0000)]
IVGCVSW-5559 Add int8_t to tflite delegate on ExecuteNetwork
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I56afc73d48848bc40842692831c05316484757a4
Narumol Prangnawarat [Fri, 20 Nov 2020 14:50:54 +0000 (14:50 +0000)]
IVGCVSW-5544 Fix FullyConnected Delegate tests
* Correct input shape
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I9d1fe4c8ef32a9dfba7f7fdd6af314e9a522fce8
David Monahan [Fri, 20 Nov 2020 15:30:49 +0000 (15:30 +0000)]
IVGCVSW-5549 Failing Transpose Conv2d Uint8 test
* Changing Uint8 tests to Int8 for Delegate Transpose Conv2d
* Refactor of Quantization tests to be per backend
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: Ic1528e1dc339030c7f1eed9f3884e99b14f389e4
Jan Eilers [Fri, 20 Nov 2020 11:59:40 +0000 (11:59 +0000)]
IVGCVSW-5550 Fix failing delegate Conv2d tests for CpuAcc/GpuAcc
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: Ibfd1968a622c2538bbfacf4802cd45096de59db5
James Conroy [Fri, 20 Nov 2020 12:19:23 +0000 (12:19 +0000)]
IVGCVSW-5564 Disable INT16 delegate quant tests on ACL
* Since NEON/CL do not support QSYMM16 for Quantization,
disabling related tests on both backends and running
on CpuRef only.
Change-Id: Ifbc44cdfb81f25587ef87af8c44243dd88bb25c3
Signed-off-by: James Conroy <james.conroy@arm.com>
David Monahan [Fri, 20 Nov 2020 09:58:54 +0000 (09:58 +0000)]
IVGCVSW-5567 armnn_delegate Reshape operator fails
* Changes to the reshape parser to more closely match the TfLiteParser
* Added boilerplate checks to avoid potential segfaults with invalid option data
* Allow fallback to checking for second input tensor if options with invalid data are passed
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I75c4683148257afc5ce18fafb0b2ac495c5ba2a0
Jan Eilers [Thu, 19 Nov 2020 17:50:34 +0000 (17:50 +0000)]
IVGCVSW-5548 Fix delegate ElementwiseUnary tests for CpuAcc/GpuAcc
* Apply new test suite structure to be able to filter for backends
For ElementwiseBinary and ElementwiseUnary
* Add tolerance to data comparison
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: Iccabb68f316c93533e1076da5822ebc199e23739
James Conroy [Thu, 19 Nov 2020 14:44:01 +0000 (14:44 +0000)]
IVGCVSW-5093 Remove redundant LogicalUnary functions
* In favour of ElementwiseUnary functions which
are the currently used code path.
Signed-off-by: James Conroy <james.conroy@arm.com>
Change-Id: I34964d2dcabd4b7ddf0b455df17c48e3c6812ee4
Jan Eilers [Wed, 18 Nov 2020 10:36:46 +0000 (10:36 +0000)]
IVGCVSW-5545 Fix delegate Comparison failures on CpuAcc/GpuAcc
* Create backend test suite structure
* Add special compare function for boolean values
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I55a2ae1ac6ad21cdcdd5ae99ef56ed00fa24776f