Finn Williams [Thu, 11 Feb 2021 16:16:42 +0000 (16:16 +0000)]
IVGCVSW-5686 Add GpuAcc MLGO tuning file configuration argument
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I3f320499c379162f9d1b00cc8816bd144cd7eee4
Nikhil Raj [Thu, 11 Feb 2021 14:49:19 +0000 (14:49 +0000)]
IVGCVSW-5679 Failure to run the build instructions to build ArmNN using android ndk
* Provide FLATBUFFERS_INCLUDE_PATH in GlobalConfig.cmake if ARMCOMPUTECL is enabled
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Iabd5bb9b8a63970df9b7f485d07f8c1ee1a78560
Jan Eilers [Wed, 3 Feb 2021 09:14:30 +0000 (09:14 +0000)]
IVGCVSW-5386 TfLiteDelegate: Add Strided Slice operator
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: Icd87b1c54e1a5de84893882da30840a9097f6d84
Colm Donelan [Fri, 12 Feb 2021 12:43:35 +0000 (12:43 +0000)]
IVGCVSW-5648 Adding serializer support for m_DimensionsSpecificity
The field m_DimensionsSpecificity in TensorShape was not being serialized
and deserialized following implementation of type 1 dynamic tensors.
* Update schema.
* Add to Serializer and Deserializer.
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I7ddbdaf54c8f4b988c6cb300f90ba848a94bdad0
Matthew Sloyan [Wed, 10 Feb 2021 16:50:53 +0000 (16:50 +0000)]
IVGCVSW-5685 Add CpuAcc specific configuration option numberOfThreads
* Added ability to set number of threads used in CpuAcc backend
* Enabled number-of-threads option in ExecuteNetwork
* Added TfLiteDelegate ModelOptions test
* Added unsigned int type to BackendOptions.hpp
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: Ia576d4f45cbe5df3654bc730bb5ebd5181d82b5a
Finn Williams [Tue, 9 Feb 2021 15:56:23 +0000 (15:56 +0000)]
IVGCVSW-4893 Refactor ILayerVisitor using unified interface strategy.
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: Id7bc8255a8e3f9e5aac65d510bec8a559bf37246
David Monahan [Thu, 11 Feb 2021 11:45:41 +0000 (11:45 +0000)]
IVGCVSW-5717 Update JsonPrinterTestImpl to match latest ACL
* Updated JsonPrinterTestImpl to use CpuLogitsDLogSoftmaxKernel_#
* Update ACL pin to:
8958167c8d609566a40c9e618158ebcbdcd3e3bb
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: Ic48d6cc321d8f4cc15c488244f0d69508fad2d1c
Teresa Charlin [Thu, 11 Feb 2021 23:05:40 +0000 (23:05 +0000)]
MLCE-347 Bug fixes in Reduce: QueueDescriptor.validate and init REDUCE_MIN
* Allow input tensors of any rank in ReduceQueueDescriptor::validate
* Fix VTS tests failing for REDUCE_MIN due to initialization
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Id8fba1662ade4e0a967093fe5a53b275847f2393
Sadik Armagan [Thu, 11 Feb 2021 13:57:07 +0000 (13:57 +0000)]
MLCE-360 'ReduceLayer InferOutputShape Issue'
* Updated ParseReduce() function in TfLiteParser to read correct axis data
* Remove unused m_TargetWidth and m_TargetHight from ReduceDescriptor
* Updated the ArmNN Serializer Schema
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I98b6e00ccba1d8ea8c845cb1ae28840e42339629
Matthew Sloyan [Fri, 5 Feb 2021 17:22:28 +0000 (17:22 +0000)]
IVGCVSW-5392 TfLiteDelegate: Implement the Batch/Space operators
* Added support for BATCH_TO_SPACE_ND and SPACE_TO_BATCH_ND
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: Ib29333f3e2bc1a18bcc63533da4369b63c45ab90
Sadik Armagan [Wed, 10 Feb 2021 16:26:44 +0000 (16:26 +0000)]
IVGCVSW-5400 'TfLiteDelegate: FLOOR operator support'
* Added FLOOR operator support to Arm NN TfLiteDelegate
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I986ce8c5a825f509e0f8b3d257fd5b60834c322f
Matthew Sloyan [Tue, 9 Feb 2021 16:46:14 +0000 (16:46 +0000)]
IVGCVSW-5679 Fix Android NDK OOB build
* Specific OOB builds will fail if flatc is not available.
* flatc command is now only run if found.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: Iab6e082fe35dc3c3dfb78a29e1630c9edbb80be6
Nikhil Raj [Tue, 9 Feb 2021 11:05:16 +0000 (11:05 +0000)]
Update ACL pin to
7e20e29904c98adae5a91c6492fd78da88b7a9bf
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ica5d673e9f6a192b0cfd28c9ad5a5143aecefba7
Sadik Armagan [Tue, 9 Feb 2021 10:28:54 +0000 (10:28 +0000)]
MLCE-347 'REDUCE_MIN, REDUCE_MAX, REDUCE_SUM Support'
* Added TfLiteParser support for REDUCE_MIN and REDUCE_MAX operators
* Added ACL workloads support for REDUCE_MIN, REDUCE_MAX, and REDUCE_SUM operators
* Added TfLite Delegate support for REDUCE_MIN, REDUCE_MAX, and REDUCE_SUM operators
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I8085d59946bfd4ab78a59a61f899031ae53371a8
Matthew Sloyan [Wed, 3 Feb 2021 10:43:04 +0000 (10:43 +0000)]
IVGCVSW-4901 Add semantic versioning to Parsers and TfLite Delegate
* Added Version.hpp to all Parsers
* Added Version.hpp to TfLite Delegate
* Updated CMakeLists to use new versions
* Added GetVersion method to parsers and TfLite Delegate
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: If29e1e6d9e615f9095ec1c01ad47acfff40b1dd5
Kevin May [Thu, 4 Feb 2021 10:27:41 +0000 (10:27 +0000)]
IVGCVSW-4873 Implement Pimpl Idiom for IRuntime
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I52448938735b2aa678c47e0f3061c87fa0c693b1
Nikhil Raj [Mon, 8 Feb 2021 10:05:13 +0000 (10:05 +0000)]
Update ACL pin to
dda6914c6e923187c2ca2c3bfd71677e9c9e5c68
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I0e29496698b5e7934c2b1c18740527cd9eb23ecd
Jan Eilers [Tue, 2 Feb 2021 13:18:09 +0000 (13:18 +0000)]
IVGCVSW-5605 Doxygen: Update parser section
* Removes support.md files from all parsers. Lists of supported
operators are now kept in doxygen only
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I137e03fdd9f41751624bdd0dd25e2db5ef4ef94f
Jan Eilers [Mon, 8 Feb 2021 09:23:21 +0000 (09:23 +0000)]
IVGCVSW-5605 Doxygen: Add remaining guides to doxygen
* Integrates the debian package installation guide
* Integrates the AndroidNDK guide
* Integrates the cross compile guide
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I2243b15ee3f8e976789494199f12f3cc0fd5f00d
Keith Mok [Fri, 8 Jan 2021 23:25:14 +0000 (15:25 -0800)]
ArmnnConfig.cmake install to correct directory
Signed-off-by: Keith Mok <ek9852@gmail.com>
Change-Id: I9b1037275379bdbf452589357576cfa763b7c128
Nikhil Raj [Wed, 3 Feb 2021 10:27:22 +0000 (10:27 +0000)]
IVGCVSW-4143 Add semantic versioning to Arm NN
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ibe1200c6d7be9e04821b4a829c83833d44542ad5
Nikhil Raj [Fri, 5 Feb 2021 12:28:54 +0000 (12:28 +0000)]
Update ACL pin to
cf87f509fc23d02c56569f794a3fb59e1b8be277
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I20b69cc042ae5828584b2ecfd2f9694021d7693c
Sadik Armagan [Mon, 11 Jan 2021 15:15:01 +0000 (15:15 +0000)]
MLCE-326 'Support Dilation in Conv2D in ONNX and Tensorflow Parsers'
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I4a0f07b1e8f80aff0d29405def1f33bde7944e31
Narumol Prangnawarat [Thu, 4 Feb 2021 11:05:52 +0000 (11:05 +0000)]
Remove LFS configuration
* Remove LFS configuration
* Add mock test models for external delegate
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I9f5b427a995aff22391548cd45821cb2afc8a474
Kevin May [Fri, 29 Jan 2021 14:24:57 +0000 (14:24 +0000)]
IVGCVSW-5592 Implement Pimpl Idiom for Caffe and Onnx Parsers
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I760dc4f33c0f87113cda2fa924da70f2e8c19025
Kevin May [Wed, 3 Feb 2021 17:38:41 +0000 (17:38 +0000)]
IVGCVSW-5592 Implement Pimpl Idiom for Tf and TfLite Parsers
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I4a82aca4a2c47b3c598b91bc0075c09397be728a
Teresa Charlin [Thu, 4 Feb 2021 09:26:07 +0000 (09:26 +0000)]
Update ACL pin to
0841ca085301e8ddbc9
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I8b27541ec11ee907b80f6e2b4ff9ce3d76320076
Narumol Prangnawarat [Wed, 3 Feb 2021 13:32:25 +0000 (13:32 +0000)]
Fix LFS issue
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I6b3321cf0d51c06b742432995ea486c987806afc
Sadik Armagan [Wed, 3 Feb 2021 09:29:30 +0000 (09:29 +0000)]
backends/reference: Add ReduceSum operation support
This patch addes ReduceSum operation support for reference backend,
which computes the sum of elements across dimensions of a tensor.
Changelog v1:
- Fix file header descriptions.
Chagelog v2:
- Fix line limit issue.
- Fix type conversion issue.
Changelog v3:
- Remove tabs.
- Modify newly added file headers.
Changelog v4:
- Symbol on header isn't allowed so drop it from newly added file headers.
Changelog v5:
- Remove tabs, fix the use of brackets and align lines correctly.
Changelog v6:
- Add serializer and deserializer support.
Changelog v7:
- Fix build error add missed code.
Changelog v8:
- Rename ReduceSumDecriptor to ReduceDescriptor
- Update m_KeepDims field data type to bool on ReduceDescriptor
- Add ReduceOperation field to ReduceDescriptor
- Rename ReduceSumLayer to ReduceLayer
- Update ReduceLayer to use ReduceDescriptor
- Update ReduceLayer::ValidateTensorShapesFromInputs() function
- Rename RefReduceSumWokload to RefReduceWorkload
- Update workload to use ReduceDescriptor
- Update workload to use Decoders and Encoders
- Remove ReduceSum.hpp and ReduceSum.cpp
- Added Reduce.hpp and Reduce.cpp
- Move Mean.cpp (which is implementing REDUCE_MEAN) functionality to Reduce.cpp
- Update RefMeanWorkload to call Reduce function with ReduceOperation::Mean argument
- Remove Mean.hpp and Mean.cpp
- Update the Serializer/Deserializer ArmnnSchema.fbs for ReduceLayer, ReduceDescriptor, and ReduceOperation
- Update Serializer and Deserializer for serializing/parsing ReduceLayer
- Added TfLiter parser Sum test for REDUCE_SUM operator
- Make corresponding changes on front-end and Ref backend to support REDUCE_SUM operator
Changelog v9:
- Fixed build errors.
Change-Id: I8c8e034f3df73f9565b3c18eff51ecca6c542195
Signed-off-by: Inki Dae <inki.dae@samsung.com>
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Jan Eilers [Sun, 31 Jan 2021 19:56:23 +0000 (19:56 +0000)]
IVGCVSW-5605 Doxygen: Add contribution guide sections
* Adds a page for contribution guidelines (Uses md guide)
* Adds a section for contribution guides (Uses md guide)
* Minor beautification
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: Iafd7e3abf9da660ec21a215afada61a27ce928fc
Jan Eilers [Fri, 29 Jan 2021 14:18:13 +0000 (14:18 +0000)]
IVGCVSW-5605 Doxygen: Add the TfLite Delegate to Doxygen docu
* Moves TensorFlowLiteDelegateSupport.md to doxygen
* Renames a few .dox files to represent the structure of the documentation
* Adds sections for build and use guides
* Integrates markdown guides for the delegate into doxygen
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I68b7a29239be88c0617da9bdfce5323ebf26f5bc
Narumol Prangnawarat [Fri, 29 Jan 2021 15:38:54 +0000 (15:38 +0000)]
IVGCVSW-5619 Enable OptimizerOptions for the python external delegate
* Add reduce-fp32-to-fp16, reduce-fp32-to-bf16, debug-data, memory-import
options to external delegate
* Simplify DelegateOptions
* Add test mock models
* Unit tests
* Configure lfs to manage tflite files
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I1e4db468862ba03d4cb031347bc307cf940b3cb1
Nikhil Raj [Tue, 2 Feb 2021 10:07:29 +0000 (10:07 +0000)]
Update ACL pin to
ea857273d8b4a94fb7f1e63ce9068a60259fb9d3
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Id43ff3eb59f8c93cfe9fc4bcd76b8496512e2859
Jan Eilers [Fri, 29 Jan 2021 09:50:36 +0000 (09:50 +0000)]
IVGCVSW-5605 Doxygen: Add PyArmNN to Doxygen docu
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I43082950c55375f62ecd30236d1c475e4ca89faf
Jan Eilers [Thu, 28 Jan 2021 16:00:00 +0000 (16:00 +0000)]
IVGCVSW-5605 Doxygen: Move "OtherTools" to "Software Tools"
* Uses README.md files to reduce duplications
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I2cfcb6cf02ac712656cb8c782c70d002df642b97
Jan Eilers [Thu, 28 Jan 2021 15:38:09 +0000 (15:38 +0000)]
IVGCVSW-5605 Doxygen: Move Converter and Quantizer to Software Tools
* Using README.md files directly to reduce duplications
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I6bd6f6326e608939ac244cc32b329e32bb4802f7
Jan Eilers [Thu, 28 Jan 2021 14:45:09 +0000 (14:45 +0000)]
IVGCVSW-5605 Doxygen: Move Serializer and Deserializer to Software Tools
* Not using the README.md files directly because it doesn't seem to
be possible to get the content of readme.md combined with the content
of the support.md files in one page
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I1e5073761f3af8a8d498385f3f7586334e7b29ec
Jan Eilers [Thu, 28 Jan 2021 09:13:24 +0000 (09:13 +0000)]
IVGCVSW-5605 Doxygen: Integrate parsers into Software Tools section
* Creates new section in doxygen called "Software Tools"
* Moves the Parser page into Software Tools
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I19643074226d7c2e73e560e3abb52f519af1a7b2
Jan Eilers [Wed, 27 Jan 2021 20:04:41 +0000 (20:04 +0000)]
IVGCVSW-5605 Doxygen: Use readme.md as mainpage in doxygen
* Gives the readme file an update
* Removes introduction.dox
* Adds FAQ to doxygen
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: Ibb67e7f2cac7e55556295eb7851c616561b17042
Finn Williams [Tue, 26 Jan 2021 22:30:06 +0000 (22:30 +0000)]
IVGCVSW-5593 Implement Pimpl Idiom for serialization classes
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I01c7bd314219e58f71505dcb787d606dbded914a
Keith Davis [Sun, 31 Jan 2021 18:36:58 +0000 (18:36 +0000)]
IVGCVSW-5374 Provide Android Build for Delegate
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: Ie8c03153f82434d73572278eedb8a4b5b89ed837
Matthew Sloyan [Mon, 18 Jan 2021 16:10:20 +0000 (16:10 +0000)]
IVGCVSW-5484 Add Network loading time to InferenceModel
* Added output log to capture time taken to load network into runtime.
* This time is cut down when loading a cached network.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I043c177f17d01df35fbe0752ec5d77e350749164
Francis Murtagh [Thu, 28 Jan 2021 14:25:15 +0000 (14:25 +0000)]
IVGCVSW-4874 Provide LayerSupportHandle to frontend users
* Add test for new IsBackendRegistered member function of Handle
* Move deprecated messages to new frontend API of LayerSupportHandle
* Update delegate to use dot operator for IsXXXLayerSupported
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: I70d7166e207a10e4b3583a827ca0dda2169bcba1
!android-nn-driver:4940
Keith Davis [Wed, 27 Jan 2021 13:12:03 +0000 (13:12 +0000)]
IVGCVSW-5374 Provide Android Build for Delegate
* Remove double brackets for scalars
* Add in extra location in cmake for tf lite dynamic library
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I31ef9a955d4677faabedc0068ae2cfbfe570b58c
Nikhil Raj [Thu, 28 Jan 2021 10:14:35 +0000 (10:14 +0000)]
Update ACL pin to
4cfab1886549d7582e3867c51278132e5d37681b
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ica17c75dfab52d9b8fada56658b95794d4e58536
Jim Flynn [Thu, 28 Jan 2021 07:01:35 +0000 (07:01 +0000)]
Remove incorrect use of std::vector.reserve
Change-Id: Ic45d4c837eaad8b9f19288d4f3b6e8caa3eaf319
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Sadik Armagan [Wed, 20 Jan 2021 17:48:07 +0000 (17:48 +0000)]
IVGCVSW-5391 'ArmNN TfLiteDelegate: Implement the Space/Depth operators'
* Added DEPTH_TO_SPACE and SPACE_TO_DEPTH operators support
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I2595f759181bd7339127e7b114b850b534210dd5
Sadik Armagan [Fri, 22 Jan 2021 10:53:38 +0000 (10:53 +0000)]
IVGCVSW-5390 'TfLiteDelegate: Implement the Normalisation operators'
* Added L2_NORMALIZATION and LOCAL_RESPONSE_NORMALIZATION opertor support
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Ic9e66879cf6469fa8761fb1c9dd5950771f629b0
Narumol Prangnawarat [Wed, 20 Jan 2021 15:58:29 +0000 (15:58 +0000)]
IVGCVSW-5619 Add OptimizerOptions and NetworkProperties to ArmNN Delegate
* Add OptimizerOptions, NetworkProperties, DebugCallbackFunction
to DelegateOptions
* Enable OptimizerOptions when the network is being optimized
* Enable NetworkProperties when loading network
* Enable DebugCallbackFunction
* Add error message when loading network
* Log warning instead of error when operator is not supported but
could fallback to another backend
* Improve uint16_t CompareData
* Unit tests
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I353035afb442774bfeb1c62570a90755c2ceaf38
Nikhil Raj [Fri, 22 Jan 2021 10:02:38 +0000 (10:02 +0000)]
Update ACL pin to
6a4ebe1305b544aec1ba0bfc67ed65d94fcc8c2e
* Pass in new window parameter to the schedule_op function
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I8579d2d6e55ab9888471bd780628df0f73438498
Francis Murtagh [Mon, 25 Jan 2021 10:18:10 +0000 (10:18 +0000)]
IVGCVSW-5525 Handle Neon optionality on 32 bit linux platforms
* Add neon detection for linux using HWCAPs
* Add test to check for backend throwing BackendUnavailable exception
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: Ib74aeb06abe5f88f21ecdd1edb2a1cd20ee2019d
Sadik Armagan [Fri, 22 Jan 2021 14:25:31 +0000 (14:25 +0000)]
MLCE-335 'DEPTH_TO_SPACE and GATHER operator support in TfLiteParser'
* Added GATHER operator support to TfLiteParser
* Added DEPTH_TO_SPACE operator support to TfLiteParser
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Id5d3b54e2d850eb9f19417029efbeb73a3029e69
Jan Eilers [Tue, 15 Dec 2020 10:42:38 +0000 (10:42 +0000)]
IVGCVSW-5571 Expose the TfLite Delegate to the TfLite python API
* Implemented external delegate adaptor interface for TfLite
* Activated armnn logging for delegate
* Added logging info to indicate if gpu tuning is turned on
* Added pytests to ensure functionality of the external delegate adaptor
* Included the delegate directory into doxygen
* Added documentation on how to use the external delegate in python
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: Id3b4588fb0b9ac7e3f47ba2c19feead7beb58e18
Teresa Charlin [Mon, 18 Jan 2021 18:07:57 +0000 (18:07 +0000)]
IVGCVSW-5616 Don't fuse activation if quantization parameters are different
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I6504e922113aa9e397f53e570ebcf47e1f133945
Sadik Armagan [Wed, 20 Jan 2021 12:17:00 +0000 (12:17 +0000)]
MLCE-336 'TfLite parser and ExecuteNetwork issues'
* Report the error thrown
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: If5e5160f43c11a284b919d76b04d9c4d53e9c56c
Sadik Armagan [Tue, 19 Jan 2021 17:24:21 +0000 (17:24 +0000)]
IVGCVSW-5399 'TfLiteDelegate: Implement the ArgMinMax operators'
* Added ARG_MIN and ARG_MAX support to armnn_delegate
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Ia000c4b64378e28320164edd4df2902ca13dcda6
Sadik Armagan [Wed, 13 Jan 2021 15:06:38 +0000 (15:06 +0000)]
IVGCVSW-4417 'Serialise ArmNN Model on android-nn-driver'
* Added generated schema file to the source tree
* Updated the ANdroid.mk file to pick up the Serializer/Deserializer source
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I12c2bf2ae7aa12374c60e671ff3a97eac5b7f161
Matthew Sloyan [Tue, 12 Jan 2021 16:19:43 +0000 (16:19 +0000)]
IVGCVSW-5644 Add documentation for cache loaded network
* Added ModelOptions documentation to CLBackendModelContext
* Improved options descriptions in ExecuteNetworkProgramOptions.cpp
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I14f0c8bb4f299809b89f49c616b691e2f7956d5b
Nikhil Raj [Tue, 12 Jan 2021 14:29:18 +0000 (14:29 +0000)]
Renaming NEActivationLayerKernel to CpuActivationKernel
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I33dc1127627b4b89c02a3bea246eaf7499e5a780
David Monahan [Tue, 12 Jan 2021 09:11:07 +0000 (09:11 +0000)]
IVGCVSW-5424 TFLite parser not parsing new TransposeConv
* Added support for bias vector in TransposeConv to TfLite parser
* Added UnitTest
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I6483986a9da9216084b4b885b7fd980fc3580fa9
Mike Kelly [Thu, 14 Jan 2021 10:04:56 +0000 (10:04 +0000)]
MLCE-325 ArmnnQuantizer incorrectly Quantizes all DataTypes
* ArmnnQuantizer incorrectly converts boolean or integer DataTypes to quantized
DataTypes. This breaks layers like ArgMinMax where the output contains the
index of an element along an axis.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I272c3d0f48bf884a2480bfa43eb14ec265fcda6b
Sadik Armagan [Thu, 14 Jan 2021 09:32:00 +0000 (09:32 +0000)]
IVGCVSW-5634 'GitHub Contributor Guide Issue'
* Fixed the ContributorGuide display issue
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I7be39cda5682a220dbd3708692230ab7421f80e0
Keith Mok [Mon, 21 Dec 2020 22:28:47 +0000 (14:28 -0800)]
Fix build breaks on file insensitive system
Current we use 'A'rmNNQuantizer name for executable
and 'a'rmNNQuantizer as library name.
Since cmake does not allow same name for executable and library.
The old way is to use a captial letter for the executable name.
But it will create a problem on system (like macosx) that the file
system is case insensitive by default. Since it will create/overwritten
file on the same folder during the cmake build which makes build failed
when BUILD_ARMNN_QUANTIZER is enabled.
Fixed this by using ArmNNQuantizerMain as the executable
name during build, then rename it back to ArmNNQuantizer using
set_target_property OUTPUT_NAME function.
Signed-off-by: Keith Mok <ek9852@gmail.com>
Change-Id: I3e0779770c851c0eb6804e300a24836be955d07a
Matthew Sloyan [Wed, 13 Jan 2021 14:30:19 +0000 (14:30 +0000)]
IVGCVSW-5483 Fix cache loaded network nightly failure
* Fixed issue where nightly job couldn't find flatbuffers import.
* Removed unnecessary commented code.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: If201f3fe54bf3bdd167aaf5d108154165d2a910d
Narumol Prangnawarat [Fri, 18 Dec 2020 16:13:06 +0000 (16:13 +0000)]
IVGCVSW-5625 Add support for Float16 to Delegate
* Float16 unit tests for Reshape
* Remove unsupported data type from Pad
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ib1804bb6e708a0552fb40d05fe8a6511936f9793
Francis Murtagh [Tue, 12 Jan 2021 11:51:09 +0000 (11:51 +0000)]
IVGCVSW-5552 Generalize versions for Debian Packaging installation guide
* Remove need to update the guide for each release
by allowing user to check for newest version
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: Ic6dda46524916762a06f24444bd7368ff1cde159
Francis Murtagh [Tue, 5 Jan 2021 14:42:00 +0000 (14:42 +0000)]
IVGCVSW-5630 Unittest failure on mipsel/s390x/ppc64/powerpc
* Use ECONNREFUSED #define instead for connection refused error no.
* As error code on mips for example is 146
Change-Id: I2c725dc93ab8951d4f42a3ba51e747e01ced3a68
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Matthew Sloyan [Fri, 8 Jan 2021 10:30:51 +0000 (10:30 +0000)]
IVGCVSW-5484 Add CacheLoadedNetwork options to ExecuteNetwork
* Enable ability to save/load ClContext in ExecuteNetwork.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I58c61a53f6713853eb06520cc372ed47baf7f8c4
Matthew Sloyan [Thu, 7 Jan 2021 13:28:47 +0000 (13:28 +0000)]
IVGCVSW-5483 'Implement Loading and Saving to File'
* Implemented Serialization and Deserialization of CLContext.
* Fixed flatbuffers android-nn-driver dependency.
!android-nn-driver:4772
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: If806f050535ffaa70922ba0f1ffe7bb10f902329
Keith Mok [Sun, 20 Dec 2020 08:05:14 +0000 (00:05 -0800)]
Fix mac build breaks
Signed-off-by: Keith Mok <ek9852@gmail.com>
Change-Id: I4b2926342bbf8621f7b7f5695cf1526dd7281bef
Keith Mok [Tue, 22 Dec 2020 01:06:57 +0000 (17:06 -0800)]
Fix build breaks for armnnDeserializer test
On macosx, the section rodata syntax is a
little bit different, add ifdef __MACH__
to fix that.
Signed-off-by: Keith Mok <ek9852@gmail.com>
Change-Id: Ic11d6faf8b8d3f3b521fd4305e6cdc3562a1c8ae
Nikhil Raj [Wed, 6 Jan 2021 16:22:13 +0000 (16:22 +0000)]
Update ACL pin to
b309fc249e4383b4d40ae03e377c3cbad3f9f5f7
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I10e46b3c4b7d69bcb742014cb2633cfc061eb718
Keith Mok [Mon, 21 Dec 2020 03:47:25 +0000 (19:47 -0800)]
Add argmax deconv support for caffe parser
armnn support argmax and deconv , but caffe parser does not.
Add back this feature.
Signed-off-by: Keith Mok <ek9852@gmail.com>
Change-Id: I6b99cc4b58491204c41c6e1d11f583c65c628ee4
Keith Mok [Sun, 20 Dec 2020 21:45:51 +0000 (13:45 -0800)]
Add Caffe Parser Dilation support
Signed-off-by: Keith Mok <ek9852@gmail.com>
Change-Id: I3a85de2d082d489fbf5a775c2ae551080d189294
Teresa Charlin [Mon, 4 Jan 2021 17:17:02 +0000 (17:17 +0000)]
adding BOOST_TEST to EnqueueWorkload in FuseActivation Unit Test
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I6a00045967fa48ec0913c8708ffc146a72ed2b87
Nikhil Raj [Tue, 5 Jan 2021 16:30:43 +0000 (16:30 +0000)]
Update ACL pin to
97b3f11a1655c05bedaf378f85f94cdccb1536ba
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ie4fd3fe2671050537eb0ab85032922f6464c9d24
Nikhil Raj [Fri, 18 Dec 2020 15:00:17 +0000 (15:00 +0000)]
Update ACL pin to
b6869dda4a5bf233df009eaac15cf0c220b653f2
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I1422eab2beb3d59841f827b60d822f987e08f326
Narumol Prangnawarat [Thu, 17 Dec 2020 12:17:58 +0000 (12:17 +0000)]
IVGCVSW-5383 TfLiteDelegate: Implement Pad and PadV2 operators
* Add Pad and PadV2 operators support to Armnn Delegate
* Add dimension check to CompareOutputData test utility
* Unit tests
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I9d00eb08f71e791498908fcbdb9de561e1c01aef
Finn Williams [Mon, 30 Nov 2020 17:43:28 +0000 (17:43 +0000)]
IVGCVSW-5374 Provide an Android build for the delegate
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I33eb8c650be654ad891afd2295f2057f13a9d084
David Monahan [Thu, 3 Dec 2020 11:09:46 +0000 (11:09 +0000)]
IVGCVSW-4625 Add CL Rank Workload
* Added CL implementation of Rank Workload
* Removed references to memcpy_s as it's a windows only function
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: Ia63666b9640d76a775f2ab98b3cd7e9f77b5a507
Nikhil Raj [Thu, 17 Dec 2020 11:01:53 +0000 (11:01 +0000)]
Update ACL pin to
462e75e217a11b92b8df8c3434f2491ef70487e3
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Icd92b46f7dcac091739e8a9b01e5c36bf16b0fcb
Matthew Sloyan [Wed, 16 Dec 2020 12:50:01 +0000 (12:50 +0000)]
IVGCVSW-5614 Enable Hard Swish and Elu activations
* Enabled Hard Swish and Elu in TfLiteDelegate
* Added support for Elu in TfLiteParser
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: If09321b58568a98e14cabce610a1586556da041e
Teresa Charlin [Mon, 30 Nov 2020 17:10:21 +0000 (17:10 +0000)]
IVGCVSW-5532 Adding UnitTest fusing activation
* QASymmS8 and BoundedReLU
* Float16 and ReLU in GpuAcc
* Remove layerName, not needed as 1 test per combination
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I930c7a04d8d904f370f1b40c62cf9311c172bbdf
Narumol Prangnawarat [Fri, 27 Nov 2020 16:57:56 +0000 (16:57 +0000)]
IVGCVSW-5595 Fix incorrect padding value for asymmetric quantized type
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I85f0c30757043f8c27c78d607f0f9dbbdd35b9fb
Nikhil Raj [Wed, 16 Dec 2020 10:50:35 +0000 (10:50 +0000)]
Update ACL pin to
4d9687e70e2d71097cd43929d5f63377c3c44523
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ib6d10096a5348f06d744c5629eb3b41f9c187059
Nikhil Raj [Tue, 15 Dec 2020 10:04:40 +0000 (10:04 +0000)]
Update ACL pin to
aa51a5ba9a3f05be08b94859b53c398edee5d2e3
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ifff69c7ddce967f7a084c26837685e84f680e78a
Matthew Sloyan [Mon, 14 Dec 2020 17:53:20 +0000 (17:53 +0000)]
Update ACL pin to
ec241b48ea7481e797285788fd68e5e1d42382bb
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I28b2eca636b5ca9156865871b60447707bfa8647
Derek Lamberti [Mon, 7 Dec 2020 13:54:12 +0000 (13:54 +0000)]
Sort subgraphview layers on construction
Make it easier for backends to traverse the subgraph during optimization
Change-Id: I140cb11f78bab5f19c801a5b55efffb38c63837f
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Nikhil Raj [Thu, 10 Dec 2020 10:07:46 +0000 (10:07 +0000)]
Update ACL pin to
ec2256b81e6d6f655dcfbc76683738fbfeb82bcc
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Idc5233a19a97a6feb42b6841e6aff9d793a88740
Derek Lamberti [Mon, 7 Dec 2020 13:56:40 +0000 (13:56 +0000)]
Default comparisons-files option to empty vector
Change-Id: Iecd8d9b333fa4456d081b4787c1a5b5d0b4a2b79
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Nikhil Raj [Wed, 9 Dec 2020 10:11:37 +0000 (10:11 +0000)]
Update ACL pin to
98e33b97b92c912f058bfb3295adad1bcad3e80f
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I3c51a9a16908af2b1bc9250ada31b8ca46307fff
James Ward [Wed, 2 Dec 2020 10:20:48 +0000 (10:20 +0000)]
IVGCVSW-5598 ArmNN Doxygen doc needs update
Signed-off-by: James Ward <james.ward@arm.com>
Change-Id: Iac19640fec7aabdfcbb88a0856d4fce3a15d3f27
Matthew Sloyan [Mon, 7 Dec 2020 13:33:24 +0000 (13:33 +0000)]
IVGCVSW-5560 Fix TfLiteDelegate Reshape operator failure
* Fixed issue when running certain models with 2D shape tensor.
* Falls back to inbuilt options if encountered.
* Fixed ExecuteNetwork so that error messages are logged if NULL.
* Updated TfLiteDelegate docs to include Logical Operators.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Signed-off-by: David Monahan <david.monahan@arm.com>
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I5dbaf30351f7fc86e6178a0caf46c152812088d3
James Conroy [Mon, 7 Dec 2020 16:59:03 +0000 (16:59 +0000)]
IVGCVSW-5500 Fix transpose conv InferOutputShape
* Use kernelShape[0] as channels for outputShape.
Signed-off-by: James Conroy <james.conroy@arm.com>
Change-Id: I070c7ff68ae365d9505a5eb28c76f9e52da1e5f9
Nina Drozd [Tue, 1 Dec 2020 11:56:12 +0000 (11:56 +0000)]
Pyarmnn fix - parsers are optional extensions
Signed-off-by: Nina Drozd <nina.drozd@arm.com>
Change-Id: Ic999cb898933fa674f1cd3b4b85ab650154d587d
Teresa Charlin [Mon, 7 Dec 2020 12:56:38 +0000 (12:56 +0000)]
Update ACL pin to
f7c5a41aebf8951ef783aa3d45f0bc4e98656e7b
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ic4c7df887d460fd695ffec822437e0c8a5095baf
Matthew Sloyan [Thu, 26 Nov 2020 10:54:22 +0000 (10:54 +0000)]
IVGCVSW-5381 TfLiteDelegate: Implement the Logical operators
* Implemented Logical AND, NOT and OR operators.
* NOT uses existing ElementwiseUnary VisitLayer function & tests.
* AND/OR uses new LogicalBinary VisitLayer function & tests.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I5e7f1e78b30c36ac7f14c70a712b54f98d664b83
David Monahan [Thu, 3 Dec 2020 09:48:06 +0000 (09:48 +0000)]
IVGCVSW-4626 Add Neon Rank Workload
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I5a85597e75d2b879ae234c6929686fabe99d7bc8
Nikhil Raj [Thu, 3 Dec 2020 11:01:03 +0000 (11:01 +0000)]
Update ACL pin to
96b16b65dd96351b8af1b2a785856ce13cc8ba84
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I2cafcbe087cb55e7252cbba2a7c8b649a98067e1
Nikhil Raj [Thu, 3 Dec 2020 11:25:34 +0000 (11:25 +0000)]
Update TF version in Cross compilation guide
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ic8efc05bfea3ac007aec03b0b6d3edd3a9e18819