platform/upstream/armnn.git
5 years agoIVGCVSW-2543 Add timing for ExecuteNetwork inference
James Conroy [Thu, 11 Apr 2019 09:23:58 +0000 (10:23 +0100)]
IVGCVSW-2543 Add timing for ExecuteNetwork inference

  * Adds a new command line option 'threshold-time'
    to ExecuteNetwork, the maximum allowed time for
    inference in EnqueueWorkload.
  * ExecuteNetwork now outputs inference time
    elapsed and (if supplied) threshold time.
  * If actual elapsed inference time is greater
    than supplied threshold time, fail the test.

Change-Id: If441b49a29cf5450687c07500c9046a80ece56fc
Signed-off-by: James Conroy <james.conroy@arm.com>
5 years agoIVGCVSW-2912 Change get_compute_libary.sh -p exit code to 0
Jim Flynn [Thu, 11 Apr 2019 12:10:46 +0000 (13:10 +0100)]
IVGCVSW-2912 Change get_compute_libary.sh -p exit code to 0

Change-Id: Id53d32f07c2c555d4ed86bcba31a860a698ff3e9
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
5 years agoIVGCVSW-2873 Update documentation for Serializer/Deserializer
Sadik Armagan [Wed, 10 Apr 2019 13:16:44 +0000 (14:16 +0100)]
IVGCVSW-2873 Update documentation for Serializer/Deserializer

 * Updated Serializer/Deserializer support documentation for Quantize Operation.

Change-Id: I8cc670a58756c9f2d7294131c4715bee5ae7a647
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
5 years agoIVGCVSW-2947 Remove boost dependency from include/TypesUtils.hpp
Aron Virginas-Tar [Tue, 9 Apr 2019 13:08:06 +0000 (14:08 +0100)]
IVGCVSW-2947 Remove boost dependency from include/TypesUtils.hpp

!android-nn-driver:968

Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
Change-Id: I03ccb4842b060a9893567542bfcadc180bbc7311

5 years agoIVGCVSW-2946 RefElementwiseWorkload configures prior to first execute
Derek Lamberti [Tue, 9 Apr 2019 09:25:02 +0000 (10:25 +0100)]
IVGCVSW-2946 RefElementwiseWorkload configures prior to first execute

+ Added PostAllocationConfigure() method to workload interface
+ Elementwise function now deduces types based on Functor
- Replaced RefComparisonWorkload with RefElementwiseWorkload specialization
+ Fixed up unit tests and minor formatting

Change-Id: I33d08797767bba01cf4efb2904920ce0f950a4fe
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
5 years agoIVGCVSW-2912 Make get_compute_library.sh sole source for clframework pin
Jim Flynn [Tue, 2 Apr 2019 14:19:08 +0000 (15:19 +0100)]
IVGCVSW-2912 Make get_compute_library.sh sole source for clframework pin

* Also incorporated fix for break in master build
  32-bit NEDepthwiseConvolution errors in clframework
* Fixed a failure in the Float16 workloads for ElementwiseOperations

!android-nn-driver:963

Change-Id: Ic2cdb0e6c9399fa42b56001c6f4b46b7f150f143
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
5 years agoIVGCVSW-2862 Extend the Elementwise Workload to support QSymm16 Data Type
Sadik Armagan [Tue, 9 Apr 2019 13:20:12 +0000 (14:20 +0100)]
IVGCVSW-2862 Extend the Elementwise Workload to support QSymm16 Data Type
IVGCVSW-2863 Unit test per Elementwise operator with QSymm16 Data Type
 * Added QSymm16 support for Elementwise Operators
 * Added QSymm16 unit tests for Elementwise Operators

Change-Id: I4e4e2938f9ed2cbbb1f05fb0f7dc476768550277
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
5 years agoIVGCVSW-2845: Add TfLite Parser support for TanH activation layer
Nina Drozd [Tue, 9 Apr 2019 08:37:38 +0000 (09:37 +0100)]
IVGCVSW-2845: Add TfLite Parser support for TanH activation layer

* Added ParseTanH in TfLiteParser
* Added testcase for parsing TanH activation in Activations.cpp
* Added new supported TanH operator in TensorflowLiteSupport.md

Signed-off-by: Nina Drozd <nina.drozd@arm.com>
Change-Id: Ie60f38994d76b077f86828c21c57381bdeeaeb5a

5 years agoIVGCVSW-2861 Refactor the Reference Elementwise workload
Sadik Armagan [Wed, 3 Apr 2019 16:48:18 +0000 (17:48 +0100)]
IVGCVSW-2861 Refactor the Reference Elementwise workload
 * Refactor Reference Comparison workload
 * Removed templating based on the DataType
 * Implemented BaseIterator to do decode/encode

Change-Id: I18f299f47ee23772f90152c1146b42f07465e105
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Signed-off-by: Kevin May <kevin.may@arm.com>
5 years agoIVGCVSW-2844: Add TfLite Parser support for Split layer
Nina Drozd [Mon, 8 Apr 2019 09:52:10 +0000 (10:52 +0100)]
IVGCVSW-2844: Add TfLite Parser support for Split layer

* Added ParseSplit method
* New Unit test Split.cpp
* Updated TensorflowLiteSupport.md with new supported operator

Change-Id: Iec80ba9ad7b48db8e86589ebae77bd7d8ed38fb2
Signed-off-by: Nina Drozd <nina.drozd@arm.com>
5 years agoIVGCVSW-2927 Fix Streamline annotations
Matthew Bentham [Fri, 5 Apr 2019 08:35:15 +0000 (09:35 +0100)]
IVGCVSW-2927 Fix Streamline annotations

Change-Id: Ia3f4852e6ba1358c6798210ecf94105a130cb1b9
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
5 years agoIVGCVSW-2914 Add Switch Layer and no-op factory method
Sadik Armagan [Fri, 5 Apr 2019 14:25:46 +0000 (15:25 +0100)]
IVGCVSW-2914 Add Switch Layer and no-op factory method

Change-Id: I6a6ece708a49e8a97c83a3e7fec11c88af1e1cfa
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
5 years agoIVGCVSW-2915 Add Merge Layer and no-op factory method
Nattapat Chaimanowong [Fri, 5 Apr 2019 12:37:19 +0000 (13:37 +0100)]
IVGCVSW-2915 Add Merge Layer and no-op factory method

Change-Id: I54549671e0d3b207904cf9796a843eb2b0a631f7
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2926 Add test for ResNetV2 50 quantized tflite model
nikraj01 [Fri, 5 Apr 2019 10:42:45 +0000 (11:42 +0100)]
IVGCVSW-2926 Add test for ResNetV2 50 quantized tflite model

Change-Id: I9389cf32d0efb303ea0930ecb4a87af884943b06
Signed-off-by: nikraj01 <nikhil.raj@arm.com>
5 years agoIVGCVSW-2539 Improve ExecuteNetwork error logging
Francis Murtagh [Thu, 4 Apr 2019 10:16:29 +0000 (11:16 +0100)]
IVGCVSW-2539 Improve ExecuteNetwork error logging

 * Add check to ensure requested input node exists
   otherwise give coherent error message

Change-Id: Ifee5f1d459f989c2e808cf78806f9a9a7f7c763f
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
5 years agoIVGCVSW-2802 Ability to run FP16 turbo mode through ExecuteNetwork
Ruomei Yan [Tue, 2 Apr 2019 15:47:34 +0000 (16:47 +0100)]
IVGCVSW-2802 Ability to run FP16 turbo mode through ExecuteNetwork

Change-Id: I679883234d78b95d1e01ed5602c5cab296b0c6bf
Signed-off-by: Ruomei Yan <ruomei.yan@arm.com>
5 years agoIVGCVSW-2875 Enable QuantisedSymm16 support for ref Dequantize workload
Nattapat Chaimanowong [Tue, 2 Apr 2019 10:41:45 +0000 (11:41 +0100)]
IVGCVSW-2875 Enable QuantisedSymm16 support for ref Dequantize workload

Change-Id: I4b1c1f963214433ad67d5a311fbea5f21177f6a2
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2872 Unit tests for Quantize layer and reference workload
Nattapat Chaimanowong [Mon, 1 Apr 2019 16:04:53 +0000 (17:04 +0100)]
IVGCVSW-2872 Unit tests for Quantize layer and reference workload

Change-Id: I291c08cb6e359453978b398255cf8ff051ed2686
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2832 (Part 2) update clframework pin to b4a44ff3aa98d2b51f1621a7525db3f81108a1bd
Jim Flynn [Mon, 1 Apr 2019 12:22:21 +0000 (13:22 +0100)]
IVGCVSW-2832 (Part 2) update clframework pin to b4a44ff3aa98d2b51f1621a7525db3f81108a1bd

* Change in clframework to remove check for data format in the NE/CLReductionOperationKernel
  that was preventing a Resnet v2 50 model from running to completion

!android-nn-driver:925

Change-Id: Ia7da001dd231d97b538846b69a40165fa64d1ff3
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
5 years agoIVGCVSW-2871 Ref QuantizeLayer workload
Derek Lamberti [Mon, 25 Mar 2019 15:41:58 +0000 (15:41 +0000)]
IVGCVSW-2871 Ref QuantizeLayer workload

Change-Id: If048b2a053c542b31ae344fe0af04d9b4f40eb6d
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
5 years agoIVGCVSW-2875 Reference implementation and unit tests for Dequantize
Nattapat Chaimanowong [Fri, 29 Mar 2019 15:25:04 +0000 (15:25 +0000)]
IVGCVSW-2875 Reference implementation and unit tests for Dequantize

Change-Id: Ie4ade0519cb0bbe35dc36be6c9cd749b9171c74b
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2866 Implement RegisterDebugCallback for RefDebugWorkload
Nattapat Chaimanowong [Thu, 28 Mar 2019 10:29:12 +0000 (10:29 +0000)]
IVGCVSW-2866 Implement RegisterDebugCallback for RefDebugWorkload

Change-Id: I9144fb6b7d05561b5b8fd9db5dbe31c9257f10ca
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoMLCE-101 Deeplab v3+ (Add Tf Lite Parser Dilation Check)
Kevin May [Tue, 26 Mar 2019 11:39:19 +0000 (11:39 +0000)]
MLCE-101 Deeplab v3+ (Add Tf Lite Parser Dilation Check)

    * Add Parse Exception for convolutions without default dilation

Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I1b8f75c2d871d81161eb5378ced277438e809ba2

5 years agoIVGCVSW-2885 fix ArmnnConverter help text
Les Bell [Thu, 28 Mar 2019 12:26:46 +0000 (12:26 +0000)]
IVGCVSW-2885 fix ArmnnConverter help text

Change-Id: I2d4ee593f5bbfb4519724d28aa8b2862bf5e5c92
Signed-off-by: Les Bell <les.bell@arm.com>
5 years agoIVGCVSW-2874 Add DequantizeLayer and no-op factory method
Nattapat Chaimanowong [Thu, 28 Mar 2019 09:56:53 +0000 (09:56 +0000)]
IVGCVSW-2874 Add DequantizeLayer and no-op factory method

*Add Dequantize layer to the frontend
*Add Serializer and Deserializer for Dequantize

Change-Id: Ide2647b9e0348d599deb97e61ca4bf66e2f17fc0
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2880 Refactor order of methods
Derek Lamberti [Mon, 25 Mar 2019 16:28:44 +0000 (16:28 +0000)]
IVGCVSW-2880 Refactor order of methods

Change-Id: I1c08ea47c19477e739d7b0f35e6f97928d53d469
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
5 years agoIVGCVSW-2827: adding Validation file for TfLiteInceptionV4Quantized
Nina Drozd [Wed, 27 Mar 2019 09:33:54 +0000 (09:33 +0000)]
IVGCVSW-2827: adding Validation file for TfLiteInceptionV4Quantized

Change-Id: I209e4e4e674f486328197eda6438e93ba0c7bda6
Signed-off-by: Nina Drozd <nina.drozd@arm.com>
5 years agoIVGCVSW-2870 Serialize quantize layer
Derek Lamberti [Wed, 27 Mar 2019 16:51:31 +0000 (16:51 +0000)]
IVGCVSW-2870 Serialize quantize layer

Change-Id: I2cff85a3cb4d47aa09227a6810812a142f2aedd3
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
5 years agoIVGCVSW-2870 Support QuantizeLayer on frontend
Derek Lamberti [Mon, 25 Mar 2019 15:41:58 +0000 (15:41 +0000)]
IVGCVSW-2870 Support QuantizeLayer on frontend

Change-Id: I2014a8d801f1f222d27a80dddf4f188ddcb3a5c9
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
5 years agoIVGCVSW-2884:Add Validation.txt for TfliteInceptionV3
nikraj01 [Wed, 27 Mar 2019 10:37:34 +0000 (10:37 +0000)]
IVGCVSW-2884:Add Validation.txt for TfliteInceptionV3

Change-Id: I08fb551d27ad80e657460242f567a59303d4879b
Signed-off-by: nikraj01 <nikhil.raj@arm.com>
5 years agoIVGCVSW-2817 Inherit SerializerVisitor from the ILayerVisitor interface class
Francis Murtagh [Wed, 27 Mar 2019 10:17:21 +0000 (10:17 +0000)]
IVGCVSW-2817 Inherit SerializerVisitor from the ILayerVisitor interface class

 * Inherit SerializerVisitor from the ILayerVisitor interface
   class rather than the base class

Change-Id: If531ec6bc3ae20bfff679fbf5f7535706eac17a2
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
5 years agoIVGCVSW-2881 Remove DebugDescriptor
Nattapat Chaimanowong [Tue, 26 Mar 2019 11:03:26 +0000 (11:03 +0000)]
IVGCVSW-2881 Remove DebugDescriptor

* Also update Debug layer to use layer guid information

Change-Id: I9ec1f639299c3f855b670ff031a0e88d685cfc6b
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2832 Update CL pin to 2761c2f0b60175469e959982a25ff0abdca6c9ce
Jim Flynn [Fri, 22 Mar 2019 15:58:39 +0000 (15:58 +0000)]
IVGCVSW-2832 Update CL pin to 2761c2f0b60175469e959982a25ff0abdca6c9ce

* Removes data format check from NE and CL CopyLayerKernel to fix customer issue
  with Resnet v1 and v2 50 models failing to run
* COMPMID-2075 Fix Segfault in NELSTM (2761c2f0b60175469e959982a25ff0abdca6c9ce)
* Added include <functional> to include/armnn/Types.hpp to fix compile failure on CI

!android-nn-driver:891

Change-Id: Icbe58b7e6d3276b0e983bdd1c004906b3d0a7a6e
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
5 years agoIVGCVSW-2882 Fix include order in armnn public headers
Matthew Bentham [Mon, 25 Mar 2019 17:37:47 +0000 (17:37 +0000)]
IVGCVSW-2882 Fix include order in armnn public headers

Change-Id: I111eab934824348f5e9c1d1384be5a24546dc19a
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
5 years agoIVGCVSW-2865 add missing include of functional
Matthew Bentham [Mon, 25 Mar 2019 12:30:56 +0000 (12:30 +0000)]
IVGCVSW-2865 add missing include of functional

Change-Id: Ib110f8fe8b8980ad948d2ca22061e9d020cb33d7
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
5 years agoUse unique names for temporary files
Matthew Bentham [Wed, 20 Mar 2019 12:46:58 +0000 (12:46 +0000)]
Use unique names for temporary files

Change-Id: I06653135c5fef38a52995da6c4b6de7ba5786b6a
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
5 years agoIVGCVSW-2861 Refactor the Reference Elementwise workloads
Sadik Armagan [Mon, 25 Mar 2019 09:03:35 +0000 (09:03 +0000)]
IVGCVSW-2861 Refactor the Reference Elementwise workloads
 * Refactored Elementwise Workload into the single workload.
 * Execute() function will react based on the DataType.

Change-Id: I6d4d6a74cec150ed8cb252e70b629ed968e7093d
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
5 years agoIVGCVSW-2865 Extend IRuntime to add a new method RegisterDebugCallback(...)
Nattapat Chaimanowong [Fri, 22 Mar 2019 14:01:46 +0000 (14:01 +0000)]
IVGCVSW-2865 Extend IRuntime to add a new method RegisterDebugCallback(...)

* Made changes to LoadedNetwork and IWorkload to pass on the registered
callback function

Change-Id: I6ea10f2a299d6de8bf681c8ff36d3fbed1d6d887
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2859 Add unit tests for QSymm16 quantization
Nattapat Chaimanowong [Thu, 21 Mar 2019 11:02:13 +0000 (11:02 +0000)]
IVGCVSW-2859 Add unit tests for QSymm16 quantization

* Add quantization test under QSymm16 scheme for all layers
* Refactor existing tests to reduce code duplication

Change-Id: I66c9437b3247d78acbb4ebc2c2481f3238268038
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2694: serialize/deserialize LSTM
Jim Flynn [Tue, 19 Mar 2019 17:22:29 +0000 (17:22 +0000)]
IVGCVSW-2694: serialize/deserialize LSTM

* added serialize/deserialize methods for LSTM and tests

Change-Id: Ic59557f03001c496008c4bef92c2e0406e1fbc6c
Signed-off-by: Nina Drozd <nina.drozd@arm.com>
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
5 years agoIVGCVSW-2850 Fix Circular Dependency Issue
Sadik Armagan [Wed, 20 Mar 2019 12:28:32 +0000 (12:28 +0000)]
IVGCVSW-2850 Fix Circular Dependency Issue
 * Create the SerilizationID for fb base layer before creating inputs and connections.

Change-Id: I3dbb18e455c1fe9d7ea0fc11988ea55655ee398f
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
5 years agoIVGCVSW-2858 Add support for QSymm16 quantization
Nattapat Chaimanowong [Wed, 20 Mar 2019 11:51:14 +0000 (11:51 +0000)]
IVGCVSW-2858 Add support for QSymm16 quantization

Change-Id: Ia7c305c30c39ec0e9db447a461479be17fde250c
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2814 AllTypesAreEqualImpl handles odd num params correctly.
Derek Lamberti [Wed, 20 Mar 2019 13:07:57 +0000 (13:07 +0000)]
IVGCVSW-2814 AllTypesAreEqualImpl handles odd num params correctly.

Change-Id: I9b661cabab41f6997dac808cca15995834bb0313
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
5 years agoIVGCVSW-2814 Extensive ref IsSupported for Activation & Addition
Derek Lamberti [Wed, 13 Mar 2019 14:16:15 +0000 (14:16 +0000)]
IVGCVSW-2814 Extensive ref IsSupported for Activation & Addition

Change-Id: Ib1a795eb129de1ec3f02807a2dff7613d7c6c28d
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
5 years agoIVGCVSW-2788 Modify Serializer test to use introspection API
Nattapat Chaimanowong [Wed, 20 Mar 2019 11:19:52 +0000 (11:19 +0000)]
IVGCVSW-2788 Modify Serializer test to use introspection API

Change-Id: Ie97012b42cd7847a437dd9f21c9b59179b2e7897
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2839 Add QuantisedSymm16 support to the ArmNN frontend
Nattapat Chaimanowong [Tue, 19 Mar 2019 12:26:36 +0000 (12:26 +0000)]
IVGCVSW-2839 Add QuantisedSymm16 support to the ArmNN frontend

Change-Id: I76f4e7db55b0efbb1a5f7d1a32bf451e66add0c7
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoMLCE-105 Fix use of std::unique_lock in LoadedNetwork
Matthew Bentham [Tue, 19 Mar 2019 10:11:01 +0000 (10:11 +0000)]
MLCE-105 Fix use of std::unique_lock in LoadedNetwork

You can't use a unique_lock to check lock ownership by a
particular thread - it just checks whether the mutex
is locked by that lock.

Change-Id: I28190dc3bea91b3cc68f9b9381751e70fd70f43f
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
5 years agoIVGCVSW-2686 Add Serializer and Deserializer for DetectionPostProcess
Nattapat Chaimanowong [Mon, 18 Mar 2019 12:37:06 +0000 (12:37 +0000)]
IVGCVSW-2686 Add Serializer and Deserializer for DetectionPostProcess

Change-Id: Ife48db5fdb005ebca0a6f21862b0ce971ccf58b7
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2354 Caffe SqueezeNet through armnn Cl and Neon
Narumol Prangnawarat [Thu, 14 Mar 2019 11:55:03 +0000 (11:55 +0000)]
IVGCVSW-2354 Caffe SqueezeNet through armnn Cl and Neon

 * Compute Softmax Acl axis for Cl and Neon
 * Add unittests for Softmax in 3D and 4D
 * Correct input and output layer names in CaffeSqueezeNet inference test

Change-Id: I2d369d9a2db19c40f2af3341039dd33f0c5637b1
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
5 years agoIVGCVSW-2429 Add Detection PostProcess Parser to TensorFlow Lite Parser
keidav01 [Thu, 14 Mar 2019 17:12:10 +0000 (17:12 +0000)]
IVGCVSW-2429 Add Detection PostProcess Parser to TensorFlow Lite Parser

    * Add helper function to generate custom data for detectPostProcess
    * Test helper function within current test suite

Change-Id: I9e66d0a28d69b1376da67723f03b112d17e97281
Signed-off-by: keidav01 <keith.davis@arm.com>
Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
5 years agoIVGCVSW-2574 Create a converter application for all the supported ArmNN Networks
Sadik Armagan [Wed, 13 Mar 2019 18:33:10 +0000 (18:33 +0000)]
IVGCVSW-2574 Create a converter application for all the supported ArmNN Networks

 * Added Caffe, TfLite and Onnx support to ArmnnConverter

Change-Id: I9807064152f23a24d280118dbed0396eb7d47420
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
5 years agoIVGCVSW-2735 Failure to find flatbuffers is not a fatal build error
Ruomei Yan [Fri, 8 Mar 2019 17:50:25 +0000 (17:50 +0000)]
IVGCVSW-2735 Failure to find flatbuffers is not a fatal build error

!referencetests:176231

Change-Id: Ic8a641507c6af2f38e535b0208eb406e74a334a1
Signed-off-by: Ruomei Yan <ruomei.yan@arm.com>
5 years agoIVGCVSW-2709 Serialize / de-serialize the Splitter layer
Jim Flynn [Fri, 8 Mar 2019 11:08:30 +0000 (11:08 +0000)]
IVGCVSW-2709 Serialize / de-serialize the Splitter layer

* fixed typo in Ref Merger Workload comment
* fixed typo in ViewsDescriptor comment
* made the origins descriptor accessable in the ViewsDescriptor
  (needed for serialization)
* based the unit test on the use of the splitter in the CaffeParser

Change-Id: I3e716839adb4eee5a695633377b49e7e18ec2aa9
Signed-off-by: Ferran Balaguer <ferran.balaguer@arm.com>
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
5 years agoIVGCVSW-2800 Update CL pin to latest master
Conor Kennedy [Fri, 8 Mar 2019 10:55:32 +0000 (10:55 +0000)]
IVGCVSW-2800 Update CL pin to latest master

Change-Id: Id04be4950e09452a056883ba68e9dcf0c6f4ee2d
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com>
5 years agoIVGCVSW-2792 Update Neon Mul/Sub workload for latest CL master
Conor Kennedy [Fri, 8 Mar 2019 08:24:41 +0000 (08:24 +0000)]
IVGCVSW-2792 Update Neon Mul/Sub workload for latest CL master

* Update Neon Subtraction/Multiplication to use BaseWorkload
* Add Uint8 tests for Subtraction/Multiplication

Change-Id: Ied2aa048924817a4db0025b9bd9e54151667bd74
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com>
5 years agoIVGCVSW-2769 Don't process node if already visited
Derek Lamberti [Thu, 28 Feb 2019 09:30:16 +0000 (09:30 +0000)]
IVGCVSW-2769 Don't process node if already visited

Change-Id: I1eb06a044ea702fce00910d84fd20a680c03f1cc
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
5 years agoIVGCVSW-2693 Serialize/de-serialize L2Normalization
Narumol Prangnawarat [Thu, 7 Mar 2019 17:31:34 +0000 (17:31 +0000)]
IVGCVSW-2693 Serialize/de-serialize L2Normalization

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I6a53ac576260383f32fb0d878b42d1251ffde94a

5 years agoIVGCVSW-2697 Add Serialize/Deserialize for the Merger Layer
Jim Flynn [Thu, 28 Feb 2019 10:40:49 +0000 (10:40 +0000)]
IVGCVSW-2697 Add Serialize/Deserialize for the Merger Layer

* Force generation of schema header in every build
* Also fixed typo in OriginsDescriptor comment (Descriptors.hpp)
* Added Serialize/Deserialize check on Addition Layer
* Added Serialize/Deserialize check on Floor Layer
* Added Serialize/Deserialize check on Minimum Layer
* Added Serialize/Deserialize check on Maximum Layer
* Added Serialize/Deserialize check on Multiplication Layer
* Added Serialize/Deserialize check on Division Layer

Change-Id: I1358ea4db7ca506d8bcec2ee64e1fbad6005e723
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
5 years agoIVGCVSW-2783 Fix Deserializer connections for layer with multiple outputs
Nattapat Chaimanowong [Mon, 4 Mar 2019 17:10:40 +0000 (17:10 +0000)]
IVGCVSW-2783 Fix Deserializer  connections for layer with multiple outputs

Change-Id: Icb278dfd8900334665432963fa6f6341a461ef3b
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2696 Serialize / de-serialize the Mean layer
Sadik Armagan [Mon, 4 Mar 2019 17:44:21 +0000 (17:44 +0000)]
IVGCVSW-2696 Serialize / de-serialize the Mean layer

Change-Id: Iee4bab5a6d6b992cf4bba8697a2918f854c906a3
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
5 years agoIVGCVSW-2689 Fix Floor Deserilizer discarding layer name
Nattapat Chaimanowong [Tue, 5 Mar 2019 17:35:28 +0000 (17:35 +0000)]
IVGCVSW-2689 Fix Floor Deserilizer discarding layer name

Change-Id: Ic402041b18654e008473893f30f2d6f8ee9535fd
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2691 Add Serialize/Deseralize Gather layer
Matteo Martincigh [Mon, 4 Mar 2019 14:34:30 +0000 (14:34 +0000)]
IVGCVSW-2691 Add Serialize/Deseralize Gather layer

Change-Id: I445c4475e5abfe500b61ce8b7138c45322043c8b
Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
5 years agoIVGCVSW-2681 Fix layer name in BatchNormalization deserialization
ruoyan01 [Mon, 4 Mar 2019 14:48:02 +0000 (14:48 +0000)]
IVGCVSW-2681 Fix layer name in BatchNormalization deserialization

Change-Id: Iec43db205d77dc9864abe1fe85104722a6954d57
Signed-off-by: Ruomei Yan <ruomei.yan@arm.com>
5 years agoIVGCVSW-2691 Add Serialize/Deseralize Gather layer
Saoirse Stewart [Mon, 4 Mar 2019 13:40:12 +0000 (13:40 +0000)]
IVGCVSW-2691 Add Serialize/Deseralize Gather layer

Change-Id: I589d37c9f65801b701858d6e68e2e3151fac6e16
Signed-off-by: Saoirse Stewart <saoirse.stewart@arm.com>
5 years agoIVGCVSW-2710 Add Serializer and Deserializer for StridedSlice
Nattapat Chaimanowong [Mon, 4 Mar 2019 12:35:39 +0000 (12:35 +0000)]
IVGCVSW-2710 Add Serializer and Deserializer for StridedSlice

Change-Id: I6e8198a2aa5f8c56f00ccf9b4d98fcd208755654
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2711 Add Serializer and Deserializer for Subtraction
Conor Kennedy [Fri, 1 Mar 2019 14:37:12 +0000 (14:37 +0000)]
IVGCVSW-2711 Add Serializer and Deserializer for Subtraction

Change-Id: I87836b5314c1f791b4df2ca90d239573ca28a2da
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com>
Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
5 years agoIVGCVSW-2705 Add Serializer and Deserializer for ResizeBilinear
Nattapat Chaimanowong [Fri, 1 Mar 2019 16:14:13 +0000 (16:14 +0000)]
IVGCVSW-2705 Add Serializer and Deserializer for ResizeBilinear

Change-Id: Ibc5689a2e00d38dc98ef39e50ed5dc3b91791e16
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2692 Add Serializer and Deserializer for Greater
Conor Kennedy [Fri, 1 Mar 2019 14:24:54 +0000 (14:24 +0000)]
IVGCVSW-2692 Add Serializer and Deserializer for Greater

Change-Id: I344a1f36a8a4ab601dd4d62a0014c554ceb6a1c6
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com>
5 years agoIVGCVSW-2681 Serialize/de-serialize the BatchNormalization layer
ruoyan01 [Thu, 28 Feb 2019 15:09:07 +0000 (15:09 +0000)]
IVGCVSW-2681 Serialize/de-serialize the BatchNormalization layer

Change-Id: I418c4465366742262fb6e6c1eeba76c634beaeb5
Signed-off-by: ruoyan01 <ruomei.yan@arm.com>
5 years agoIVGCVSW-2689 Serialize / de-serialize the Floor layer
Finn Williams [Fri, 1 Mar 2019 11:51:52 +0000 (11:51 +0000)]
IVGCVSW-2689 Serialize / de-serialize the Floor layer

Change-Id: I61177a999092195fbdfdcf810d289969252dd365
Signed-off-by: Finn Williams <finn.williams@arm.com>
5 years agoIVGCVSW-2706 Serialize / de-serialize the Rsqrt layer
Sadik Armagan [Fri, 1 Mar 2019 14:24:49 +0000 (14:24 +0000)]
IVGCVSW-2706 Serialize / de-serialize the Rsqrt layer

Change-Id: Ic1cfa0833c3531c743ba2d2f277fd70086357119
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
5 years agoIVGCVSW-2701 Add Serializer and Deserializer for Pad
Nattapat Chaimanowong [Fri, 1 Mar 2019 12:14:06 +0000 (12:14 +0000)]
IVGCVSW-2701 Add Serializer and Deserializer for Pad

Change-Id: I71184236f0394518f29944a77d4b934cbde9e53d
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2700 Serialize/de-serialize the Normalization layer
Nina Drozd [Wed, 27 Feb 2019 10:53:27 +0000 (10:53 +0000)]
IVGCVSW-2700 Serialize/de-serialize the Normalization layer

Change-Id: Ib307ec6c28beb6c158d337678e67a2484c495a06
Signed-off-by: Nina Drozd <nina.drozd@arm.com>
5 years agoIVGCVSW-2695 Serialize / deserialize the Maximum layer
Aron Virginas-Tar [Wed, 27 Feb 2019 14:42:31 +0000 (14:42 +0000)]
IVGCVSW-2695 Serialize / deserialize the Maximum layer

Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
Change-Id: I6c89a40b1fc00699a048efb26966142517c3ff43

5 years agoIVGCVSW-2688 Add Serializer and Deserializer for Equal
Nattapat Chaimanowong [Thu, 28 Feb 2019 16:27:30 +0000 (16:27 +0000)]
IVGCVSW-2688 Add Serializer and Deserializer for Equal

Change-Id: If613f4394e161483eea4930dab2afba74c5e26fd
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2698 Serialize / deserialize the Minimum layer
Aron Virginas-Tar [Thu, 28 Feb 2019 13:12:47 +0000 (13:12 +0000)]
IVGCVSW-2698 Serialize / deserialize the Minimum layer

Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
Change-Id: I8a931c920ff38506c210e9369b81fae150096776

5 years agoIVGCVSW-2765 Modify ParserFlatBuffersSerilizeFixture to accept different output type
Nattapat Chaimanowong [Wed, 27 Feb 2019 17:27:16 +0000 (17:27 +0000)]
IVGCVSW-2765 Modify ParserFlatBuffersSerilizeFixture to accept different output type

Change-Id: Ia61e25e7375f7c58db6b0cf6389af151ac004f4c
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2763 Fix bug in BatchToSpaceNdLayer::InferOutputShapes
Nattapat Chaimanowong [Wed, 27 Feb 2019 10:28:09 +0000 (10:28 +0000)]
IVGCVSW-2763 Fix bug in BatchToSpaceNdLayer::InferOutputShapes

*Also added test case for non-zero crop and moved BatchToSpaceNd test
functions together

Change-Id: I142ba356165618b2811a4ab650ca6ced35220d9c
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2766 Modify CheckDeserializedNetworkAgainstOriginal to work with multiple...
Nattapat Chaimanowong [Wed, 27 Feb 2019 16:52:29 +0000 (16:52 +0000)]
IVGCVSW-2766 Modify CheckDeserializedNetworkAgainstOriginal to work with multiple inputs and outputs

Change-Id: I90d1701d5bfd8ced32720e495e0126de0014aff9
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2687 Add Serializer & Deserializer for Division
Éanna Ó Catháin [Wed, 27 Feb 2019 16:16:39 +0000 (16:16 +0000)]
IVGCVSW-2687 Add Serializer & Deserializer for Division

Change-Id: I230220eccbfb22e56e8d351cc963988d734836ac
Signed-off-by: Éanna Ó Catháin <eanna.ocathain@arm.com>
5 years agoIVGCVSW-2598 Update attribute to use num_split
Saoirse Stewart [Thu, 28 Feb 2019 11:32:41 +0000 (11:32 +0000)]
IVGCVSW-2598 Update attribute to use num_split

Change-Id: I5de0e0a2de9241498213d274a6bf2a62ba7da7cc
Signed-off-by: Saoirse Stewart <saoirse.stewart@arm.com>
5 years agoIVGCVSW-2682 Add Serializer and Deserializer for BatchToSpaceNd
Nattapat Chaimanowong [Tue, 26 Feb 2019 17:24:13 +0000 (17:24 +0000)]
IVGCVSW-2682 Add Serializer and Deserializer for BatchToSpaceNd

Change-Id: I8b8ac99b4ecf282b796a8af4b30594ade4e061e6
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2752 Make biases optional in INetwork
Aron Virginas-Tar [Fri, 22 Feb 2019 17:03:44 +0000 (17:03 +0000)]
IVGCVSW-2752 Make biases optional in INetwork

* Added new version of AddConvolution2dLayer, AddDepthwiseConvolution2dLayer
  and AddFullyConnectedLayer with Optional<ConstTensor> biases
* Deprecated old AddConvolution2dLayer, AddDepthwiseConvolution2dLayer
  and AddFullyConnectedLayer methods
* Made necessary changes to implementation functions

Change-Id: I65eddb28dc72a9c74429c331815a96c2bfdc8c51
Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
5 years agoIVGCVSW-2759 Add MakeOptional to enable in-place optional object construction
Aron Virginas-Tar [Fri, 22 Feb 2019 17:08:36 +0000 (17:08 +0000)]
IVGCVSW-2759 Add MakeOptional to enable in-place optional object construction

* Added new argument-forwarding in-place constructor to Optional
* Added MakeOptional utility template to allow for efficient construction
  of optional objects

Change-Id: Iec9067fc5c3e109a26c4cc2fe8468260637b66c5
Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
5 years agoIVGCVSW-2598 Fix for constant axis issue for Tensorflow Parser
Saoirse Stewart [Wed, 27 Feb 2019 11:07:57 +0000 (11:07 +0000)]
IVGCVSW-2598 Fix for constant axis issue for Tensorflow Parser

Change-Id: I8b081012529aed8e434273259c5a5ef7dc3afff7
Signed-off-by: Finn Williams <finn.williams@arm.com>
Signed-off-by: Saoirse Stewart <saoirse.stewart@arm.com>
5 years agoIVGCVSW-2764 Strengthen test for thread-safety in Profiler
Matthew Bentham [Wed, 27 Feb 2019 11:51:40 +0000 (11:51 +0000)]
IVGCVSW-2764 Strengthen test for thread-safety in Profiler

Replace assert with explicit conditions so that the checks
are correctly performed in release builds.

Change-Id: Id69ab3cc0aa8c61021642b7250e30c255f144a3a
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
5 years agoIVGCVSW-2632 Fix RefMerger from QAsymm8 types with different quantization parameters
Ferran Balaguer [Wed, 27 Feb 2019 09:42:06 +0000 (09:42 +0000)]
IVGCVSW-2632 Fix RefMerger from QAsymm8 types with different quantization parameters

Change-Id: Ie67ce4966c5e5fef618876b027292da429de1485
Signed-off-by: Ferran Balaguer <ferran.balaguer@arm.com>
5 years agoIVGCVSW-2560 Add support of SSD MobileNet to TensorFlowLiteSupport.md
Narumol Prangnawarat [Tue, 26 Feb 2019 17:51:08 +0000 (17:51 +0000)]
IVGCVSW-2560 Add support of SSD MobileNet to TensorFlowLiteSupport.md

 * Add support for Custom operator - TFLite_Detection_PostProcess
 * Add Quantized SSD MobileNet to tested networks

Change-Id: Id7e729ed02dbc401638b9832c8b9b5d71a6d31b7
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
5 years agoIVGCVSW-2560 Verify Inference test for TensorFlow Lite MobileNet SSD
Narumol Prangnawarat [Mon, 25 Feb 2019 17:26:05 +0000 (17:26 +0000)]
IVGCVSW-2560 Verify Inference test for TensorFlow Lite MobileNet SSD

 * Assign output shape of MobileNet SSD to ArmNN network
 * Add m_OverridenOutputShapes to TfLiteParser to set shape in GetNetworkOutputBindingInfo
 * Use input quantization instead of output quantization params
 * Correct data and datatype in Inference test

Change-Id: I01ac2e07ed08e8928ba0df33a4847399e1dd8394
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
5 years agoIVGCVSW-2708 Add Serializer and Deserializer SpaceToBatchNd
Nattapat Chaimanowong [Tue, 26 Feb 2019 15:53:02 +0000 (15:53 +0000)]
IVGCVSW-2708 Add Serializer and Deserializer SpaceToBatchNd

Change-Id: I14f2a660654dc87939fe413fafa9384f09594f68
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2429 Add Detection PostProcess Parser to TensorFlow Lite Parser
keidav01 [Tue, 26 Feb 2019 11:57:39 +0000 (11:57 +0000)]
IVGCVSW-2429 Add Detection PostProcess Parser to TensorFlow Lite Parser

    * Added additional custom option use_regular_nms to JSON string
    * Renamed use_regular_non_max_suppression to use_regular_nms in parser

Change-Id: I5431eabade6337f6f8c3372670862e32e9cda63c
Signed-off-by: keidav01 <keith.davis@arm.com>
5 years agoIVGCVSW-2683 Add Serializer & Deserializer for Constant
Conor Kennedy [Tue, 26 Feb 2019 08:29:54 +0000 (08:29 +0000)]
IVGCVSW-2683 Add Serializer & Deserializer for Constant

Change-Id: Iad7d89dfa963d9015cbe044f67aecc8bf6634b10
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com>
5 years agoIVGCVSW-2629 Adding support for uint8 in ExecuteNetwork to fix issues with output...
Éanna Ó Catháin [Tue, 26 Feb 2019 11:26:24 +0000 (11:26 +0000)]
IVGCVSW-2629 Adding support for uint8 in ExecuteNetwork to fix issues with output tensor being all zero

Change-Id: I4da1ffd684672fff0853fb053c3340d06a3bc165
Signed-off-by: Éanna Ó Catháin <eanna.ocathain@arm.com>
5 years agoIVGCVSW-2756 Fix bug in ClSpaceToBatchNdWorkload
Nattapat Chaimanowong [Tue, 26 Feb 2019 12:26:08 +0000 (12:26 +0000)]
IVGCVSW-2756 Fix bug in ClSpaceToBatchNdWorkload

*Padding was not in format expected by Cl

Change-Id: Id0de3fd2b306e31d555e2d67bc4406e5302dcd3b
Signed-off-by: Nattapat Chaimanowong <nattapat.chaimanowong@arm.com>
5 years agoIVGCVSW-2525 *Update TfLite supported operator list
Derek Lamberti [Tue, 26 Feb 2019 10:49:52 +0000 (10:49 +0000)]
IVGCVSW-2525 *Update TfLite supported operator list

Change-Id: Ia349d71ec966b37feaffb971c7a77bf8cd44501c
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
5 years agoIVGCVSW-2751 When layers are Deserialized the layer name is lost
Éanna Ó Catháin [Mon, 25 Feb 2019 16:26:29 +0000 (16:26 +0000)]
IVGCVSW-2751 When layers are Deserialized the layer name is lost

 * Fixed defect
 * Added unit tests to check names

Change-Id: I67211110b90aabff6e00bccdadd1145423b07523
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Signed-off-by: Éanna Ó Catháin <eanna.ocathain@arm.com>
5 years agoRename ArmNN schema file to ArmnnSchema.fbs
Matthew Bentham [Mon, 25 Feb 2019 13:58:24 +0000 (13:58 +0000)]
Rename ArmNN schema file to ArmnnSchema.fbs

This makes the header file change to ArmnnSchema_generated.h,
which is then unambiguous with respect to other generated schema files.

Change-Id: Id7785ed74cced4dcd4d6bcbab81e53c6aeba973c
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
5 years agoIVGCVSW-2762 Fix missing layer name and output slot index in DebugLayer output
Aron Virginas-Tar [Mon, 25 Feb 2019 14:12:46 +0000 (14:12 +0000)]
IVGCVSW-2762 Fix missing layer name and output slot index in DebugLayer output

Change-Id: Idda9c8ba244c74d931105ced90c38a12d48df48a
Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
5 years agoAdd strided-slice parser to tf-lite
Bruno Goncalves [Wed, 13 Feb 2019 00:59:22 +0000 (22:59 -0200)]
Add strided-slice parser to tf-lite

Change-Id: I1821d7e8123c76823562dd2e8822c5293fcb18c3
Signed-off-by: Bruno Goncalves <bruno.slackware@gmail.com>
5 years agoIVGCVSW-2757 Add check for wrong number of components supplied to const tensor
Saoirse Stewart [Mon, 25 Feb 2019 09:22:58 +0000 (09:22 +0000)]
IVGCVSW-2757 Add check for wrong number of components supplied to const tensor

Change-Id: Ia9bc6c73ce246712c41496a1cfe0bb6a1d2eb8e9
Signed-off-by: Saoirse Stewart <saoirse.stewart@arm.com>