platform/upstream/armnn.git
4 years agoUpdate ACL pin to 4b869532f8b2aa7f02aa55c4f4813e994ea2df68
Nikhil Raj [Fri, 27 Mar 2020 11:59:10 +0000 (11:59 +0000)]
Update ACL pin to 4b869532f8b2aa7f02aa55c4f4813e994ea2df68

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I6e0474d88fcfed8812d7a1b565e09b12256b9956

4 years agoIVGCVSW-4555 ArmnnConverter (Serializer) does not support per-axis quantization params
Sadik Armagan [Fri, 27 Mar 2020 15:56:57 +0000 (15:56 +0000)]
IVGCVSW-4555 ArmnnConverter (Serializer) does not support per-axis quantization params

* TensorInfo can have multiple scales and quantization dimension.

Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I0ff02e3766996b6a9da6dc4e92d366bc9505c77d

4 years agoIVGCVSW-4597 Modify BF16 optimizer to Convert only inputs and weights of
Narumol Prangnawarat [Thu, 26 Mar 2020 09:20:43 +0000 (09:20 +0000)]
IVGCVSW-4597 Modify BF16 optimizer to Convert only inputs and weights of
Convolution2d and FullyConnected layers

 * Add InsertConvertFp32ToBf16LayersBefore
 * Add ConvertWeight to ConvertFp32NetworkToBf16Impl for Conv2d and FullyConnected
 * Allow different input and output when input is BF16 and output is FP32
Conv2d and FullyConnected layers
 * Unit tests

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ic8f92ff28edcae08a72a3114a28f50c4619f919b

4 years agoUpdate ACL pin to 1b14c75c0d591c4abe4d2d41b7e4e165fbf58382
Nikhil Raj [Thu, 26 Mar 2020 14:55:42 +0000 (14:55 +0000)]
Update ACL pin to 1b14c75c0d591c4abe4d2d41b7e4e165fbf58382

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I1d255e21f3786bc5afb1aec71cab6e523e5e4ac9

4 years agoIVGCVSW-4599 ArmNN Compile Error when compiled against gcc 9
Francis Murtagh [Thu, 26 Mar 2020 12:14:21 +0000 (12:14 +0000)]
IVGCVSW-4599 ArmNN Compile Error when compiled against gcc 9

 * Use default keyword for armnn::Optional assignment.
 * Use default keyword for BFloat16 copy constructor and assignment.
 * Remove unnecessary const from static_cast template argument which
   was giving ignored-qualifiers warning.

Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: Ie3f4ce0a0c199a578d8cca2fea8f5dcef63dba4d

4 years agoIVGCVSW-4526 Fix UnitTest errors when running on raspberry pi
Jan Eilers [Thu, 26 Mar 2020 12:04:54 +0000 (12:04 +0000)]
IVGCVSW-4526 Fix UnitTest errors when running on raspberry pi

* The std::thread::id is included in some timeline packages of the
profiler. But the size of thread::id is platform dependent. That's why
some tests expected a wrong package size

Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I4794ebbdda2d75ed5be7112f6a3bf2e5f14f221b

4 years agoIVGCVSW-4589 Add timeline tests to Mock Gatord end to end test
Finn Williams [Mon, 23 Mar 2020 18:01:49 +0000 (18:01 +0000)]
IVGCVSW-4589 Add timeline tests to Mock Gatord end to end test

Change-Id: I500f82e9fff881e0a49aa5a7cc580c6c4923d33c
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
4 years agoUpdate ACL pin to 51a9558d484e812707a776efceef18b93698cec9
Nikhil Raj [Wed, 25 Mar 2020 11:40:05 +0000 (11:40 +0000)]
Update ACL pin to 51a9558d484e812707a776efceef18b93698cec9

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I114dff0427b9ae6f49b3138e78ade97d07684fd1

4 years agoIVGCVSW-4521 Add bf16-turbo-mode option to ExecuteNetwork
Narumol Prangnawarat [Tue, 24 Mar 2020 13:54:05 +0000 (13:54 +0000)]
IVGCVSW-4521 Add bf16-turbo-mode option to ExecuteNetwork

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I57ec47adf98680254fa481fb91d5a98dea8f032e

4 years agoIVGCVSW-4596 Fix BufferManager's packet order
Finn Williams [Tue, 24 Mar 2020 13:46:22 +0000 (13:46 +0000)]
IVGCVSW-4596 Fix BufferManager's packet order

Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I35e0a891cd69f2c130b8886460089c441d8e666d

4 years agoIVGCVSW-3813 Add Unary Elementwise Operation 'NEG' support to the android-nn-driver
Sadik Armagan [Tue, 24 Mar 2020 09:54:36 +0000 (09:54 +0000)]
IVGCVSW-3813 Add Unary Elementwise Operation 'NEG' support to the android-nn-driver

* Implemented ClNegWorkload
* Implemented NeonNegWorkload
* Enabled 'NEG' operator on CL and Neon as well as Ref
* Implemented unit tests for 'NEG' operator

Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I3d7a892692716636cae6bdf8ddd238e3d1ea064f

4 years agoUpdate ACL pin to 689c968239180eda4263e34c3d450093d4a0450d
Nikhil Raj [Tue, 24 Mar 2020 10:00:12 +0000 (10:00 +0000)]
Update ACL pin to 689c968239180eda4263e34c3d450093d4a0450d

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I2f72b559594c227e2c5181fb9ec22a776ec9dcb1

4 years agoUpdate ACL pin to 6cd1c9bc312b65137da52a973489ba6a0f0180e3
Nikhil Raj [Mon, 23 Mar 2020 14:34:41 +0000 (14:34 +0000)]
Update ACL pin to 6cd1c9bc312b65137da52a973489ba6a0f0180e3

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I0d9b2ba0d3f2569baf6fc824f06a9c1412f2814e

4 years agoIVGCVSW-4520 Implement BFloat16 Optimizer
Narumol Prangnawarat [Fri, 20 Mar 2020 15:01:01 +0000 (15:01 +0000)]
IVGCVSW-4520 Implement BFloat16 Optimizer

 * Add ReduceFp32ToBf16 to OptimizerOptions
 * Add ConvertFp32NetworkToBf16
 * Add utility functions to insert conversion layers
 * Add constant conversion BF16 <-> FP32
 * Unit tests

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Iaff77e20c721400b052cb37eb9ef6fe16d7abaff

4 years agoIVGCVSW-4589 Add call to SendWellKnownLabelsAndEventClasses
Finn Williams [Fri, 20 Mar 2020 15:10:59 +0000 (15:10 +0000)]
IVGCVSW-4589 Add call to SendWellKnownLabelsAndEventClasses

Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: Ia42f962ba53d7684f5ad75f5b1b91e2d9f3a2f9c

4 years agoIVGCVSW-4549 Add front end for new QLSTM layer
James Conroy [Fri, 20 Mar 2020 08:49:33 +0000 (08:49 +0000)]
IVGCVSW-4549 Add front end for new QLSTM layer

* Added new layer QLstm (Android R HAL 1.3)
* Made necessary updates to APIs
* Added unit tests
* This layer is functionally equivalent to the
  original unquantized LSTM layer with some
  additonal quantization features added. Due
  to this, original LstmParams are used for
  this layer.

Signed-off-by: James Conroy <james.conroy@arm.com>
Change-Id: I5b7f2d2fb6e17e81573b41a31bc55f49ae79608f

4 years agoIVGCVSW-4588 Remove short form of option file-format
Nikhil Raj [Fri, 20 Mar 2020 11:13:48 +0000 (11:13 +0000)]
IVGCVSW-4588 Remove short form of option file-format

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I90bbe9406d81320289d9878700d738f6b33d8a94

4 years agoIVGCVSW-4587 ArmNN failing to build in the Internal OOB
Sadik Armagan [Fri, 20 Mar 2020 11:11:01 +0000 (11:11 +0000)]
IVGCVSW-4587 ArmNN failing to build in the Internal OOB

* ProfilingService reference field not required in TimelineUtilityMethods

Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I83ca13e577d35fb9497d7df1535607ec66c201bf

4 years agoIVGCVSW-4582 Undefined reference to GetProfilingService causes failure in the Backend...
Sadik Armagan [Thu, 19 Mar 2020 18:16:46 +0000 (18:16 +0000)]
IVGCVSW-4582 Undefined reference to GetProfilingService causes failure in the Backends CI job

* Enable the GetProfilingService() function to BackendProfilingTests and ProfilingTestUtils

Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I32e3625db0f465883f2ec27fb7c2fad4e91b6306

4 years agoIVGCVSW-4565 TENSOR_BOOL8 data type not supported in AndroidNN Driver
Sadik Armagan [Thu, 19 Mar 2020 13:53:16 +0000 (13:53 +0000)]
IVGCVSW-4565 TENSOR_BOOL8 data type not supported in AndroidNN Driver

* Enabled Boolean and Int32 data types in Reference Comparison inputs
* Added decoder for Boolean data type
* Refactored ClGreaterWorkload to work with any data type
* Refactored NeonGreaterWorkload to work with any data type

!android-nn-driver:2902

Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I92772810b744b388831c9dca0119ebf8cb7a447e

4 years agoMLECO-755: ArmNN: Add file format external profiling option
Isabella Gottardi [Wed, 11 Mar 2020 18:04:20 +0000 (18:04 +0000)]
MLECO-755: ArmNN: Add file format external profiling option

* Added new m_FileFormat variable in ExternalProfilingOptions
* Added new profiling option to ExecuteNetwork
* Added check for file format in ProfilingConnectionFactory
* Added test in profiling tests

Change-Id: I0e9cb8ecac919dc0ed03dcf77324a65621f07ae7
Signed-off-by: Isabella Gottardi <isabella.gottardi@arm.com>
4 years agoIVGCVSW-4516 Add ConvertFp32ToBf16Layer and Ref workload support
Narumol Prangnawarat [Mon, 16 Mar 2020 16:36:10 +0000 (16:36 +0000)]
IVGCVSW-4516 Add ConvertFp32ToBf16Layer and Ref workload support

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I9099a4f840fb747336f77d20a0868b64e801a310

4 years agoIVGCVSW-4553 Fix Wrapper Object Use after free in UnitTests.hpp
Finn Williams [Wed, 18 Mar 2020 14:20:37 +0000 (14:20 +0000)]
IVGCVSW-4553 Fix Wrapper Object Use after free in UnitTests.hpp

Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I174f83c9a454b5499f817baf0bddcd4a49cac523

4 years agoIVGCVSW-4552 Fix Wrapper Object Use after free in ProfilerTests
Finn Williams [Wed, 18 Mar 2020 12:51:43 +0000 (12:51 +0000)]
IVGCVSW-4552 Fix Wrapper Object Use after free in ProfilerTests

Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I84ab68c048675a39a67045430b2dde571b45e479

4 years agoIVGCVSW-4446 Add HardSwish EndToEnd tests
Jan Eilers [Wed, 18 Mar 2020 15:58:11 +0000 (15:58 +0000)]
IVGCVSW-4446 Add HardSwish EndToEnd tests

* adds convert from armnn HardSwish to Acl HardSwish
* adds EndToEnd tests for Ref, Cl and Neon

Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: If997dad783ff45d7f061254e7e30bb69d4d4d564

4 years agoIVGCVSW-4444 Adding Elu end to end test
Jan Eilers [Wed, 11 Mar 2020 12:52:46 +0000 (12:52 +0000)]
IVGCVSW-4444 Adding Elu end to end test

* implemented activation layer end to end test
* adds support for different tolerances in layer tests
* added tests for Elu (Ref, Cl, Neon)

Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I81e28cfb4456e815bae2fb31f5c345134ff2432f

4 years agoIVGCVSW-4463 Change ProfilingService to a member of runtime from a singleton
Sadik Armagan [Wed, 18 Mar 2020 10:57:30 +0000 (10:57 +0000)]
IVGCVSW-4463 Change ProfilingService to a member of runtime from a singleton

Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I345c39a10a4693a500aa1687d9a5cee76da791c3

4 years agoIVGCVSW-4161 Provide for per model call back registration
Finn Williams [Thu, 27 Feb 2020 16:21:41 +0000 (16:21 +0000)]
IVGCVSW-4161 Provide for per model call back registration

!armnn:2810

Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: Idf56d42bd767baa5df0059a2f489f75281f8ac71

4 years agoUpdate ACL pin to fd7780d910f3bc4c85bc95b57ea3dd4375d95d41
Nikhil Raj [Wed, 18 Mar 2020 10:00:00 +0000 (10:00 +0000)]
Update ACL pin to fd7780d910f3bc4c85bc95b57ea3dd4375d95d41

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I83bf33aeec93326b9b2c99db4e5151404df5bb30

4 years agoIVGCVSW-4515 Add ConvertBf16ToFp32Layer and Ref workload support
Narumol Prangnawarat [Fri, 13 Mar 2020 10:26:05 +0000 (10:26 +0000)]
IVGCVSW-4515 Add ConvertBf16ToFp32Layer and Ref workload support

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ida6d7e1d2c9abe0618f8b711bab9d62c011090d6

4 years agoIVGCVSW-4545 Relax check on ParseReshape
Derek Lamberti [Tue, 17 Mar 2020 14:25:57 +0000 (14:25 +0000)]
IVGCVSW-4545 Relax check on ParseReshape

Change-Id: Icae7c40abb307e1bbdd383ab3f835f5a1bee2db1
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
4 years agoMLCE-161: Added support for NormalizationLayer in ArmnnQuantizer.
Pablo Tello [Thu, 12 Mar 2020 10:58:39 +0000 (10:58 +0000)]
MLCE-161: Added support for NormalizationLayer in ArmnnQuantizer.

* Improved error reporting by using VisitorThrowingPolicy in
   DynamicQuantizationVisitor.

Change-Id: I8a7d0975d448e6c2b6efb5f315ac255eec29f7a2
Signed-off-by: Pablo Tello <pablo.tello@arm.com>
4 years agoUpdate ACL pin 0ec53a0e54ae0be0ed9c4e4c14a5fd10ed5f48a8 (COMPMID-3238)
Nikhil Raj [Mon, 16 Mar 2020 09:45:43 +0000 (09:45 +0000)]
Update ACL pin 0ec53a0e54ae0be0ed9c4e4c14a5fd10ed5f48a8 (COMPMID-3238)

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I035b3aeef778cd415224e9238f463bc706c00080

4 years agoIVGCVSW-4531 Fix for failing strided slice NNT/VTS tests on Android R
David Monahan [Fri, 13 Mar 2020 07:52:54 +0000 (07:52 +0000)]
IVGCVSW-4531 Fix for failing strided slice NNT/VTS tests on Android R

Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I7f6932f0d21b5678ab9822b0fc69f589bbbb07e5

4 years agoIVGCVSW-3726 Upload ArmNN Doxygen files
Ryan OShea [Fri, 13 Mar 2020 16:26:19 +0000 (16:26 +0000)]
IVGCVSW-3726 Upload ArmNN Doxygen files

 * Upload current ArmNN Doxygen files

Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: I8989ed16ee40a99a4495b100bd009cf3e24a7285

4 years agoUpdate ACL pin to 470bc1eea65560d13001e60a7f7b22b12ec89bbc(COMPMID-3069)
Nikhil Raj [Fri, 13 Mar 2020 09:35:04 +0000 (09:35 +0000)]
Update ACL pin to 470bc1eea65560d13001e60a7f7b22b12ec89bbc(COMPMID-3069)

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ie966c938752e06ddc8a6d03b973edd0291864a39

4 years agoIVGCVSW-4512 Add BFloat16 Debug Workload
Narumol Prangnawarat [Thu, 12 Mar 2020 14:24:13 +0000 (14:24 +0000)]
IVGCVSW-4512 Add BFloat16 Debug Workload

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Id179cb4774a4565e5e905e5fe4c34299178644de

4 years agoIVGCVSW-4511 Add BFloat16 to RefLayerSupport and unit tests
Narumol Prangnawarat [Wed, 11 Mar 2020 14:51:27 +0000 (14:51 +0000)]
IVGCVSW-4511 Add BFloat16 to RefLayerSupport and unit tests

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ifaae4d5aac468ba927b2c6a4bf31b8c8522aeb2e

4 years agoGatordMock: Fixing errors in parsing command file.
Colm Donelan [Mon, 2 Mar 2020 21:35:10 +0000 (21:35 +0000)]
GatordMock: Fixing errors in parsing command file.

An empty line resulted in program exit.

* Ignore empty lines.
* Add error message when an invalid number of parameters to
  SET or WAIT command is encountered.

Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: Ie2d229c1330b71b559d988d4ecb8019f2f850333

4 years agoIVGCVSW-4545 Fix segfault parsing reshape layer
Derek Lamberti [Wed, 11 Mar 2020 11:42:26 +0000 (11:42 +0000)]
IVGCVSW-4545 Fix segfault parsing reshape layer

Change-Id: Ib4bbab387cec4780c8aae56fdede090fa265e4ba
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
4 years agoUpdate ACL pin to 6800117df3be825f0ec5c6cc71c4377322f51b99
Nikhil Raj [Thu, 12 Mar 2020 10:03:03 +0000 (10:03 +0000)]
Update ACL pin to 6800117df3be825f0ec5c6cc71c4377322f51b99

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ic9180b560ba527a14800c452453cb027120fac0c

4 years agoIVGCVSW-3726 Doxygen touch-up
Ryan OShea [Wed, 12 Feb 2020 16:15:27 +0000 (16:15 +0000)]
IVGCVSW-3726 Doxygen touch-up

 * Doxygen comment touch-ups
 * Fixed markup in .dox files
 * Fixed stylesheet
 * Doxyfile changes
 * Added logo file
 * Added header file

Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: I94c7f5a6923a0bbb5c6ed610f1f55d57e2bb8a49

4 years agoIVGCVSW-4542 Refactor TimelineDecoder parsing of TimelinePackets
Keith Davis [Wed, 11 Mar 2020 12:17:05 +0000 (12:17 +0000)]
IVGCVSW-4542 Refactor TimelineDecoder parsing of TimelinePackets

 * Added test to add multiple SwTraceMessages to the buffer
 * Updated TimelineCaptureCommandHandler to iterate until there
   are no more read functions in the packet
 * Further commenting

Change-Id: I41d5acf4f7288ce5a51ffd10a5eea335ac3026ec
Signed-off-by: Keith Davis <keith.davis@arm.com>
4 years agoIVGCVSW-3726 - Doxygen Beautification
Ryan OShea [Wed, 12 Feb 2020 16:15:27 +0000 (16:15 +0000)]
IVGCVSW-3726 - Doxygen Beautification

 * Added .dox files for main sections
 * Merged .md files into .dox files
 * Updated Doxyfile
 * Stylesheet for Doxygen

Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: Ic13c28b3235fca91aeb463cd5063750aa6d85be8

4 years agoUpdate ACL pin to 1c2ff950071c5b4fd6e83487083d23c96637545f
Nikhil Raj [Wed, 11 Mar 2020 15:16:39 +0000 (15:16 +0000)]
Update ACL pin to 1c2ff950071c5b4fd6e83487083d23c96637545f

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I718d0553f1d30f0b62d75d8dfb03a9556eb2a347

4 years agoIVGCVSW-4517 Modify BFloat16 to conformant to the coding standards
Narumol Prangnawarat [Wed, 11 Mar 2020 11:34:55 +0000 (11:34 +0000)]
IVGCVSW-4517 Modify BFloat16 to conformant to the coding standards

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I85b6967469dc1fddbbc875b34ba107480b78089a

4 years agoMLCE-159 Add QAsymmS8 to ArmnnQuantizer
Francis Murtagh [Tue, 10 Mar 2020 13:51:45 +0000 (13:51 +0000)]
MLCE-159 Add QAsymmS8 to ArmnnQuantizer

 * Allow per layer quantization from Fp32 to Int8 (QAsymmS8) like TfLite

Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: I5bbf770aa29d81af3568c15b47d2b2c18e55bb28

4 years agoGithub #326 Allow linking against shared Compute Library
Matthew Bentham [Tue, 10 Mar 2020 11:13:17 +0000 (11:13 +0000)]
Github #326 Allow linking against shared Compute Library

As a last resort, check for shared Compute Library in standard paths.
This will work for Linux distribution builds where no static Compute
Library has been installed.

Change-Id: I1ea11d184ef9dcf4480ae0687a4ba81b402c5b2d
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
4 years agoIVGCVSW-4482 Remove boost::ignore_unused
Jan Eilers [Mon, 9 Mar 2020 12:13:48 +0000 (12:13 +0000)]
IVGCVSW-4482 Remove boost::ignore_unused

!referencetests:229377

Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: Ia9b360b4a057fe7bbce5b268092627c09a0dba82

4 years agoIVGCVSW-4517 Implement BFloat16 Encoder and Decoder
Narumol Prangnawarat [Fri, 6 Mar 2020 14:45:57 +0000 (14:45 +0000)]
IVGCVSW-4517 Implement BFloat16 Encoder and Decoder

 * Add ConvertFloat32ToBFloat16
 * Add ConvertBFloat16ToFloat32
 * Add BFloat16Encoder
 * Add BFloat16Decoder
 * Unit tests

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I198888384c923aba28cfbed09a02edc6f8194b3e

4 years agoIVGCVSW-4541 Modify Timeline Packet construction
Keith Davis [Thu, 5 Mar 2020 16:25:28 +0000 (16:25 +0000)]
IVGCVSW-4541 Modify Timeline Packet construction

 * Changed TimelinePacket encoding so that there is only one header for
   multiple timeline swtrace messages
 * Refactored function names to have more suitable description
 * Refactored CodeStyle to coincide with ArmNN coding standards
 * Refactored profiling test names to be descriptive
 * Refactored ErrorCode name to TimelineStatus
 * Updated existing unit tests

Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I83bd4bb9e7393617bca97eba96a6e1388916e5b0

4 years agoIVGCVSW-4486 Introduce numeric_cast implementation
Derek Lamberti [Wed, 19 Feb 2020 13:40:56 +0000 (13:40 +0000)]
IVGCVSW-4486 Introduce numeric_cast implementation

Change-Id: I3e64bca4a1709ac199513676579cf3c9a3090f26
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
4 years agoMLCE-160 Error loading quantized model containing BatchNorm Layer
Mike Kelly [Wed, 4 Mar 2020 18:01:13 +0000 (18:01 +0000)]
MLCE-160 Error loading quantized model containing BatchNorm Layer

 * Relaxed restrictions in BatchNormalizationQueueDescriptor::Validate

Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I3101971c2101e90144bbbf7b63367cb0ef09573f

4 years agoIVGCVSW-4540 Fix master build failure to link UnitTests on Android
Sadik Armagan [Mon, 9 Mar 2020 11:04:32 +0000 (11:04 +0000)]
IVGCVSW-4540 Fix master build failure to link UnitTests on Android

Change-Id: I22148a0bf243eabfd045475644510f30096d96e3
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
4 years agoIVGCVSW-4483 Introduce polymorphic_downcast implementation
Derek Lamberti [Wed, 19 Feb 2020 13:30:47 +0000 (13:30 +0000)]
IVGCVSW-4483 Introduce polymorphic_downcast implementation

Change-Id: I958dd719162337eb5c7e71f4ac49dd5784564b1a
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
4 years agoIVGCVSW-4517 Add BFloat16 class and unit tests
Narumol Prangnawarat [Thu, 5 Mar 2020 17:27:45 +0000 (17:27 +0000)]
IVGCVSW-4517 Add BFloat16 class and unit tests

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ie2e9e617b9210d79a26e7ba58ecc874d1202e599

4 years agoIVGCVSW-4539 Add missing Activation Unit Test to CL and Neon
Teresa Charlin [Thu, 5 Mar 2020 14:41:50 +0000 (14:41 +0000)]
IVGCVSW-4539 Add missing Activation Unit Test to CL and Neon
    *Square, Tanh, SoftReLu, LeakyReLu, Abs, ReLU

Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Id7beed0b6770177722bf0f93957706620df81b0d

4 years agoIVGCVSW-4485 Introduce ARMNN_ASSERT(_MSG) macros
Derek Lamberti [Wed, 19 Feb 2020 13:25:42 +0000 (13:25 +0000)]
IVGCVSW-4485 Introduce ARMNN_ASSERT(_MSG) macros

Change-Id: Iba372f7311a68877a42e52595430db212c5c9fec
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
4 years agoIVGCVSW-4482 Introduce IgnoreUnused implementation
Derek Lamberti [Wed, 19 Feb 2020 13:17:02 +0000 (13:17 +0000)]
IVGCVSW-4482 Introduce IgnoreUnused implementation

Change-Id: Iad534e0e15ce561be6d0ffa23be19496be361385
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
4 years agoUpdate Acl Pin adb3291dda4e56de1af10e783b787445d6587a38
Kevin May [Wed, 4 Mar 2020 08:34:13 +0000 (08:34 +0000)]
Update Acl Pin adb3291dda4e56de1af10e783b787445d6587a38

* COMPMID-3100 Fuse bias addition with fully connected layer NEON
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I7a1953c4b611934ab0180c2a934fd047a6c6967a

4 years agoIVGCVSW-4213 Enable split along any dimension
Ryan OShea [Wed, 4 Mar 2020 12:42:05 +0000 (12:42 +0000)]
IVGCVSW-4213 Enable split along any dimension

 * Remove check on split dimension

Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: I03b88b8c8f1dcd842d9cc9d783ad7d0aa2c0ed3a

4 years agoIVGCVSW-4160 Make the ARM Developer Studio code a self contained build entity
Finn Williams [Wed, 26 Feb 2020 10:25:26 +0000 (10:25 +0000)]
IVGCVSW-4160 Make the ARM Developer Studio code a self contained build entity

!armnn:2773

Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I246cf0de04a1d29dd135cb0fc7e55bc5f0d4b854

4 years agoIVGCVSW-4163 Enhance the error handling in the ReadPacket function
Sadik Armagan [Tue, 3 Mar 2020 10:44:56 +0000 (10:44 +0000)]
IVGCVSW-4163 Enhance the error handling in the ReadPacket function

* Introduced armnn::SocketConnectionException with fields error no and socket info.

Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Ideb85b00771864e332226635aeff3096fbea8e5f

4 years agoIVGCVSW-4508 Add BFloat16 data type
Narumol Prangnawarat [Fri, 28 Feb 2020 12:45:21 +0000 (12:45 +0000)]
IVGCVSW-4508 Add BFloat16 data type

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ie2fcf06d0bae9e2ef958e60ab9e8b121fdc7b590

4 years agoIVGCVSW-4375 Add support for Transpose to optimizations
Mike Kelly [Tue, 3 Mar 2020 12:39:09 +0000 (12:39 +0000)]
IVGCVSW-4375 Add support for Transpose to optimizations

 * Changed some existing Permutation specific optimizations to also support Transpose
 * Added MoveTransposeUp optimization
 * Added TransposeAsReshape optimization
 * Added tests for Transpose optimizations
 * Added missing layer tests for Transpose

Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I20d099b284861402ae94aaa5dbf34907327a485f

4 years agoIVGCVSW-4314 Per-layer backend hint API
Derek Lamberti [Fri, 3 Jan 2020 16:53:38 +0000 (16:53 +0000)]
IVGCVSW-4314 Per-layer backend hint API

Change-Id: I6ddcffe792e39b17fcdb8af7f13f4a689ef8019d
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
4 years agoIVGCVSW-4532 Update Acl Pin to fec13b8e20dc9d71d729f750633fa52c3a8a0036
Kevin May [Tue, 3 Mar 2020 12:10:10 +0000 (12:10 +0000)]
IVGCVSW-4532 Update Acl Pin to fec13b8e20dc9d71d729f750633fa52c3a8a0036

* Fix NeonLayerSupport/IsLayerSupportedUint8Neon Quantize layer Unit Test

Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I71deb10dd3bb18e30c77b72d6ca25a9a4f8842c3

4 years agoIVGCVSW-4426 Add missing Neon tests for quantized types
Keith Davis [Thu, 20 Feb 2020 16:41:25 +0000 (16:41 +0000)]
IVGCVSW-4426 Add missing Neon tests for quantized types

Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I3b33a88801b65697d7580f1f4ebd96cfab6b796e

4 years agoIVGCVSW-4375 Add parser support for Transpose
Mike Kelly [Mon, 2 Mar 2020 11:41:31 +0000 (11:41 +0000)]
IVGCVSW-4375 Add parser support for Transpose

 * Changed TfParser::ParseTranspose to use Transpose instead of Permute
 * Changed TfLiteParser::ParseTranspose to use Transpose instead of Permute

!armnn:2787

Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: If48f2fb88d97d31d66b6b1e631b41637d8e4c8f0

4 years agoModifying the IBackendProfilingContext interface to return a bool on
David Monahan [Wed, 26 Feb 2020 10:24:03 +0000 (10:24 +0000)]
Modifying the IBackendProfilingContext interface to return a bool on
EnableProfiling and adding error checking to the Runtime
Invocation

Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I65b8bb16c6f1c7d668de31238ce0408a48974997

4 years agoIVGCVSW-4440 : Add HARD_SWISH Support to Activation in CpuRef
Colm Donelan [Wed, 26 Feb 2020 15:39:23 +0000 (15:39 +0000)]
IVGCVSW-4440 : Add HARD_SWISH Support to Activation in CpuRef

* Add a new Activiation type of HardSwish.
* Add CpuRef support and tests.

Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I68c3840aa45b7a27d5e416a5d50fe8f99f003ce8

4 years agoIVGCVSW-4375 Add support for Transpose
Mike Kelly [Fri, 28 Feb 2020 18:11:58 +0000 (18:11 +0000)]
IVGCVSW-4375 Add support for Transpose

 * Added TransposeLayer
 * Added CL, Neon and Ref Workloads
 * Added Transpose utilities
 * Added Serializer and Deserializer support
 * Added Quantizer support

Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I04c755ba7cb5b1edf72b3c9f3c0314878032e3c7

4 years agoIVGCVSW-4164 Change the callbacks to a C++ pure virtual interface
Finn Williams [Fri, 21 Feb 2020 11:14:08 +0000 (11:14 +0000)]
IVGCVSW-4164 Change the callbacks to a C++ pure virtual interface

Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I0a15b9f228ceb5a8393a48571b345394c005ee1f

4 years agoIVGCVSW-4454 Remove the CounterSet and Device fields from Category
Sadik Armagan [Tue, 25 Feb 2020 12:44:44 +0000 (12:44 +0000)]
IVGCVSW-4454 Remove the CounterSet and Device fields from Category

Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I721f59cd1f6d068e02dabd62c42871a43be9d934

4 years agoIVGCVSW-4439: Adding Elu support to Activation
David Monahan [Tue, 25 Feb 2020 09:03:29 +0000 (09:03 +0000)]
IVGCVSW-4439: Adding Elu support to Activation

 * Added CpuRef implementation
 * Added Unit Tests
 * Added Quantizer Test
 * Enabled Tests for Neon and CL backends on fp32 only
 * Added to Serializer

Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: Ic23e1797dbc9352b40678c389d7fe2b836b582ea

4 years agoCOMPMID-3060: Add TF Parser support for Transpose
Sang-Hoon Park [Tue, 18 Feb 2020 11:27:35 +0000 (11:27 +0000)]
COMPMID-3060: Add TF Parser support for Transpose

Signed-off-by: Sang-Hoon Park <sang-hoon.park@arm.com>
Change-Id: I9661787071554b38c5b0ab3c98431f3863b98520

4 years agoIVGCVSW-4368 Update Android.mk and backend.mk files with latest unit tests
Colm Donelan [Thu, 20 Feb 2020 14:31:49 +0000 (14:31 +0000)]
IVGCVSW-4368 Update Android.mk and backend.mk files with latest unit tests

* Sync up the Android build files with the CMakeLists.txt

Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I1675b0937fed7c74833e46af6d077ced57cf5bed

4 years agoIVGCVSW-4475 Update BuildGuideAndroidNDK.md
Narumol Prangnawarat [Fri, 21 Feb 2020 17:21:34 +0000 (17:21 +0000)]
IVGCVSW-4475 Update BuildGuideAndroidNDK.md

 * Remove export keyword

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: If505923c8283a352a02956621074174f423adb07

4 years agoIVGCVSW-4456 Disable NEON PostDetectionProcess
James Conroy [Fri, 21 Feb 2020 16:52:44 +0000 (16:52 +0000)]
IVGCVSW-4456 Disable NEON PostDetectionProcess

* Reverting to CpuRef workload because it
  currently has better performance.
* Disabling NEON EndToEnd tests.

Signed-off-by: James Conroy <james.conroy@arm.com>
Change-Id: Idd5314e46c50581ef4bec24e391779188f20951b

4 years agoIVGCVSW-4307 Onnx Segfault Bug
Ryan OShea [Fri, 21 Feb 2020 12:33:17 +0000 (12:33 +0000)]
IVGCVSW-4307 Onnx Segfault Bug

 * Fixed ParseConstant
 * Fixed Exception
 * Fixed 0 dimension tensor
 * Add unit test to check addition as tensor and scalar
 * Change C++ style comments to Doxygen style

Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: Ied7cbe2e11e713c23d87106d2db39e0eb446c920

4 years agoIVGCVSW-4475 Update BuildGuideAndroidNDK.md
Narumol Prangnawarat [Thu, 20 Feb 2020 16:34:36 +0000 (16:34 +0000)]
IVGCVSW-4475 Update BuildGuideAndroidNDK.md

 * Update TensorFlow version
 * Add export OpenCl and Mali library paths

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ibbd166c3ff6dd93b925a84c5178b9e92280309d8

4 years agoIVGCVSW-4432 Update Readme for 20.02
Sadik Armagan [Thu, 20 Feb 2020 16:51:15 +0000 (16:51 +0000)]
IVGCVSW-4432 Update Readme for 20.02

Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I416b39b0adac1410f854d3ec5b855044bd85e1cc

4 years agoIVGCVSW-4456 Fix MobileNet SSD perf regression
James Conroy [Thu, 20 Feb 2020 11:14:49 +0000 (11:14 +0000)]
IVGCVSW-4456 Fix MobileNet SSD perf regression

* Now use accelerated DetectionPostProcess
  NEON workload, originally was using vanilla
  version.

Change-Id: Ib64653801024a191f841d601932fa3c54baa5c3b
Signed-off-by: James Conroy <james.conroy@arm.com>
4 years agoCOMPMID-3062: Add ExecuteNetwork option to explicitly dequantize output
Georgios Pinitas [Tue, 18 Feb 2020 13:25:23 +0000 (13:25 +0000)]
COMPMID-3062: Add ExecuteNetwork option to explicitly dequantize output

Signed-off-by: Georgios Pinitas <georgios.pinitas@arm.com>
Change-Id: Ic7abe5dad700fbdc1b7cbab6936b52554f0a0360

4 years agoIVGCVSW-4472 Yolo v3 ExecuteNetwork failing
Keith Davis [Wed, 19 Feb 2020 10:08:33 +0000 (10:08 +0000)]
IVGCVSW-4472 Yolo v3 ExecuteNetwork failing

 * Add Debug workload for QAsymmS8/U8
 * Change Dequantize tests to test AsymmS8 instead of SymmS8
 * Fix incorrect supportedness within RefLayerSupport

Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: Ie51f1e33c564d46c86bf0150b1addda3fc093d13

4 years agoIVGCVSW-2232 Pack/Stack operator support in Tensorflow Parser
Sadik Armagan [Tue, 18 Feb 2020 15:18:27 +0000 (15:18 +0000)]
IVGCVSW-2232 Pack/Stack operator support in Tensorflow Parser

* Parser support and unit tests added for Stack opertor in TfParser

Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I243b33fda2762180ef880458e760a54fde64f3d8

4 years agoIVGCVSW-4433 Update version number to 20.02
Nikhil Raj [Tue, 18 Feb 2020 16:36:49 +0000 (16:36 +0000)]
IVGCVSW-4433 Update version number to 20.02

Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I06b4384312b14e6af8beb8a2903896c237b9c48d

4 years agoCOMPMID-3059: Add TF parser support for StridedSlice
Georgios Pinitas [Fri, 14 Feb 2020 14:46:51 +0000 (14:46 +0000)]
COMPMID-3059: Add TF parser support for StridedSlice

Signed-off-by: Georgios Pinitas <georgios.pinitas@arm.com>
Change-Id: I31f25f26a50c9054b5650b1be127c84194b56be7

4 years agoIVGCVSW-4436 Add ExecuteNetwork test for mobilenet_v2_int8
Keith Davis [Tue, 11 Feb 2020 16:51:50 +0000 (16:51 +0000)]
IVGCVSW-4436 Add ExecuteNetwork test for mobilenet_v2_int8

 * Add QAsymmS8 to QueueDescriptor supportedTypes
 * Add QSymmS8/QAsymmS8 to RefLayerSupport supportedTypes
 * Some additional comments and refactoring

Change-Id: I8567314452e6e8f6f69cb6e458ee147d3fc92fab
Signed-off-by: Keith Davis <keith.davis@arm.com>
4 years agoIVGCVSW-4403 Add standalone backend build steps to BuildGuideAndroidNDK
Narumol Prangnawarat [Mon, 17 Feb 2020 13:49:54 +0000 (13:49 +0000)]
IVGCVSW-4403 Add standalone backend build steps to BuildGuideAndroidNDK

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I339511938ca1356581ffac96baa642d4299d3240

4 years agoIVGCVSW-4340 Backend profiling: Add tests for Timeline functions
Colm Donelan [Thu, 13 Feb 2020 20:47:08 +0000 (20:47 +0000)]
IVGCVSW-4340 Backend profiling: Add tests for Timeline functions

* Add tests for the timeline functions that are part of
  IBackendProfiling: GetSendTimelinePacket & GetProfilingGuidGenerator
* Modify MockBackendProfilingService to store a
  MockBackendProfilingContext shared pointer.

Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I99fc4b1da019858b9f29409cd59ef8f590c0d3a2

4 years agoIVGCVSW-4320 Implement the bulk reporting of counter values from backends
Sadik Armagan [Mon, 17 Feb 2020 11:33:31 +0000 (11:33 +0000)]
IVGCVSW-4320 Implement the bulk reporting of counter values from backends

* Implemented unit test for ReportCounters function in BackendProfiling

Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Iec342a96060c8ef6090e6cc67bda8a7a3e890c50

4 years agoUpdate ACL pin to 20.02 release branch
James Conroy [Mon, 17 Feb 2020 08:43:56 +0000 (08:43 +0000)]
Update ACL pin to 20.02 release branch

Signed-off-by: James Conroy <james.conroy@arm.com>
Change-Id: Ifc7fe6e6272155a250a649adc22beaa876996abb

4 years agoIVGCVSW-4320 Implement ReportCounters in BackendProfiling
Jim Flynn [Fri, 14 Feb 2020 10:18:08 +0000 (10:18 +0000)]
IVGCVSW-4320 Implement ReportCounters in BackendProfiling

Change-Id: Idd545079f6331bb4241709fa1534635f3fdf610b
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
4 years agoIVGCVSW-4420 Failing Unit Test Cl: Quantize layer
Keith Davis [Fri, 14 Feb 2020 12:22:40 +0000 (12:22 +0000)]
IVGCVSW-4420 Failing Unit Test Cl: Quantize layer

 * Fix bug with missing ValidateInputsOutputs in Cl Workload
 * Renamed data type tests to be more specific
 * Future proofing

Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I157acc318e40d727fcfb3f36f7f577fc87472f3d

4 years agoIVGCVSW-4338 Implement the Activation of Counters in backends
Finn Williams [Wed, 12 Feb 2020 11:02:34 +0000 (11:02 +0000)]
IVGCVSW-4338 Implement the Activation of Counters in backends

Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I4a2465f06e046f78242ff0a246c651638b205498

4 years agoIVGCVSW-4400 Backend Counter Registry Functionality
David Monahan [Wed, 12 Feb 2020 15:52:35 +0000 (15:52 +0000)]
IVGCVSW-4400 Backend Counter Registry Functionality

 * Adding BackendProfilingContext to the MockBackend
 * Made IBackendProfilingContext pure Virtual
 * Added UnitTest using MockBackend for testing Backend Counter Registration
 * Moved Registry of backend counters from Initialize() to AddBackendProfilingContext()
 * Added m_MaxGlobalCounterId to ProfilingService
 * Removed automatic registration of MockBack in BackendRegistry()

Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: Ie1c6c31e56d1ac7079d6116ecad041961014aedc

4 years agoIVGCVSW-4403 Add standalone backend build steps to BuildGuideCrossCompilation
Narumol Prangnawarat [Tue, 11 Feb 2020 17:29:54 +0000 (17:29 +0000)]
IVGCVSW-4403 Add standalone backend build steps to BuildGuideCrossCompilation

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I424643294781fa91cb4f4209f6a5a384bb4e4759

4 years agoFix legacy ClTuner API
Derek Lamberti [Tue, 11 Feb 2020 12:56:52 +0000 (12:56 +0000)]
Fix legacy ClTuner API

Change-Id: Ib96446c753f7b794f5dc08cb9ff59888987cdf80
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
4 years agoIVGCVSW-4403 Update readme for sample standalone dynamic backend
Narumol Prangnawarat [Tue, 11 Feb 2020 12:19:14 +0000 (12:19 +0000)]
IVGCVSW-4403 Update readme for sample standalone dynamic backend
             and remove standalone dynamic reference backend

Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I33bc82d8b07450a9c3f6c5dc415eda8427aec57b