Finn Williams [Wed, 26 Feb 2020 10:25:26 +0000 (10:25 +0000)]
IVGCVSW-4160 Make the ARM Developer Studio code a self contained build entity
!armnn:2773
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I246cf0de04a1d29dd135cb0fc7e55bc5f0d4b854
Sadik Armagan [Tue, 3 Mar 2020 10:44:56 +0000 (10:44 +0000)]
IVGCVSW-4163 Enhance the error handling in the ReadPacket function
* Introduced armnn::SocketConnectionException with fields error no and socket info.
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Ideb85b00771864e332226635aeff3096fbea8e5f
Narumol Prangnawarat [Fri, 28 Feb 2020 12:45:21 +0000 (12:45 +0000)]
IVGCVSW-4508 Add BFloat16 data type
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ie2fcf06d0bae9e2ef958e60ab9e8b121fdc7b590
Mike Kelly [Tue, 3 Mar 2020 12:39:09 +0000 (12:39 +0000)]
IVGCVSW-4375 Add support for Transpose to optimizations
* Changed some existing Permutation specific optimizations to also support Transpose
* Added MoveTransposeUp optimization
* Added TransposeAsReshape optimization
* Added tests for Transpose optimizations
* Added missing layer tests for Transpose
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I20d099b284861402ae94aaa5dbf34907327a485f
Derek Lamberti [Fri, 3 Jan 2020 16:53:38 +0000 (16:53 +0000)]
IVGCVSW-4314 Per-layer backend hint API
Change-Id: I6ddcffe792e39b17fcdb8af7f13f4a689ef8019d
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Kevin May [Tue, 3 Mar 2020 12:10:10 +0000 (12:10 +0000)]
IVGCVSW-4532 Update Acl Pin to
fec13b8e20dc9d71d729f750633fa52c3a8a0036
* Fix NeonLayerSupport/IsLayerSupportedUint8Neon Quantize layer Unit Test
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I71deb10dd3bb18e30c77b72d6ca25a9a4f8842c3
Keith Davis [Thu, 20 Feb 2020 16:41:25 +0000 (16:41 +0000)]
IVGCVSW-4426 Add missing Neon tests for quantized types
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I3b33a88801b65697d7580f1f4ebd96cfab6b796e
Mike Kelly [Mon, 2 Mar 2020 11:41:31 +0000 (11:41 +0000)]
IVGCVSW-4375 Add parser support for Transpose
* Changed TfParser::ParseTranspose to use Transpose instead of Permute
* Changed TfLiteParser::ParseTranspose to use Transpose instead of Permute
!armnn:2787
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: If48f2fb88d97d31d66b6b1e631b41637d8e4c8f0
David Monahan [Wed, 26 Feb 2020 10:24:03 +0000 (10:24 +0000)]
Modifying the IBackendProfilingContext interface to return a bool on
EnableProfiling and adding error checking to the Runtime
Invocation
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I65b8bb16c6f1c7d668de31238ce0408a48974997
Colm Donelan [Wed, 26 Feb 2020 15:39:23 +0000 (15:39 +0000)]
IVGCVSW-4440 : Add HARD_SWISH Support to Activation in CpuRef
* Add a new Activiation type of HardSwish.
* Add CpuRef support and tests.
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I68c3840aa45b7a27d5e416a5d50fe8f99f003ce8
Mike Kelly [Fri, 28 Feb 2020 18:11:58 +0000 (18:11 +0000)]
IVGCVSW-4375 Add support for Transpose
* Added TransposeLayer
* Added CL, Neon and Ref Workloads
* Added Transpose utilities
* Added Serializer and Deserializer support
* Added Quantizer support
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I04c755ba7cb5b1edf72b3c9f3c0314878032e3c7
Finn Williams [Fri, 21 Feb 2020 11:14:08 +0000 (11:14 +0000)]
IVGCVSW-4164 Change the callbacks to a C++ pure virtual interface
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I0a15b9f228ceb5a8393a48571b345394c005ee1f
Sadik Armagan [Tue, 25 Feb 2020 12:44:44 +0000 (12:44 +0000)]
IVGCVSW-4454 Remove the CounterSet and Device fields from Category
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I721f59cd1f6d068e02dabd62c42871a43be9d934
David Monahan [Tue, 25 Feb 2020 09:03:29 +0000 (09:03 +0000)]
IVGCVSW-4439: Adding Elu support to Activation
* Added CpuRef implementation
* Added Unit Tests
* Added Quantizer Test
* Enabled Tests for Neon and CL backends on fp32 only
* Added to Serializer
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: Ic23e1797dbc9352b40678c389d7fe2b836b582ea
Sang-Hoon Park [Tue, 18 Feb 2020 11:27:35 +0000 (11:27 +0000)]
COMPMID-3060: Add TF Parser support for Transpose
Signed-off-by: Sang-Hoon Park <sang-hoon.park@arm.com>
Change-Id: I9661787071554b38c5b0ab3c98431f3863b98520
Colm Donelan [Thu, 20 Feb 2020 14:31:49 +0000 (14:31 +0000)]
IVGCVSW-4368 Update Android.mk and backend.mk files with latest unit tests
* Sync up the Android build files with the CMakeLists.txt
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I1675b0937fed7c74833e46af6d077ced57cf5bed
Narumol Prangnawarat [Fri, 21 Feb 2020 17:21:34 +0000 (17:21 +0000)]
IVGCVSW-4475 Update BuildGuideAndroidNDK.md
* Remove export keyword
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: If505923c8283a352a02956621074174f423adb07
James Conroy [Fri, 21 Feb 2020 16:52:44 +0000 (16:52 +0000)]
IVGCVSW-4456 Disable NEON PostDetectionProcess
* Reverting to CpuRef workload because it
currently has better performance.
* Disabling NEON EndToEnd tests.
Signed-off-by: James Conroy <james.conroy@arm.com>
Change-Id: Idd5314e46c50581ef4bec24e391779188f20951b
Ryan OShea [Fri, 21 Feb 2020 12:33:17 +0000 (12:33 +0000)]
IVGCVSW-4307 Onnx Segfault Bug
* Fixed ParseConstant
* Fixed Exception
* Fixed 0 dimension tensor
* Add unit test to check addition as tensor and scalar
* Change C++ style comments to Doxygen style
Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: Ied7cbe2e11e713c23d87106d2db39e0eb446c920
Narumol Prangnawarat [Thu, 20 Feb 2020 16:34:36 +0000 (16:34 +0000)]
IVGCVSW-4475 Update BuildGuideAndroidNDK.md
* Update TensorFlow version
* Add export OpenCl and Mali library paths
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ibbd166c3ff6dd93b925a84c5178b9e92280309d8
Sadik Armagan [Thu, 20 Feb 2020 16:51:15 +0000 (16:51 +0000)]
IVGCVSW-4432 Update Readme for 20.02
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I416b39b0adac1410f854d3ec5b855044bd85e1cc
James Conroy [Thu, 20 Feb 2020 11:14:49 +0000 (11:14 +0000)]
IVGCVSW-4456 Fix MobileNet SSD perf regression
* Now use accelerated DetectionPostProcess
NEON workload, originally was using vanilla
version.
Change-Id: Ib64653801024a191f841d601932fa3c54baa5c3b
Signed-off-by: James Conroy <james.conroy@arm.com>
Georgios Pinitas [Tue, 18 Feb 2020 13:25:23 +0000 (13:25 +0000)]
COMPMID-3062: Add ExecuteNetwork option to explicitly dequantize output
Signed-off-by: Georgios Pinitas <georgios.pinitas@arm.com>
Change-Id: Ic7abe5dad700fbdc1b7cbab6936b52554f0a0360
Keith Davis [Wed, 19 Feb 2020 10:08:33 +0000 (10:08 +0000)]
IVGCVSW-4472 Yolo v3 ExecuteNetwork failing
* Add Debug workload for QAsymmS8/U8
* Change Dequantize tests to test AsymmS8 instead of SymmS8
* Fix incorrect supportedness within RefLayerSupport
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: Ie51f1e33c564d46c86bf0150b1addda3fc093d13
Sadik Armagan [Tue, 18 Feb 2020 15:18:27 +0000 (15:18 +0000)]
IVGCVSW-2232 Pack/Stack operator support in Tensorflow Parser
* Parser support and unit tests added for Stack opertor in TfParser
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I243b33fda2762180ef880458e760a54fde64f3d8
Nikhil Raj [Tue, 18 Feb 2020 16:36:49 +0000 (16:36 +0000)]
IVGCVSW-4433 Update version number to 20.02
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I06b4384312b14e6af8beb8a2903896c237b9c48d
Georgios Pinitas [Fri, 14 Feb 2020 14:46:51 +0000 (14:46 +0000)]
COMPMID-3059: Add TF parser support for StridedSlice
Signed-off-by: Georgios Pinitas <georgios.pinitas@arm.com>
Change-Id: I31f25f26a50c9054b5650b1be127c84194b56be7
Keith Davis [Tue, 11 Feb 2020 16:51:50 +0000 (16:51 +0000)]
IVGCVSW-4436 Add ExecuteNetwork test for mobilenet_v2_int8
* Add QAsymmS8 to QueueDescriptor supportedTypes
* Add QSymmS8/QAsymmS8 to RefLayerSupport supportedTypes
* Some additional comments and refactoring
Change-Id: I8567314452e6e8f6f69cb6e458ee147d3fc92fab
Signed-off-by: Keith Davis <keith.davis@arm.com>
Narumol Prangnawarat [Mon, 17 Feb 2020 13:49:54 +0000 (13:49 +0000)]
IVGCVSW-4403 Add standalone backend build steps to BuildGuideAndroidNDK
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I339511938ca1356581ffac96baa642d4299d3240
Colm Donelan [Thu, 13 Feb 2020 20:47:08 +0000 (20:47 +0000)]
IVGCVSW-4340 Backend profiling: Add tests for Timeline functions
* Add tests for the timeline functions that are part of
IBackendProfiling: GetSendTimelinePacket & GetProfilingGuidGenerator
* Modify MockBackendProfilingService to store a
MockBackendProfilingContext shared pointer.
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I99fc4b1da019858b9f29409cd59ef8f590c0d3a2
Sadik Armagan [Mon, 17 Feb 2020 11:33:31 +0000 (11:33 +0000)]
IVGCVSW-4320 Implement the bulk reporting of counter values from backends
* Implemented unit test for ReportCounters function in BackendProfiling
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Iec342a96060c8ef6090e6cc67bda8a7a3e890c50
James Conroy [Mon, 17 Feb 2020 08:43:56 +0000 (08:43 +0000)]
Update ACL pin to 20.02 release branch
Signed-off-by: James Conroy <james.conroy@arm.com>
Change-Id: Ifc7fe6e6272155a250a649adc22beaa876996abb
Jim Flynn [Fri, 14 Feb 2020 10:18:08 +0000 (10:18 +0000)]
IVGCVSW-4320 Implement ReportCounters in BackendProfiling
Change-Id: Idd545079f6331bb4241709fa1534635f3fdf610b
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Keith Davis [Fri, 14 Feb 2020 12:22:40 +0000 (12:22 +0000)]
IVGCVSW-4420 Failing Unit Test Cl: Quantize layer
* Fix bug with missing ValidateInputsOutputs in Cl Workload
* Renamed data type tests to be more specific
* Future proofing
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I157acc318e40d727fcfb3f36f7f577fc87472f3d
Finn Williams [Wed, 12 Feb 2020 11:02:34 +0000 (11:02 +0000)]
IVGCVSW-4338 Implement the Activation of Counters in backends
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I4a2465f06e046f78242ff0a246c651638b205498
David Monahan [Wed, 12 Feb 2020 15:52:35 +0000 (15:52 +0000)]
IVGCVSW-4400 Backend Counter Registry Functionality
* Adding BackendProfilingContext to the MockBackend
* Made IBackendProfilingContext pure Virtual
* Added UnitTest using MockBackend for testing Backend Counter Registration
* Moved Registry of backend counters from Initialize() to AddBackendProfilingContext()
* Added m_MaxGlobalCounterId to ProfilingService
* Removed automatic registration of MockBack in BackendRegistry()
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: Ie1c6c31e56d1ac7079d6116ecad041961014aedc
Narumol Prangnawarat [Tue, 11 Feb 2020 17:29:54 +0000 (17:29 +0000)]
IVGCVSW-4403 Add standalone backend build steps to BuildGuideCrossCompilation
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I424643294781fa91cb4f4209f6a5a384bb4e4759
Derek Lamberti [Tue, 11 Feb 2020 12:56:52 +0000 (12:56 +0000)]
Fix legacy ClTuner API
Change-Id: Ib96446c753f7b794f5dc08cb9ff59888987cdf80
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Narumol Prangnawarat [Tue, 11 Feb 2020 12:19:14 +0000 (12:19 +0000)]
IVGCVSW-4403 Update readme for sample standalone dynamic backend
and remove standalone dynamic reference backend
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I33bc82d8b07450a9c3f6c5dc415eda8427aec57b
Matthew Bentham [Mon, 10 Feb 2020 17:23:39 +0000 (17:23 +0000)]
Silence clang-8 warnings wrt explicit defaulting of implicitly deleted operator
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: I9ff918e7f9fe340e65f8dd1b1c47754c8b41de1f
Mike Kelly [Tue, 11 Feb 2020 11:54:04 +0000 (11:54 +0000)]
Updating armnn-arm_compute to arm_compute_library.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I7c608a75d0dbeb2f95df94440e23aecfa97bd93b
Finn Williams [Mon, 10 Feb 2020 16:59:58 +0000 (16:59 +0000)]
IVGCVSW-4424 Set minimum timeout for SendThread in WaitingForAck state
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: Iee7de5040e355933b7e14a39d44e9d51b30427c8
Sadik Armagan [Mon, 10 Feb 2020 12:24:15 +0000 (12:24 +0000)]
IVGCVSW-4328 BufferManager running out of buffers crashes application
* Refactored SendCounterPacket classes, separated SendCounterPacket from Send thread
* Created ISendThread.hpp, IConsumer, SendThread.hpp and SendThread.cpp
* Injected IConsumer to BufferManager to notify SendThread when packet is ready to read
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I80f0bb8b8401c6bfd1611f7760217c6fe35d7ad8
Ryan OShea [Fri, 7 Feb 2020 17:22:22 +0000 (17:22 +0000)]
IVGCVSW-4409 Fix TfLiteParser to handle all datatypes correctly
* Added check for QAsymmS8 datatype for Per-Tensor quantization
Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: I902aa3863dd5cefdce90e68be8a5750dd6ff9e54
Matthew Bentham [Wed, 5 Feb 2020 21:39:55 +0000 (21:39 +0000)]
Clean up header inclusion in CL workloads.
Remove usage of CLFunctions.h and replace with specific header
for each function.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: I255a843b36a5dd8cf90a52786282192b8fe04f83
Matthew Bentham [Wed, 5 Feb 2020 22:15:26 +0000 (22:15 +0000)]
Suppress warnings from OpenCL include folder.
Fixes an odd compiler warning with half.hpp when included
from ComputeLibrary/include directory.
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
Change-Id: I17d251bb68384c357ffb93ea8e63333564aba659
David Monahan [Fri, 7 Feb 2020 12:01:05 +0000 (12:01 +0000)]
IVGCVSW-4400 Adding invocation of the back to Profiling Service initialisation
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I5f3bb4c9cde1cca11b8f6201ab559c2960eb32c0
James Conroy [Thu, 6 Feb 2020 18:34:52 +0000 (18:34 +0000)]
IVGCVSW-4319 Implement Counter Status Querying
* Adds implementations for GetCounterStatus and
GetActiveCounters.
* Adds CheckCounterStatusQuery in ProfilingTests.
* Modifies Holder and ProfilingService to open
up access to CaptureData for use by
BackendProfiling.
Signed-off-by: James Conroy <james.conroy@arm.com>
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: Iec47952545c0072a71088b12ca3dc31673fa9c51
Narumol Prangnawarat [Mon, 10 Feb 2020 10:05:50 +0000 (10:05 +0000)]
IVGCVSW-4402 Modify the signature of CreateBackendProfilingContext
as the signature in IBackendInternal is changed to remove const
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I773cbc36f49bde13e498a05399d55ca9b0343d31
Ryan OShea [Fri, 7 Feb 2020 10:06:33 +0000 (10:06 +0000)]
IVGCVSW-4386 Add ArmNN reference support for QAsymmS8
* Added Quantization Scheme for QAsymmS8
* Added Unit Tests for QAsymmS8
* Renamed QAsymm8 calls to QAsymmU8
Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: I897b4e018ba1d808cc3f8c113f2be2dbad49c8db
Narumol Prangnawarat [Fri, 7 Feb 2020 10:28:31 +0000 (10:28 +0000)]
IVGCVSW-4402 add boost and armnn path to sample dynamic backend
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ibeed3301352d8f15e144f8466d8a26b21c744b84
Narumol Prangnawarat [Fri, 7 Feb 2020 09:46:31 +0000 (09:46 +0000)]
IVGCVSW-4418 disable unused variable and parameter warning for Caffe protobuf cc
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I903b75276b0c98894d8116a3d244103a910efa63
Sang-Hoon Park [Wed, 8 Jan 2020 10:25:24 +0000 (10:25 +0000)]
MLCE-139: add capability to align corners for bilinear resize
* Add parsing of the related parameter to TfLiteParser
* Update ResizeDescriptor to store the additional parameter
* Update NEON/CL workload to pass the additional parameter.
* Update Reference workload to pass and handle the additional parameter.
!ComputeLibrary:2538
!ComputeLibrary:2569
!armnn:2612
Signed-off-by: Sang-Hoon Park <sang-hoon.park@arm.com>
Change-Id: Id149e1c24c2abed7e9dd81939acf54dfabfcdfd2
Teresa Charlin [Fri, 7 Feb 2020 09:06:28 +0000 (09:06 +0000)]
Update ACL pin to
c971cf1034a61875c8e8c87d48634cbfac3865fd
* COMPMID-3090: Fail NEON/ColorConvert/RGBtoU8
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I551e5a6e4d755a52e67298b94c44ede61c8431c0
Colm Donelan [Wed, 5 Feb 2020 17:48:59 +0000 (17:48 +0000)]
IVGCVSW-4317 Implement the Profiling Context Initialisation
* Call CreateBackendProfilingContext on each backend from Runtime passing
an instance of the BackendProfiling interface.
* Modify the signature of CreateBackendProfilingContext to remove const
and return a shared_ptr to BackendProfilingContext
* Add concrete BackendProfiling class.
* Store BackendProfilingContexts in Profiling service.
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I975eaa2093ae91fa623835f65f9e5b25eb65117a
Kevin May [Thu, 6 Feb 2020 09:16:45 +0000 (09:16 +0000)]
Update ACL pin to
4bce11548268b9a10b0f06eff3cff9ae06d5b9dd
* COMPMID-3063: Address Custom Convolution failures
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I9fce935d72aca67198ab381351828cd016c0c41d
Narumol Prangnawarat [Tue, 4 Feb 2020 14:45:41 +0000 (14:45 +0000)]
IVGCVSW-4404 Add libraries to sample dynamic backend for android
* Add Boost and armnn paths
* Add CreateBackendProfilingContext, CreateWorkloadFactory,
CreateBackendProfilingContext
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ib36d751b15450a922c12895e292abafe06f9e7cf
Derek Lamberti [Tue, 4 Feb 2020 14:49:16 +0000 (14:49 +0000)]
IVGCVSW-4389 Enable ClTuner in ClContextControl
Change-Id: If169736c4523a92f9aa10eac13e320eb41088624
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Matthew Bentham [Fri, 24 Jan 2020 23:11:43 +0000 (23:11 +0000)]
Clean up header usage a bit in NEON backend
Including NEFunctions.h is unnecessary and adds about a second
to compile time each translation unit in which it appears,
so we should use just the header file with the arm compute function
declarations that we need.
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
Change-Id: I605d0eb82ccf2aafa35381a5d9d54337d3fe17a7
Tee Jung [Tue, 5 Nov 2019 10:48:25 +0000 (10:48 +0000)]
Build graph->inputIds/outputIds with layerBindingId instead of layerIndex
Signed-off-by: Jung Tae-young tee.ty.jung@openedges.com
Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
Change-Id: I25ceeca70e72fad88ab039aed5a5ab6a7cc08c6c
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Matthew Bentham [Tue, 4 Feb 2020 10:03:55 +0000 (10:03 +0000)]
Github #273 Handle failure to initialise BackendContext in Runtime
Define CreateBackendContext to throw BackendUnavailableException
if necessary runtime components are missing.
Handle this in the constructor of Runtime by not adding those
backends to the internal DeviceSpec owned by the Runtime.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: Iadffb5240e32e1f105683c4d361276b92d1e720c
Keith Davis [Tue, 4 Feb 2020 09:31:47 +0000 (09:31 +0000)]
IVGCVSW-4390 Refactor QUANTIZE to make use of Decoder/Encoder types
* Fix bug where QSymmS8 is duplicated and F16 is missing
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I312815868e74a9dff913bac052f1a86585644098
Teresa Charlin [Mon, 3 Feb 2020 18:15:00 +0000 (18:15 +0000)]
IVGCVSW-4365 Update ACL pin to
5c829cab49b0dcffd893065af05f0bf028e7a548
* Fix CTS for ArgMinMax
Change-Id: I61ac4f80550bc3cbf2e19af5e602e3070c43ea1d
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Narumol Prangnawarat [Mon, 3 Feb 2020 12:29:56 +0000 (12:29 +0000)]
IVGCVSW-4399 Create Sample Dynamic backend
* Move IWorkload and WorkloadInfo to include/armnn/backends
* Add simple sample dynamic backend with addition workload
* Add sample example to run dynamic backend
* Unit tests
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I0753ce35b8e8a6223a1471388b49246d82438a44
Keith Davis [Mon, 3 Feb 2020 14:47:54 +0000 (14:47 +0000)]
IVGCVSW-4334 Wire Signed Quantized 8 bit type into ACL
* Add QSymmS8 LayerSupport tests for all backends
* Update BatchNormalization IsLayerSupport Bias' QSymmS8 case
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: Ib66befe11f9df5956869eb80699fc415a4d3fa16
Jim Flynn [Sun, 2 Feb 2020 12:52:59 +0000 (12:52 +0000)]
IVGCVSW-4393 Register backend counters
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I419ecc2fce4b7e0fcaeb6d1f9cb687c0b660125d
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Jim Flynn [Thu, 30 Jan 2020 14:10:55 +0000 (14:10 +0000)]
IVGCVSW-4394 Add CounterIdMap to Profiling Service
Change-Id: I416397a7855fe45319b4801252e141b78f0325f0
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Keith Davis [Wed, 29 Jan 2020 16:52:59 +0000 (16:52 +0000)]
IVGCVSW-4390 Refactor QUANTIZE to make use of Decoder/Encoder types
* Add no-ops for CL/NEON Uint8
* Refactor Quantize workload to Decoder/Encoder types
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I80b09de528299b925e2ac38acd9a5019b8d3e4ac
Teresa Charlin [Fri, 31 Jan 2020 10:21:44 +0000 (10:21 +0000)]
IVGCVSW-4388 Update ACL pin to
6a342648ae50beb8457871862f14fc9baef6b74f
!android-nn-driver:2671
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ifeb6be7812fbb98b37f2a1439bfd5a3215de2a62
Narumol Prangnawarat [Fri, 31 Jan 2020 11:59:06 +0000 (11:59 +0000)]
IVGCVSW-4196 Add condition to check to add common source for Android
to dynamic reference CMakeLists
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I7a60903e2af0fdbceabbad312616ecc049f9701d
Jan Eilers [Thu, 30 Jan 2020 13:50:36 +0000 (13:50 +0000)]
IVGCVSW-4171 Temporarily disable DumpOutgoingValidFileEndToEnd unit test
* Test causes intermittent failures on CI system
* Temporarily disabled until fix is found
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I689a4688d64040d557c63829a765d2c07c4fac3a
David Monahan [Thu, 30 Jan 2020 12:44:23 +0000 (12:44 +0000)]
IVGCVSW-4391 Add Global/Backend Counter ID map
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I943e02bc2026564e3a19d03e81ba75850d204497
Narumol Prangnawarat [Tue, 28 Jan 2020 16:50:13 +0000 (16:50 +0000)]
IVGCVSW-4322 Remove deprecated AbsLayer and RsqrtLayer and add source
for all environment to dynamic reference backend CMakeLists
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I2db1f48597b2af08c9d6d8d052ca08e885e51563
Ryan OShea [Wed, 29 Jan 2020 16:19:55 +0000 (16:19 +0000)]
IVGCVSW-4149 Enable quantisation multiplier > 1 in all convolutions
Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: I9652844a868ce8e05c0433c051e7079cf203c422
Colm Donelan [Wed, 29 Jan 2020 15:22:43 +0000 (15:22 +0000)]
IVGCVSW-4316 First draft of IBackendProfiling and IBackendProfilingContext
* Introduce two new backend profiling interfaces IBackendProfiling
and IBackendProfilingContext.
* Add a mechanism to pull a context from a backend through IBackendInternal
* Update CL, Neon and Ref backends to return an empty profiling backend.
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I6e7438fcb126ad7a073a226862dc44836c9998b7
Ryan OShea [Thu, 23 Jan 2020 11:56:05 +0000 (11:56 +0000)]
IVGCVSW-4152 Remove check for QAsymm8 in ArgMinMax CL layer support
* Added ClLayerTests
* Added ClEndToEndTests
Signed-off-by: Ryan OShea <ryaosh02@e121865.galway.arm.com>
Change-Id: I1512ebae248dee9a0e6a8c4f52ecf99f677a22c6
Keith Davis [Mon, 27 Jan 2020 15:24:59 +0000 (15:24 +0000)]
IVGCVSW-4306 Verify the tflite Yolo v3
* Added debug layer support for QSymmS8
* QSymmS8 support for workloads
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I51af92fadc0be290629dd9198beab5abef9e351f
Keith Davis [Wed, 22 Jan 2020 11:57:54 +0000 (11:57 +0000)]
IVGCVSW-4335 Add support for per-channel QSymm8 to TfLite parser
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I52f777f56138a27655a821aff376ecd0d3d23511
Teresa Charlin [Tue, 21 Jan 2020 13:29:22 +0000 (13:29 +0000)]
IVGCVSW-4360 Update ACL pin to
19bd412fd044197726dbd8c756dbd74a9e33fd2b
!android-nn-driver:2614
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I3b4019cb562bd13cc661d9c175de4e3e1adea9a2
Teresa Charlin [Tue, 28 Jan 2020 12:24:34 +0000 (12:24 +0000)]
IVGCVSW-4369 Add default offset and scale to IsLayerSupportedTestImpl
*Fix IsLayerSupportedUint8Cl failure due to scale=0
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I6e5125eccdd495a9c98b434837d1e9ab371a4e8e
Colm Donelan [Fri, 24 Jan 2020 16:27:02 +0000 (16:27 +0000)]
IVGCVSW-4316 Promote ISendTimelinePacket and IProfilingGuidGenerator
As part of IVGCVSW-4316 we need to expose ISendTimelinePacket and
IProfilingGuidGenerator to enable them to be used by backends for
profiling. This also required moving ProfilingRelationshipType from
ProfilingUtils.
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I58cc64e32ecfffa5231c9d2028522ed58d0ddf31
Narumol Prangnawarat [Mon, 27 Jan 2020 14:13:03 +0000 (14:13 +0000)]
IVGCVSW-4313 Add Android case to dynamic reference CMakeLists
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I10724f2874018fb214cd12c3aef45be5347a8306
Mike Kelly [Mon, 27 Jan 2020 12:14:47 +0000 (12:14 +0000)]
IVGCVSW-4380 Add NEON backend support for BatchToSpaceNd
* Added NeonBatchToSpaceNdWorkload class.
* Added CreateBatchToSpaceNd implementation to NeonWorkloadFactory.
* Added IsBatchToSpaceNdSupported implementation to NeonLayerSupport.
* Enabled BatchToSpaceNd tests on Neon backend.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I179feefaa67dc87a03fcbe52e5df100c1188f9a5
Kevin May [Thu, 12 Dec 2019 17:28:05 +0000 (17:28 +0000)]
IVGCVSW-4262 Use ACL Permute and Reshape Validate function in Neon and CL
!android-nn-driver:2642
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: Ibabb73c0ae0df2e530a68398f75c76e6b80c0701
David Monahan [Fri, 24 Jan 2020 09:13:33 +0000 (09:13 +0000)]
Updates to Filesystem.cpp/hpp and NetworkSockets.cpp/hpp to fix failing master
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I566c29754aa586167a938d2c2b4e5069a39b5e50
Pablo Tello [Thu, 23 Jan 2020 10:37:17 +0000 (10:37 +0000)]
MLCE-156: Add Division workload in CpuAcc
Change-Id: I1f228fcaf1077867d9755a2b850c6703387fab34
Signed-off-by: Pablo Tello <pablo.tello@arm.com>
Mike Kelly [Fri, 24 Jan 2020 11:27:50 +0000 (11:27 +0000)]
IVGCVSW-4374 Add NEON backend support for SpaceToBatchNd
* Added NeonSpaceToBatchNdWorkload class.
* Added CreateSpaceToBatchNd implementation to NeonWorkloadFactory.
* Added IsSpaceToBatchNdSupported implementation to NeonLayerSupport.
* Enabled SpaceToBatchNd tests on Neon backend.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: Ic7d469a380482ec9febd44450f72dd7e53cda03f
Rob Hughes [Tue, 7 Jan 2020 09:40:12 +0000 (09:40 +0000)]
Add ARMNN_DLLEXPORT macro to import/export static data symbols on Windows
Armnn has several static data symbols that are needed by the unit tests.
These are now explicitly marked for import when that header is included
from the unit test code.
See also https://cmake.org/cmake/help/v3.4/prop_tgt/WINDOWS_EXPORT_ALL_SYMBOLS.html.
Change-Id: I4e71ba659b6321659a1396125b5a9c271578040f
Signed-off-by: Robert Hughes <robert.hughes@arm.com>
Derek Lamberti [Wed, 22 Jan 2020 15:37:29 +0000 (15:37 +0000)]
IVGCVSW-4370 Deprecate DataType::QuantizedSymm8PerAxis
!android-nn-driver:2622
Change-Id: If99d3eff71ff66ba28af1e5af248299fe04511b9
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
josh minor [Mon, 6 Jan 2020 22:40:46 +0000 (16:40 -0600)]
IVGCVSW-4259 Add frontend and reference workload for UnaryOperationLayer
* Added new layer named ElementwiseUnary
* Deprecated existing Abs/Rsqrt layer functions
* Updated existing Abs/Rsqrt test infrastructure to use new layer
* Added boilerplate for new Exp,Neg,Sqrt elemwise op layers
* AbsQuantize test removed pending future commit
* Serialization support added
!android-nn-driver:2550
Change-Id: Ic595c645925e17b45db568187fd05646daf2e87f
Signed-off-by: josh minor <josh.minor@arm.com>
Teresa Charlin [Thu, 23 Jan 2020 11:44:24 +0000 (11:44 +0000)]
IVGCVSW-4268 Print all Descriptors on dot graph
Change-Id: I82a7dcffc3771efa8350e2e1e22cfb20969551f9
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
David Monahan [Wed, 22 Jan 2020 15:40:34 +0000 (15:40 +0000)]
Add check to NetworkSockets.cpp to fix failing Android build
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: Ieaa91fae464047c6eeff557b4e01dac09653473d
Rob Hughes [Tue, 7 Jan 2020 17:05:24 +0000 (17:05 +0000)]
Add thin abstraction layer for processes and filesystem
This is used instead of some hardcoded Unix calls and means this code
now works on Windows
(This is a rework of a previous patch which used boost, now that I have
been informed that we are trying to move towards removing boost).
Change-Id: Ib0d11055279bbd7b710f086e9890369e3ecbfe9a
Signed-off-by: Robert Hughes <robert.hughes@arm.com>
Rob Hughes [Mon, 13 Jan 2020 11:14:59 +0000 (11:14 +0000)]
Add thin abstraction layer for network sockets
This makes SocketProfilingConnection and GatordMock work on Windows as
well as Linux
Change-Id: I4b10c079b653a1c3f61eb20694e5b5f8a6f5fdfb
Signed-off-by: Robert Hughes <robert.hughes@arm.com>
Derek Lamberti [Tue, 21 Jan 2020 13:43:21 +0000 (13:43 +0000)]
IVGCVSW-4364 Only apply deprecated attribute where available
Change-Id: Ifde03ea6d9057db0949acad95560be8852c05f73
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Francis Murtagh [Fri, 17 Jan 2020 11:18:01 +0000 (11:18 +0000)]
IVGCVSW-4239 Remove dynamic link to libOpenCL.so
* Instead rely on ACL's dlopen() to dynamically load the libraries
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: I2b451c1c382f3baf51665da9add8f2415353849a
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Mike Kelly [Mon, 20 Jan 2020 17:18:18 +0000 (17:18 +0000)]
IVGCVSW-4331 Calling RemoveDebugLayers can break connections
* Changed RemoveDebugLayers to move all connections from its OutputSlot.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I3c649e3f660804ca48f3c2af993a5af6a7ed4d4a
Matthew Bentham [Mon, 20 Jan 2020 16:16:06 +0000 (16:16 +0000)]
Remove inclusion of ArmNN.hpp where it is unnecessary.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: Idb583f8de4470eefb47c90189cd3c90e74e0440a
Matthew Bentham [Mon, 20 Jan 2020 10:09:09 +0000 (10:09 +0000)]
Remove use of ArmNN.hpp where it is unnecessary.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: I6c90eab1c6bad76d5c7b3bf094998fa4b454bcd1
Matthew Bentham [Fri, 17 Jan 2020 11:47:42 +0000 (11:47 +0000)]
Remove use of ArmNN.hpp from other public headers
Also remove it from armnnSerializer and armnnUtils.
In general code within Arm NN should only include exactly what it needs.
This will help keep compile times down, and reduces the need for a
complete rebuild when anything in the public headers changes.
ArmNN.hpp should only be provided as a convenience for user code where the
user doesn't know enough of the API to decide which specific headers
they need.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: I4ffcaa7662af4f88a1babf2bf17d03da6f77d665
projects / platform / upstream / armnn.git / log