James Conroy [Thu, 20 Feb 2020 11:14:49 +0000 (11:14 +0000)]
IVGCVSW-4456 Fix MobileNet SSD perf regression
* Now use accelerated DetectionPostProcess
NEON workload, originally was using vanilla
version.
Change-Id: Ib64653801024a191f841d601932fa3c54baa5c3b
Signed-off-by: James Conroy <james.conroy@arm.com>
Georgios Pinitas [Tue, 18 Feb 2020 13:25:23 +0000 (13:25 +0000)]
COMPMID-3062: Add ExecuteNetwork option to explicitly dequantize output
Signed-off-by: Georgios Pinitas <georgios.pinitas@arm.com>
Change-Id: Ic7abe5dad700fbdc1b7cbab6936b52554f0a0360
Keith Davis [Wed, 19 Feb 2020 10:08:33 +0000 (10:08 +0000)]
IVGCVSW-4472 Yolo v3 ExecuteNetwork failing
* Add Debug workload for QAsymmS8/U8
* Change Dequantize tests to test AsymmS8 instead of SymmS8
* Fix incorrect supportedness within RefLayerSupport
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: Ie51f1e33c564d46c86bf0150b1addda3fc093d13
Sadik Armagan [Tue, 18 Feb 2020 15:18:27 +0000 (15:18 +0000)]
IVGCVSW-2232 Pack/Stack operator support in Tensorflow Parser
* Parser support and unit tests added for Stack opertor in TfParser
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I243b33fda2762180ef880458e760a54fde64f3d8
Nikhil Raj [Tue, 18 Feb 2020 16:36:49 +0000 (16:36 +0000)]
IVGCVSW-4433 Update version number to 20.02
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I06b4384312b14e6af8beb8a2903896c237b9c48d
Georgios Pinitas [Fri, 14 Feb 2020 14:46:51 +0000 (14:46 +0000)]
COMPMID-3059: Add TF parser support for StridedSlice
Signed-off-by: Georgios Pinitas <georgios.pinitas@arm.com>
Change-Id: I31f25f26a50c9054b5650b1be127c84194b56be7
Keith Davis [Tue, 11 Feb 2020 16:51:50 +0000 (16:51 +0000)]
IVGCVSW-4436 Add ExecuteNetwork test for mobilenet_v2_int8
* Add QAsymmS8 to QueueDescriptor supportedTypes
* Add QSymmS8/QAsymmS8 to RefLayerSupport supportedTypes
* Some additional comments and refactoring
Change-Id: I8567314452e6e8f6f69cb6e458ee147d3fc92fab
Signed-off-by: Keith Davis <keith.davis@arm.com>
Narumol Prangnawarat [Mon, 17 Feb 2020 13:49:54 +0000 (13:49 +0000)]
IVGCVSW-4403 Add standalone backend build steps to BuildGuideAndroidNDK
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I339511938ca1356581ffac96baa642d4299d3240
Colm Donelan [Thu, 13 Feb 2020 20:47:08 +0000 (20:47 +0000)]
IVGCVSW-4340 Backend profiling: Add tests for Timeline functions
* Add tests for the timeline functions that are part of
IBackendProfiling: GetSendTimelinePacket & GetProfilingGuidGenerator
* Modify MockBackendProfilingService to store a
MockBackendProfilingContext shared pointer.
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I99fc4b1da019858b9f29409cd59ef8f590c0d3a2
Sadik Armagan [Mon, 17 Feb 2020 11:33:31 +0000 (11:33 +0000)]
IVGCVSW-4320 Implement the bulk reporting of counter values from backends
* Implemented unit test for ReportCounters function in BackendProfiling
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: Iec342a96060c8ef6090e6cc67bda8a7a3e890c50
James Conroy [Mon, 17 Feb 2020 08:43:56 +0000 (08:43 +0000)]
Update ACL pin to 20.02 release branch
Signed-off-by: James Conroy <james.conroy@arm.com>
Change-Id: Ifc7fe6e6272155a250a649adc22beaa876996abb
Jim Flynn [Fri, 14 Feb 2020 10:18:08 +0000 (10:18 +0000)]
IVGCVSW-4320 Implement ReportCounters in BackendProfiling
Change-Id: Idd545079f6331bb4241709fa1534635f3fdf610b
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Keith Davis [Fri, 14 Feb 2020 12:22:40 +0000 (12:22 +0000)]
IVGCVSW-4420 Failing Unit Test Cl: Quantize layer
* Fix bug with missing ValidateInputsOutputs in Cl Workload
* Renamed data type tests to be more specific
* Future proofing
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I157acc318e40d727fcfb3f36f7f577fc87472f3d
Finn Williams [Wed, 12 Feb 2020 11:02:34 +0000 (11:02 +0000)]
IVGCVSW-4338 Implement the Activation of Counters in backends
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I4a2465f06e046f78242ff0a246c651638b205498
David Monahan [Wed, 12 Feb 2020 15:52:35 +0000 (15:52 +0000)]
IVGCVSW-4400 Backend Counter Registry Functionality
* Adding BackendProfilingContext to the MockBackend
* Made IBackendProfilingContext pure Virtual
* Added UnitTest using MockBackend for testing Backend Counter Registration
* Moved Registry of backend counters from Initialize() to AddBackendProfilingContext()
* Added m_MaxGlobalCounterId to ProfilingService
* Removed automatic registration of MockBack in BackendRegistry()
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: Ie1c6c31e56d1ac7079d6116ecad041961014aedc
Narumol Prangnawarat [Tue, 11 Feb 2020 17:29:54 +0000 (17:29 +0000)]
IVGCVSW-4403 Add standalone backend build steps to BuildGuideCrossCompilation
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I424643294781fa91cb4f4209f6a5a384bb4e4759
Derek Lamberti [Tue, 11 Feb 2020 12:56:52 +0000 (12:56 +0000)]
Fix legacy ClTuner API
Change-Id: Ib96446c753f7b794f5dc08cb9ff59888987cdf80
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Narumol Prangnawarat [Tue, 11 Feb 2020 12:19:14 +0000 (12:19 +0000)]
IVGCVSW-4403 Update readme for sample standalone dynamic backend
and remove standalone dynamic reference backend
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I33bc82d8b07450a9c3f6c5dc415eda8427aec57b
Matthew Bentham [Mon, 10 Feb 2020 17:23:39 +0000 (17:23 +0000)]
Silence clang-8 warnings wrt explicit defaulting of implicitly deleted operator
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: I9ff918e7f9fe340e65f8dd1b1c47754c8b41de1f
Mike Kelly [Tue, 11 Feb 2020 11:54:04 +0000 (11:54 +0000)]
Updating armnn-arm_compute to arm_compute_library.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I7c608a75d0dbeb2f95df94440e23aecfa97bd93b
Finn Williams [Mon, 10 Feb 2020 16:59:58 +0000 (16:59 +0000)]
IVGCVSW-4424 Set minimum timeout for SendThread in WaitingForAck state
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: Iee7de5040e355933b7e14a39d44e9d51b30427c8
Sadik Armagan [Mon, 10 Feb 2020 12:24:15 +0000 (12:24 +0000)]
IVGCVSW-4328 BufferManager running out of buffers crashes application
* Refactored SendCounterPacket classes, separated SendCounterPacket from Send thread
* Created ISendThread.hpp, IConsumer, SendThread.hpp and SendThread.cpp
* Injected IConsumer to BufferManager to notify SendThread when packet is ready to read
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I80f0bb8b8401c6bfd1611f7760217c6fe35d7ad8
Ryan OShea [Fri, 7 Feb 2020 17:22:22 +0000 (17:22 +0000)]
IVGCVSW-4409 Fix TfLiteParser to handle all datatypes correctly
* Added check for QAsymmS8 datatype for Per-Tensor quantization
Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: I902aa3863dd5cefdce90e68be8a5750dd6ff9e54
Matthew Bentham [Wed, 5 Feb 2020 21:39:55 +0000 (21:39 +0000)]
Clean up header inclusion in CL workloads.
Remove usage of CLFunctions.h and replace with specific header
for each function.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: I255a843b36a5dd8cf90a52786282192b8fe04f83
Matthew Bentham [Wed, 5 Feb 2020 22:15:26 +0000 (22:15 +0000)]
Suppress warnings from OpenCL include folder.
Fixes an odd compiler warning with half.hpp when included
from ComputeLibrary/include directory.
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
Change-Id: I17d251bb68384c357ffb93ea8e63333564aba659
David Monahan [Fri, 7 Feb 2020 12:01:05 +0000 (12:01 +0000)]
IVGCVSW-4400 Adding invocation of the back to Profiling Service initialisation
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I5f3bb4c9cde1cca11b8f6201ab559c2960eb32c0
James Conroy [Thu, 6 Feb 2020 18:34:52 +0000 (18:34 +0000)]
IVGCVSW-4319 Implement Counter Status Querying
* Adds implementations for GetCounterStatus and
GetActiveCounters.
* Adds CheckCounterStatusQuery in ProfilingTests.
* Modifies Holder and ProfilingService to open
up access to CaptureData for use by
BackendProfiling.
Signed-off-by: James Conroy <james.conroy@arm.com>
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: Iec47952545c0072a71088b12ca3dc31673fa9c51
Narumol Prangnawarat [Mon, 10 Feb 2020 10:05:50 +0000 (10:05 +0000)]
IVGCVSW-4402 Modify the signature of CreateBackendProfilingContext
as the signature in IBackendInternal is changed to remove const
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I773cbc36f49bde13e498a05399d55ca9b0343d31
Ryan OShea [Fri, 7 Feb 2020 10:06:33 +0000 (10:06 +0000)]
IVGCVSW-4386 Add ArmNN reference support for QAsymmS8
* Added Quantization Scheme for QAsymmS8
* Added Unit Tests for QAsymmS8
* Renamed QAsymm8 calls to QAsymmU8
Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: I897b4e018ba1d808cc3f8c113f2be2dbad49c8db
Narumol Prangnawarat [Fri, 7 Feb 2020 10:28:31 +0000 (10:28 +0000)]
IVGCVSW-4402 add boost and armnn path to sample dynamic backend
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ibeed3301352d8f15e144f8466d8a26b21c744b84
Narumol Prangnawarat [Fri, 7 Feb 2020 09:46:31 +0000 (09:46 +0000)]
IVGCVSW-4418 disable unused variable and parameter warning for Caffe protobuf cc
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I903b75276b0c98894d8116a3d244103a910efa63
Sang-Hoon Park [Wed, 8 Jan 2020 10:25:24 +0000 (10:25 +0000)]
MLCE-139: add capability to align corners for bilinear resize
* Add parsing of the related parameter to TfLiteParser
* Update ResizeDescriptor to store the additional parameter
* Update NEON/CL workload to pass the additional parameter.
* Update Reference workload to pass and handle the additional parameter.
!ComputeLibrary:2538
!ComputeLibrary:2569
!armnn:2612
Signed-off-by: Sang-Hoon Park <sang-hoon.park@arm.com>
Change-Id: Id149e1c24c2abed7e9dd81939acf54dfabfcdfd2
Teresa Charlin [Fri, 7 Feb 2020 09:06:28 +0000 (09:06 +0000)]
Update ACL pin to
c971cf1034a61875c8e8c87d48634cbfac3865fd
* COMPMID-3090: Fail NEON/ColorConvert/RGBtoU8
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I551e5a6e4d755a52e67298b94c44ede61c8431c0
Colm Donelan [Wed, 5 Feb 2020 17:48:59 +0000 (17:48 +0000)]
IVGCVSW-4317 Implement the Profiling Context Initialisation
* Call CreateBackendProfilingContext on each backend from Runtime passing
an instance of the BackendProfiling interface.
* Modify the signature of CreateBackendProfilingContext to remove const
and return a shared_ptr to BackendProfilingContext
* Add concrete BackendProfiling class.
* Store BackendProfilingContexts in Profiling service.
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I975eaa2093ae91fa623835f65f9e5b25eb65117a
Kevin May [Thu, 6 Feb 2020 09:16:45 +0000 (09:16 +0000)]
Update ACL pin to
4bce11548268b9a10b0f06eff3cff9ae06d5b9dd
* COMPMID-3063: Address Custom Convolution failures
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I9fce935d72aca67198ab381351828cd016c0c41d
Narumol Prangnawarat [Tue, 4 Feb 2020 14:45:41 +0000 (14:45 +0000)]
IVGCVSW-4404 Add libraries to sample dynamic backend for android
* Add Boost and armnn paths
* Add CreateBackendProfilingContext, CreateWorkloadFactory,
CreateBackendProfilingContext
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Ib36d751b15450a922c12895e292abafe06f9e7cf
Derek Lamberti [Tue, 4 Feb 2020 14:49:16 +0000 (14:49 +0000)]
IVGCVSW-4389 Enable ClTuner in ClContextControl
Change-Id: If169736c4523a92f9aa10eac13e320eb41088624
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Matthew Bentham [Fri, 24 Jan 2020 23:11:43 +0000 (23:11 +0000)]
Clean up header usage a bit in NEON backend
Including NEFunctions.h is unnecessary and adds about a second
to compile time each translation unit in which it appears,
so we should use just the header file with the arm compute function
declarations that we need.
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
Change-Id: I605d0eb82ccf2aafa35381a5d9d54337d3fe17a7
Tee Jung [Tue, 5 Nov 2019 10:48:25 +0000 (10:48 +0000)]
Build graph->inputIds/outputIds with layerBindingId instead of layerIndex
Signed-off-by: Jung Tae-young tee.ty.jung@openedges.com
Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
Change-Id: I25ceeca70e72fad88ab039aed5a5ab6a7cc08c6c
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Matthew Bentham [Tue, 4 Feb 2020 10:03:55 +0000 (10:03 +0000)]
Github #273 Handle failure to initialise BackendContext in Runtime
Define CreateBackendContext to throw BackendUnavailableException
if necessary runtime components are missing.
Handle this in the constructor of Runtime by not adding those
backends to the internal DeviceSpec owned by the Runtime.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: Iadffb5240e32e1f105683c4d361276b92d1e720c
Keith Davis [Tue, 4 Feb 2020 09:31:47 +0000 (09:31 +0000)]
IVGCVSW-4390 Refactor QUANTIZE to make use of Decoder/Encoder types
* Fix bug where QSymmS8 is duplicated and F16 is missing
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I312815868e74a9dff913bac052f1a86585644098
Teresa Charlin [Mon, 3 Feb 2020 18:15:00 +0000 (18:15 +0000)]
IVGCVSW-4365 Update ACL pin to
5c829cab49b0dcffd893065af05f0bf028e7a548
* Fix CTS for ArgMinMax
Change-Id: I61ac4f80550bc3cbf2e19af5e602e3070c43ea1d
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Narumol Prangnawarat [Mon, 3 Feb 2020 12:29:56 +0000 (12:29 +0000)]
IVGCVSW-4399 Create Sample Dynamic backend
* Move IWorkload and WorkloadInfo to include/armnn/backends
* Add simple sample dynamic backend with addition workload
* Add sample example to run dynamic backend
* Unit tests
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I0753ce35b8e8a6223a1471388b49246d82438a44
Keith Davis [Mon, 3 Feb 2020 14:47:54 +0000 (14:47 +0000)]
IVGCVSW-4334 Wire Signed Quantized 8 bit type into ACL
* Add QSymmS8 LayerSupport tests for all backends
* Update BatchNormalization IsLayerSupport Bias' QSymmS8 case
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: Ib66befe11f9df5956869eb80699fc415a4d3fa16
Jim Flynn [Sun, 2 Feb 2020 12:52:59 +0000 (12:52 +0000)]
IVGCVSW-4393 Register backend counters
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I419ecc2fce4b7e0fcaeb6d1f9cb687c0b660125d
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Jim Flynn [Thu, 30 Jan 2020 14:10:55 +0000 (14:10 +0000)]
IVGCVSW-4394 Add CounterIdMap to Profiling Service
Change-Id: I416397a7855fe45319b4801252e141b78f0325f0
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Keith Davis [Wed, 29 Jan 2020 16:52:59 +0000 (16:52 +0000)]
IVGCVSW-4390 Refactor QUANTIZE to make use of Decoder/Encoder types
* Add no-ops for CL/NEON Uint8
* Refactor Quantize workload to Decoder/Encoder types
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I80b09de528299b925e2ac38acd9a5019b8d3e4ac
Teresa Charlin [Fri, 31 Jan 2020 10:21:44 +0000 (10:21 +0000)]
IVGCVSW-4388 Update ACL pin to
6a342648ae50beb8457871862f14fc9baef6b74f
!android-nn-driver:2671
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ifeb6be7812fbb98b37f2a1439bfd5a3215de2a62
Narumol Prangnawarat [Fri, 31 Jan 2020 11:59:06 +0000 (11:59 +0000)]
IVGCVSW-4196 Add condition to check to add common source for Android
to dynamic reference CMakeLists
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I7a60903e2af0fdbceabbad312616ecc049f9701d
Jan Eilers [Thu, 30 Jan 2020 13:50:36 +0000 (13:50 +0000)]
IVGCVSW-4171 Temporarily disable DumpOutgoingValidFileEndToEnd unit test
* Test causes intermittent failures on CI system
* Temporarily disabled until fix is found
Signed-off-by: Jan Eilers <jan.eilers@arm.com>
Change-Id: I689a4688d64040d557c63829a765d2c07c4fac3a
David Monahan [Thu, 30 Jan 2020 12:44:23 +0000 (12:44 +0000)]
IVGCVSW-4391 Add Global/Backend Counter ID map
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I943e02bc2026564e3a19d03e81ba75850d204497
Narumol Prangnawarat [Tue, 28 Jan 2020 16:50:13 +0000 (16:50 +0000)]
IVGCVSW-4322 Remove deprecated AbsLayer and RsqrtLayer and add source
for all environment to dynamic reference backend CMakeLists
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I2db1f48597b2af08c9d6d8d052ca08e885e51563
Ryan OShea [Wed, 29 Jan 2020 16:19:55 +0000 (16:19 +0000)]
IVGCVSW-4149 Enable quantisation multiplier > 1 in all convolutions
Signed-off-by: Ryan OShea <Ryan.OShea2@arm.com>
Change-Id: I9652844a868ce8e05c0433c051e7079cf203c422
Colm Donelan [Wed, 29 Jan 2020 15:22:43 +0000 (15:22 +0000)]
IVGCVSW-4316 First draft of IBackendProfiling and IBackendProfilingContext
* Introduce two new backend profiling interfaces IBackendProfiling
and IBackendProfilingContext.
* Add a mechanism to pull a context from a backend through IBackendInternal
* Update CL, Neon and Ref backends to return an empty profiling backend.
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I6e7438fcb126ad7a073a226862dc44836c9998b7
Ryan OShea [Thu, 23 Jan 2020 11:56:05 +0000 (11:56 +0000)]
IVGCVSW-4152 Remove check for QAsymm8 in ArgMinMax CL layer support
* Added ClLayerTests
* Added ClEndToEndTests
Signed-off-by: Ryan OShea <ryaosh02@e121865.galway.arm.com>
Change-Id: I1512ebae248dee9a0e6a8c4f52ecf99f677a22c6
Keith Davis [Mon, 27 Jan 2020 15:24:59 +0000 (15:24 +0000)]
IVGCVSW-4306 Verify the tflite Yolo v3
* Added debug layer support for QSymmS8
* QSymmS8 support for workloads
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I51af92fadc0be290629dd9198beab5abef9e351f
Keith Davis [Wed, 22 Jan 2020 11:57:54 +0000 (11:57 +0000)]
IVGCVSW-4335 Add support for per-channel QSymm8 to TfLite parser
Signed-off-by: Keith Davis <keith.davis@arm.com>
Change-Id: I52f777f56138a27655a821aff376ecd0d3d23511
Teresa Charlin [Tue, 21 Jan 2020 13:29:22 +0000 (13:29 +0000)]
IVGCVSW-4360 Update ACL pin to
19bd412fd044197726dbd8c756dbd74a9e33fd2b
!android-nn-driver:2614
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I3b4019cb562bd13cc661d9c175de4e3e1adea9a2
Teresa Charlin [Tue, 28 Jan 2020 12:24:34 +0000 (12:24 +0000)]
IVGCVSW-4369 Add default offset and scale to IsLayerSupportedTestImpl
*Fix IsLayerSupportedUint8Cl failure due to scale=0
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I6e5125eccdd495a9c98b434837d1e9ab371a4e8e
Colm Donelan [Fri, 24 Jan 2020 16:27:02 +0000 (16:27 +0000)]
IVGCVSW-4316 Promote ISendTimelinePacket and IProfilingGuidGenerator
As part of IVGCVSW-4316 we need to expose ISendTimelinePacket and
IProfilingGuidGenerator to enable them to be used by backends for
profiling. This also required moving ProfilingRelationshipType from
ProfilingUtils.
Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
Change-Id: I58cc64e32ecfffa5231c9d2028522ed58d0ddf31
Narumol Prangnawarat [Mon, 27 Jan 2020 14:13:03 +0000 (14:13 +0000)]
IVGCVSW-4313 Add Android case to dynamic reference CMakeLists
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I10724f2874018fb214cd12c3aef45be5347a8306
Mike Kelly [Mon, 27 Jan 2020 12:14:47 +0000 (12:14 +0000)]
IVGCVSW-4380 Add NEON backend support for BatchToSpaceNd
* Added NeonBatchToSpaceNdWorkload class.
* Added CreateBatchToSpaceNd implementation to NeonWorkloadFactory.
* Added IsBatchToSpaceNdSupported implementation to NeonLayerSupport.
* Enabled BatchToSpaceNd tests on Neon backend.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I179feefaa67dc87a03fcbe52e5df100c1188f9a5
Kevin May [Thu, 12 Dec 2019 17:28:05 +0000 (17:28 +0000)]
IVGCVSW-4262 Use ACL Permute and Reshape Validate function in Neon and CL
!android-nn-driver:2642
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: Ibabb73c0ae0df2e530a68398f75c76e6b80c0701
David Monahan [Fri, 24 Jan 2020 09:13:33 +0000 (09:13 +0000)]
Updates to Filesystem.cpp/hpp and NetworkSockets.cpp/hpp to fix failing master
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I566c29754aa586167a938d2c2b4e5069a39b5e50
Pablo Tello [Thu, 23 Jan 2020 10:37:17 +0000 (10:37 +0000)]
MLCE-156: Add Division workload in CpuAcc
Change-Id: I1f228fcaf1077867d9755a2b850c6703387fab34
Signed-off-by: Pablo Tello <pablo.tello@arm.com>
Mike Kelly [Fri, 24 Jan 2020 11:27:50 +0000 (11:27 +0000)]
IVGCVSW-4374 Add NEON backend support for SpaceToBatchNd
* Added NeonSpaceToBatchNdWorkload class.
* Added CreateSpaceToBatchNd implementation to NeonWorkloadFactory.
* Added IsSpaceToBatchNdSupported implementation to NeonLayerSupport.
* Enabled SpaceToBatchNd tests on Neon backend.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: Ic7d469a380482ec9febd44450f72dd7e53cda03f
Rob Hughes [Tue, 7 Jan 2020 09:40:12 +0000 (09:40 +0000)]
Add ARMNN_DLLEXPORT macro to import/export static data symbols on Windows
Armnn has several static data symbols that are needed by the unit tests.
These are now explicitly marked for import when that header is included
from the unit test code.
See also https://cmake.org/cmake/help/v3.4/prop_tgt/WINDOWS_EXPORT_ALL_SYMBOLS.html.
Change-Id: I4e71ba659b6321659a1396125b5a9c271578040f
Signed-off-by: Robert Hughes <robert.hughes@arm.com>
Derek Lamberti [Wed, 22 Jan 2020 15:37:29 +0000 (15:37 +0000)]
IVGCVSW-4370 Deprecate DataType::QuantizedSymm8PerAxis
!android-nn-driver:2622
Change-Id: If99d3eff71ff66ba28af1e5af248299fe04511b9
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
josh minor [Mon, 6 Jan 2020 22:40:46 +0000 (16:40 -0600)]
IVGCVSW-4259 Add frontend and reference workload for UnaryOperationLayer
* Added new layer named ElementwiseUnary
* Deprecated existing Abs/Rsqrt layer functions
* Updated existing Abs/Rsqrt test infrastructure to use new layer
* Added boilerplate for new Exp,Neg,Sqrt elemwise op layers
* AbsQuantize test removed pending future commit
* Serialization support added
!android-nn-driver:2550
Change-Id: Ic595c645925e17b45db568187fd05646daf2e87f
Signed-off-by: josh minor <josh.minor@arm.com>
Teresa Charlin [Thu, 23 Jan 2020 11:44:24 +0000 (11:44 +0000)]
IVGCVSW-4268 Print all Descriptors on dot graph
Change-Id: I82a7dcffc3771efa8350e2e1e22cfb20969551f9
Signed-off-by: Jim Flynn <jim.flynn@arm.com>
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
David Monahan [Wed, 22 Jan 2020 15:40:34 +0000 (15:40 +0000)]
Add check to NetworkSockets.cpp to fix failing Android build
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: Ieaa91fae464047c6eeff557b4e01dac09653473d
Rob Hughes [Tue, 7 Jan 2020 17:05:24 +0000 (17:05 +0000)]
Add thin abstraction layer for processes and filesystem
This is used instead of some hardcoded Unix calls and means this code
now works on Windows
(This is a rework of a previous patch which used boost, now that I have
been informed that we are trying to move towards removing boost).
Change-Id: Ib0d11055279bbd7b710f086e9890369e3ecbfe9a
Signed-off-by: Robert Hughes <robert.hughes@arm.com>
Rob Hughes [Mon, 13 Jan 2020 11:14:59 +0000 (11:14 +0000)]
Add thin abstraction layer for network sockets
This makes SocketProfilingConnection and GatordMock work on Windows as
well as Linux
Change-Id: I4b10c079b653a1c3f61eb20694e5b5f8a6f5fdfb
Signed-off-by: Robert Hughes <robert.hughes@arm.com>
Derek Lamberti [Tue, 21 Jan 2020 13:43:21 +0000 (13:43 +0000)]
IVGCVSW-4364 Only apply deprecated attribute where available
Change-Id: Ifde03ea6d9057db0949acad95560be8852c05f73
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Francis Murtagh [Fri, 17 Jan 2020 11:18:01 +0000 (11:18 +0000)]
IVGCVSW-4239 Remove dynamic link to libOpenCL.so
* Instead rely on ACL's dlopen() to dynamically load the libraries
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: I2b451c1c382f3baf51665da9add8f2415353849a
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Mike Kelly [Mon, 20 Jan 2020 17:18:18 +0000 (17:18 +0000)]
IVGCVSW-4331 Calling RemoveDebugLayers can break connections
* Changed RemoveDebugLayers to move all connections from its OutputSlot.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I3c649e3f660804ca48f3c2af993a5af6a7ed4d4a
Matthew Bentham [Mon, 20 Jan 2020 16:16:06 +0000 (16:16 +0000)]
Remove inclusion of ArmNN.hpp where it is unnecessary.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: Idb583f8de4470eefb47c90189cd3c90e74e0440a
Matthew Bentham [Mon, 20 Jan 2020 10:09:09 +0000 (10:09 +0000)]
Remove use of ArmNN.hpp where it is unnecessary.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: I6c90eab1c6bad76d5c7b3bf094998fa4b454bcd1
Matthew Bentham [Fri, 17 Jan 2020 11:47:42 +0000 (11:47 +0000)]
Remove use of ArmNN.hpp from other public headers
Also remove it from armnnSerializer and armnnUtils.
In general code within Arm NN should only include exactly what it needs.
This will help keep compile times down, and reduces the need for a
complete rebuild when anything in the public headers changes.
ArmNN.hpp should only be provided as a convenience for user code where the
user doesn't know enough of the API to decide which specific headers
they need.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: I4ffcaa7662af4f88a1babf2bf17d03da6f77d665
Nikhil Raj [Mon, 20 Jan 2020 11:50:16 +0000 (11:50 +0000)]
IVGCVSW-4106 Network not failing when Inference time is greater than threshold time
Signed-off-by: Nikhil Raj <nikraj01@e110586.galway.arm.com>
Change-Id: I4e5f96cb3a843a4ae29bad539c0eed42282344a8
Narumol Prangnawarat [Thu, 9 Jan 2020 10:16:39 +0000 (10:16 +0000)]
Add Signed32 to debug layer
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: Iedfc196bfd18e8280e99a06db68df9c15c8ea835
Matthew Bentham [Fri, 17 Jan 2020 09:36:49 +0000 (09:36 +0000)]
Github #320 Add logging and error checking to SimpleSample
These things are frequently asked questions, so I think it makes sense
to add them to the basic sample.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: I17cacb37fbe87e2a8fb14e7b7e85ebc528575386
Matthew Bentham [Wed, 15 Jan 2020 17:55:08 +0000 (17:55 +0000)]
Remove Logging.hpp from ArmNN.hpp
Logging.hpp is mainly useful for raising Arm NN log messages. There's
very little point in automatically including it for users of the library
via the ArmNN.hpp convenience header.
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Change-Id: I71fb3188dc0b30c1bbc86a31996470c707d38c19
Matthew Bentham [Wed, 15 Jan 2020 17:21:38 +0000 (17:21 +0000)]
Remove use of boost from Logging.hpp
This helps prevent leaking of boost names into Arm NN public headers.
Change-Id: I1605d2ed178965f8e502bc6a4b4ac3e627bbbbed
Signed-off-by: Matthew Bentham <Matthew.Bentham@arm.com>
Rob Hughes [Tue, 7 Jan 2020 13:26:42 +0000 (13:26 +0000)]
Support different flatbuffer libs for debug and release
The existing FLATBUFFERS_LIBRARY variable is still honoured, but if
not specified then we use CMake's find_library to find the debug and release
variants, using PATH_SUFFIXES to help separate debug and release.
This is the same approach we use for the armcompute libs.
Change-Id: I21e8da3f76669dbfb8dbdf49046f9db46cba50a2
Signed-off-by: Robert Hughes <robert.hughes@arm.com>
Rob Hughes [Fri, 10 Jan 2020 09:15:30 +0000 (09:15 +0000)]
Fix typo in name of GatordMock executable :O
Change-Id: I36cbaa89dd521728835ca1e90da27a5f9b93a89d
Signed-off-by: Robert Hughes <robert.hughes@arm.com>
Sadik Armagan [Tue, 10 Dec 2019 16:32:07 +0000 (16:32 +0000)]
IVGCVSW-4193 Add QUANTIZE to the TfLite parser
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
Change-Id: I53431c70edb64c9283ae556407cc07e54469d8cc
Finn Williams [Thu, 19 Dec 2019 17:05:18 +0000 (17:05 +0000)]
IVGCVSW-4229 Fix Intermittent failures in ExternalProfiling
* Added a BufferManager.Reset() method to prevent packets being retained after a test
* Fixed a bug causing the send thread to wait needlessly before moving to active state
* Refactored SendCoundPacketTests and ProfilingTests test helper classes
* Fixed issue where WaitForPacketSent could miss a notification and timeout
Signed-off-by: Finn Williams <Finn.Williams@arm.com>
Change-Id: I353a652260c2f7dd465baa9e979e22f50f3ca6a7
Derek Lamberti [Fri, 10 Jan 2020 17:14:08 +0000 (17:14 +0000)]
Rename quantized data types to remove ambiguity for signed/unsigned payloads
!android-nn-driver:2572
Change-Id: I8fe52ceb09987b3d05c539409510f535165455cc
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Francis Murtagh [Thu, 9 Jan 2020 14:24:11 +0000 (14:24 +0000)]
Update commented clframework revision to match SHA of actual pinned ref
* Prevent confusion as branches/arm_compute_19_11 had different SHA
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: I9348f444a9c132285977e2768bc6124b10e58e15
Rob Hughes [Thu, 9 Jan 2020 10:59:34 +0000 (10:59 +0000)]
Fix issues due to #include Windows.h
Change-Id: I9d77b5ad6cd81e87217da0c47788a43834c3ac28
Signed-off-by: Robert Hughes <robert.hughes@arm.com>
Rob Hughes [Thu, 9 Jan 2020 12:46:21 +0000 (12:46 +0000)]
Fix build error on gcc 7+ for implicit switch statement fallthroughs
Change-Id: I48632a42892d8e9a616255fe106e40161b0ee55f
Signed-off-by: Robert Hughes <robert.hughes@arm.com>
Derek Lamberti [Tue, 10 Dec 2019 22:20:54 +0000 (22:20 +0000)]
IVGCVSW-4246 Enable -Wextra by default
!referencetests:218340
Change-Id: If24a604310d0363b1f09b406e4d53ebfeb106aad
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Derek Lamberti [Tue, 10 Dec 2019 22:00:43 +0000 (22:00 +0000)]
IVGCVSW-4246 Clean build of parsers with -Wextra
Change-Id: Ib00f185b431ab74fd9425d8f478bd2ddb182f74b
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Derek Lamberti [Thu, 2 Jan 2020 13:50:57 +0000 (13:50 +0000)]
IVGCVSW-4246 Clean build of profiling with -Wextra Pt2
Change-Id: Iae306546e7c009105712f177943ed76451bbe8e7
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Narumol Prangnawarat [Thu, 2 Jan 2020 17:46:53 +0000 (17:46 +0000)]
IVGCVSW-4195 Fix MultipleNetworksCifar10 test to load dynamic backend
before checking if requested backends are valid
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I5274d27a50fa10f0c86275140acec7bdc681a24f
Derek Lamberti [Tue, 10 Dec 2019 22:07:09 +0000 (22:07 +0000)]
IVGCVSW-4246 Clean build of backends with -Wextra
Change-Id: I9e8d5576b3ec04c871785d5f2f9545bf1136e59b
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Francis Murtagh [Tue, 31 Dec 2019 12:44:20 +0000 (12:44 +0000)]
IVGCVSW-4246 Clean build of ArmNN API with -Wextra
Change-Id: I6003d2f82ca02d926dd95abee712337783eacfc7
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Derek Lamberti [Tue, 10 Dec 2019 21:23:23 +0000 (21:23 +0000)]
IVGCVSW-4246 Clean build profiling with -Wextra
Change-Id: Ieab870fa2194075433a0a26abdb13f69e1fbaaae
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
Derek Lamberti [Tue, 10 Dec 2019 22:05:21 +0000 (22:05 +0000)]
IVGCVSW-4246 Clean build of Visitors with -Wextra
Change-Id: Icb1b35ff55fa22103777853e6f49fc282d61750d
Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>