platform/upstream/dldt.git
4 years agofix path to code snippets in Custom_ONNX_Ops.md (#2764)
Mateusz Tabaka [Wed, 28 Oct 2020 03:20:52 +0000 (04:20 +0100)]
fix path to code snippets in Custom_ONNX_Ops.md (#2764)

4 years ago[IE][VPU]: Implement HSwish layer with tests (#2775)
Maksim Doronin [Tue, 27 Oct 2020 21:38:10 +0000 (00:38 +0300)]
[IE][VPU]: Implement HSwish layer with tests (#2775)

* Implement HSwish layer with tests
* Disable HSwish decomposition by a predicate
* Update vpu firmware

4 years agoONNX Loop operation support (#2756)
Evgeny Lazarev [Tue, 27 Oct 2020 20:04:43 +0000 (23:04 +0300)]
ONNX Loop operation support (#2756)

* Generate TensorIterator without back edges from TensorFlow models

* Added a check in the MarkSubgraphsWithCorrectLayout to not fail when port is not connected

* Updated the 'protobuf2nx' to consume the graph protobuf message

* Cleanup TI from the IRv7 specific code

* Do not run some front transformations recursively

* Draft support for the ONNX Loop operation when 'cond' = True

* LoopToTI transformation changes

* Added draft of Loop operation and parser for ONNX Loop operation body

* Updated Loop body parser + added shape and type infer for the Loop operation

* Fixes for ONNX Loop operation parser

* Moved Loop parsing to Loop op extractor. Added generation of external edges for the Loop body ops

* Added support for ThresholdedRelu using decomposition

* Added support for Min ONNX operation

* Draft fixes for port_map generation for the Loop

* Rename transformation file and fix BOM

* Fixed shape inference for Loop scan outputs (axis is not None)

* Fixed shape inference for ONNX Loop operation

* Refactor checks in the TensorIteratorMerge transformation

* Code refactoring. Enabled commented transformations

* Documentation update for ONNX Loop, ThresholdedRelu and Min

* Fixed typo in the Loop front transformation where execution condition input is connected. Other refactorings

* Fixed in the Loop extractor

* Added printing 'internal_layer_id' attribute in the graph dumper

* Updated calculation of iterations number for the Loop

* Added missing code

* Fixed output port shapes and types generation for Loop operation

* Update function names and variable names in the Loop operation

* Fixed type inference for iteration count input

* Added removal of input/output ports of the Loop if they are not used

* Fixed renumbering Loop operations input/output ports to keep mandatory

* Fixed ThresholdedReluDecomposition transformation

* Updated MO IR Reader to know about Loop operation. But it is still not supported by the MO IR Reader

* Added unit test for Slice op shape infer (reverse the sequence of elements)

* Reverted changes in the ONNX loader function call to protobuf2nx

* Enable Reshape0DToSqueeze transformation recursively

* Refactored Loop operation support implementation

* Changed ThresholdedReluDecomposition to generate Const with shape [1] instead of scalar

* Code style and wording fixes

* Restored accidentally removed 'return' statement in the TI shape infer function

* Fixed comments

* Fixed comment

Co-authored-by: Evgeny Lazarev <elazarev.nnov@gmail.com>
4 years agoEnable Logical Reduction tests which currently pass (#2776)
Michał Karzyński [Tue, 27 Oct 2020 13:26:15 +0000 (14:26 +0100)]
Enable Logical Reduction tests which currently pass (#2776)

4 years agoBump infra
Andrey Babushkin [Tue, 27 Oct 2020 12:12:33 +0000 (15:12 +0300)]
Bump infra

4 years ago[ONNX] Extend ONNX importer with Round-5 (#2749)
Jan Iwaszkiewicz [Tue, 27 Oct 2020 10:01:23 +0000 (11:01 +0100)]
[ONNX] Extend ONNX importer with Round-5 (#2749)

4 years agoMSVC warnings fix (#2620)
Andrey Kamaev [Tue, 27 Oct 2020 09:24:57 +0000 (12:24 +0300)]
MSVC warnings fix (#2620)

* Fix MSVC build warnings in Ngraph

* Fix MSVC build warnings in transformations library

* Fix MSVC build warnings in core,legacy,preprocessing

* Fix MSVC build warnings in XLink

* Fix MSVC build warnings in Myriad plugin

4 years agoAvoid excess tensor copy for Reshape/Squeeze/Unsqueeze folding (#2834)
Gleb Kazantaev [Tue, 27 Oct 2020 09:05:02 +0000 (12:05 +0300)]
Avoid excess tensor copy for Reshape/Squeeze/Unsqueeze folding (#2834)

* Updated Reshape ConstantFolding to avoid excess tensor copies

* Updated Squeeze/Unsqueeze CF to avoid excess tensor copies

* Fixed typo

4 years ago[IE][VPU]: Config key to disable weights analysis pass (#2714)
Monica-elena Burger [Tue, 27 Oct 2020 08:52:18 +0000 (10:52 +0200)]
[IE][VPU]: Config key to disable weights analysis pass (#2714)

* Add config key to disable weights analysis pass in graph transformer

4 years ago[IE][VPU]: Bidirectional mode for broadcast on vpu (#2627)
Polina Brzezinskaya [Tue, 27 Oct 2020 08:49:35 +0000 (11:49 +0300)]
[IE][VPU]: Bidirectional mode for broadcast on vpu (#2627)

* Support for bidirectional broadcast mode

4 years ago[IE CLDNN] Added Round-5 operation (#2838)
Roman Lyamin [Tue, 27 Oct 2020 07:56:15 +0000 (10:56 +0300)]
[IE CLDNN] Added Round-5 operation (#2838)

4 years ago[Samples] Python: added support of onnx models (#2782)
Mikhail Ryzhov [Tue, 27 Oct 2020 07:23:25 +0000 (10:23 +0300)]
[Samples] Python: added support of onnx models (#2782)

* [Samples] Python: added support of onnx models

* [Docs] Python: added support of onnx models

Updated documentation

4 years agoRemove obsoleted v0::Gather and v0::GatherND (#2826)
Mateusz Tabaka [Tue, 27 Oct 2020 07:07:48 +0000 (08:07 +0100)]
Remove obsoleted v0::Gather and v0::GatherND (#2826)

4 years agoAdd nGraph function serialization. (#2579)
Jozef Daniecki [Tue, 27 Oct 2020 03:57:48 +0000 (04:57 +0100)]
Add nGraph function serialization. (#2579)

* Add nGraph function serialization.

* Turn of execption throwing on failed visitation.

* CNNNetworkNgrapImpl serialize also support fallback to v7 serialization.

* Add error message for legacy IR not implemented case.

* Store tests models in files.

* Add tests with multiple layers.

* Style aligned to IE rules.

* Add visit_attributes to ExecutionNode.

* Layer version XML atribute implementation.

* Fix opset atribute creation for ExecutionGraph. Refactoring.

* Add missing header.

* Move opset collecting to private scope.

* Add missing header.

* Add test wit multiple oututs. Fix found issues: constant name, result
outputs.

* Move serialization to transformation library.

* Add versioning to serialization transformation.

* Add functional tests with ONNX importer path.

* Add nodes unique name checking and correction.

* Add checks for unsuported cases: dynamic shapes & GenericIE node

* General refactoring.

* Add comment describing type name translations.

* Add serialization deterministicity tests.

It's needed to ensure that subsequent calls to serialize() on the same function are giving the same results.

* Serialization in CNNNetworkNGraphImpl::serialize executed via pass::Manager.

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
* NGRAPH_CHECK messages refactored.

* Performance and const correctness refactoring.

* Style formatting applied.

* Code simplifaction.

* Serialize transformation documentation refactoring.

* Changed compare_function() to throw on functions with multiple outputs.

Before this check was implemented with assert which means it was working
only in debug builds. Now it is working also in release build.

* Adjust tests to new compare_functions() behaviour.

* Replace cmakes add_definitions with more modern target_compile_definitions

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
4 years agoFeature/azaytsev/merge to master (#2786)
Andrey Zaytsev [Mon, 26 Oct 2020 21:41:46 +0000 (00:41 +0300)]
Feature/azaytsev/merge to master (#2786)

* [IE CLDNN] Memory allocation optimizations (#2178)

* [GNA] Safety fixes (#2193)

* LSTMCell test [GNA] LSTMCell fix for GNA (#2216)

* [GNA] fix scale factor calculation for unfused bias after fc (2021.1) (#2195)

* [GNA] fix scale factor calculation for unfused bias after fc

* change check

* add test

* apply requested changes

* cpplint fix

* apply test changes

* modify model for test to match ::op::

* [LPT] Copy constant with several outputs before blob update (#2197)

* [LPT] Copy constant implementation

* [LPT] the same Constant ops as FQ interval boundaries

* [Scripts] Fixing issue with exporting path-like env when it undef  (#2164)

* setupvars.sh: Added logic for exporting path env in case if it not defined

* setupvars: Removed duplicated colon

* Kept quotes where they were

* setupvars: updated copyrights

* FakeQuantize + Mul fusion (#2133)

* FQ+Mul fusion transform skeleton

* FQ+Mul fusion transform tests prep

* Basic UT for the transform

* Basic implementation of the transform

* Parametrized UTs for FQMul transform

* Parametrization of FQ+Mul UTs

* Make sure that the shapes of constants match

* Check if the mul constant matches FQ data

* CentOs compilation error fix

* PR feedback and adjusted tests

* NHWC layout of the mul constant

* UT: FQ output limits 4D

* Redundant CF pass removed

* Rewrite the graph in a different way

* Shape checking infrastructure skeleton

* Handle some negative cases

* Check the rt info in the fusion test

* Fuse all Mul nodes detected after FQ node

* Dont cast the original FQ node

* Dont throw if CF fails in new output range calculation

* More UTs

* Accept any type of input to FQ in the transformation

* Test the fusion when all FQ inputs are non-const

* Fusion test when only one output limit is const

* Extend error message (#2174)

* some nGraph KW fixes (#2176)

* Removed redundant methods

* Fixed KW for linux

* Fix QueryNetwork for networks with KSO (#2202)

* Added a test to reproduce QueryNetwork with KSO

* Fixed QueryNetwork for networks with KSO

* Added additional test

* Fixed output names for case with redundant ops before result (#2209)

* [IE][VPU]: Workaround to support parameter Beta for layer Swish (#2207)

* Workaround to full support Swish layer. It is faster than native Swish for now.

* [IE][VPU]: Remove the second call of ngraph::CommonOptimizations (#2221)

* Remove the second call of ngraph::CommonOptimizations in myriad plugin
* Reuse code with vpu ngraph transformations

* Duplicate PR 2167 for release branch: GatherTree description was extended and outdated link fixed (#2235)

* add more alrifications to description

* move clarification to comment

* pseudo code become more accurate

* review changes

* Add exposing function signatures via Cython (#2244)

* [DOC] Reshape feature (#2194)

* [IE][VPU][OpenCL] 2021.1 release compiler (#2189)

* Statically analyzed issues. (#2261)

* [IE][VPU]: Fix K propagation through Reshape (2021.1) (#2180)

* Fix K propagation through Reshape
* Add test cases

* Revert "[IE TESTS] dynavic batch for mvn layer (#1010)" (#2256)

This reverts commit 2e3378c50feb96df2bb8cb719bf0745705e35ad9.

* Fixed KW warning and review issues (#2262)

* [IE][VPU]: update firmware 1381 (#2236)

* Reverting devicePriorities to be vector and respect the order, as opposed to the incorrect (recent?) refactoring that introduced the unordered_map that effectively ignores the priorities (#2251)

* update OpenCV version to 4.5.0 (#2260)

* Add VPUX configuration to compile_tool (#2248)

* [IE][TESTS] Fix compareRawBuffers and compareBlobData methods (#2246)

Use `<=` comparison instead of `<` with thresholds.
This allows to use `0` threshold for bit-exact comparison.

* [IE][VPU]: KW fixes (#2186)

* Some KW fixes
* Fix printTo in vpu ngraph transformations

* Fix for static PartialShape detection algorithm (#2177)

* Fixes for Interpolate-4. (#2281)

* Update get_ov_update_message.py (#2286)

* Clone a specific tag for pybind11 (#2296)

* [Scripts] Fix setting PYTHONPATH logic (#2305)

* setupvars.sh: Added logic for exporting path env in case if it not defined

* setupvars: Removed duplicated colon

* install_openvino_dependencies: Updated copyrights

setupvars.bat: Updated notification about incorrect Python version. Removed checking ICC2019
setupvars.sh: Removed logic with choosing higher version of installed Python. Added dynamic detecting python3 major and minor version for setting path. Add checking minimum required Python version(now 3.6)

* Added python3-gi package and fixed libglib2.0-0 package location. (#2294)

* [IE TESTS] CoreThreading_LoadNetwork tests were disabled for GPU plugin (#2245) (#2283)

* setupvars: Updated notifications, fixed calling python in Windows case (#2318)

* Updated operations specification documents (2021.1) (#2268)

* Updated documentation structure and remove incorrect added files for Acosh-1, Asinh-1 and Atanh-1

* Fixed broken links

* Fixed c samples build (#2278) (#2304)

* Fixed c samples build

fixed CVS-38816 - Failure to build samples in C

* Fixed issue with gflags

* Revert "[IE][VPU]: Fix K propagation through Reshape (2021.1) (#2180)" (#2322)

This reverts commit d604a03ac0e639ba6dff3aa76f2830501a097fab.

* Added ONNX Resize-11 and ONNX Resize-13 to supported frameworks layers list. (#2325)

* Implement `run_executable.py` to run `TimeTests` several times (#2125) (#2188)

CI passed

* install_NEO_OCL_driver: Updated exit codes, messages. Updated way to remove old driver on Ubuntu (#2333)

* Bump cmake version to 3.13 (#2339)

* install_NEO_OCL_driver: Added checking of installed packages before trying to remove them. Added quotes for echo. (#2350)

* convert to doxygen comments

* add doxygen doc build configurations (#2191)

Co-authored-by: Nikolay Tyukaev <ntyukaev_lo@jenkins.inn.intel.com>
* [DOCS] Added an evaluate method for custom operation (#2272)

* Added an evaluate method for custom operation

* Fixed comments

* Downgrade cmake for samples (#2372)

* Downgrade cmake for samples

Downgraded cmake version to default version for Ubuntu 18.04

* Updated supported python version

The minimal python version in 2021.1 is 3.5

* Added notes about cmake requirements for samples and demo

* Install dependency refactoring. (#2381)

* Updated Transformation development doc (#2370)

* Delete xfail for resolved known issue (#2385)

* Fix layout links for dl streamer and c api (#2375)

* fix layouts

* change the dl-streamer link

Co-authored-by: Nikolay Tyukaev <ntyukaev_lo@jenkins.inn.intel.com>
* Added link options for cross-compilation (#2397)

* Added new GSG for macOS, made minor changes in Windows GSG (#2070) (#2405)

* Added new GSG for macOS, made minor changes in Windows GSG

* Update get_started_macos.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Fixed docs build on Windows (#2383)

* layouts and code comments

* Replace absolute links to docs.openvinotoolkit.org by relative ones (#2439)

* Replaced direct links to docs.openvinotoolkit.org with relative links

* Replaced direct links to docs.openvinotoolkit.org with relative links. Added GSGs for Win and macOS

* Minor fixes in GSGs

* Replaced direct links to docs.openvinotoolkit.org with relative links

* Removed links to OpenVINO markdown files that contain anchor - they don't work in the current implementation of the doc process

* Fixed Notes

* Removed links to OpenVINO markdown files that contain anchor - they don't work in the current implementation of the doc process

* fixed link to installing-openvino-linux.md

* Update the menu to align with POT doc headers (#2433)

* Update the menu to align with POT doc headers

It changes the menu to align with Post-training Optimization Toolkit documentation titles.

* Corrected one title

Run Examples => How to Run Examples

* Added closing braсket (#2466)

Fixed syntax error (b4b03b1)

* Remove the deprecation notice (#2314)

* Removed deprecation notice

* Removed the note from other files

* [DOCS] Update Installation Guide - GPU steps (#2308)

* Initial commit

* fixing lists

* Update installing-openvino-linux.md

* Get rid of the note

* Added the scrrenshot

* Update installing-openvino-linux.md

* fixes

* separate layout

* [Docs] Update MO What's new description (#2481)

* Azure CI: Add separated pipelines for Windows, Linux, Mac

* Feature/azaytsev/benchmarks 2021 1 (#2501)

* Initial changes for 2021.1

* Inserted Graphtool scripts, updated configurations info

* Updated FAQ and minor changes to performance_benchmarks.md

* Updated for 2021.1

* Updated

* incorporated review comments

* incorporated review comments for FAQ

* fixed link

* Update build-instruction.md for MacOsX (#2457)

* Update build-instruction.md for MacOsX

* Removed call of install_dependencies.sh from the steps

* Changed layouts

* Feature/azaytsev/cvs-38240 (#2469)

* Updated for 2020 version, replaced Ubuntu 16.04 with Ubuntu 20.04

* Updated the release package numbers

* Removed FPGA from the documentation

* Updated according to the comments in the ticket CVS-37827 (#2448)

* Updated according to CVS-38225

* some changes

* Update docs for speech libs and demos (#2518)

* Made changes to benchmarks according to review comments

* Remove `--collect_results_only` (#2523)

* Remove `--collect_results_only` from MemCheckTests

* Remove CLI keys from README

* Added logo info to the Legal_Information, updated Ubuntu, CentOS supported versions

* Updated supported Intel® Core™ processors list

* Fixed table formatting

* [Jenkinsfile] Bump infra (#2546)

* [GNA] Documentation updates for 2021.1 (#2460)

* [GNA] Documentation updates for 2021.1

* Take Mike's comments into account

* More fixes according to review

* Fix processor generation names

* update api layouts

* Added new index page with overview

* Changed CMake and Python versions

* Fixed links

* some layout changes

* some layout changes

* nGraph Python API tutorial (#2500)

* nGraph Python API tutorial

* Tweaks

* Code review comments

* Code review comments

* some layout changes

* COnverted svg images to png

* layouts

* update layout

* Added a label for nGraph_Python_API.md

* fixed links

* Fixed image

* First draft of nGraph documentation (#2271)

* First draft of nGraph documentation

* updated according to review comments

* Updated

* Reviewed the nGraph Transformation section, added missing images

* Update nGraph_dg.md

* Delete python_api.md

Removed since there is already the nGraph_Python_API.md document with a comprehensive overview.

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
Co-authored-by: CCR\avladimi <anastasiya.ageeva@intel.com>
* Feature/azaytsev/docs 2021 1 (#2560)

* Removed FPGA from the documentation

* Updated according to CVS-38225

* Added logo info to the Legal_Information, updated Ubuntu, CentOS supported versions

* Updated supported Intel® Core™ processors list

* Added new index page with overview

* Changed CMake and Python versions

* Fixed links

* COnverted svg images to png

* Added a label for nGraph_Python_API.md

* fixed links

* Fixed image

* Update SW requirements in build instructions and change latest release to 2021.1 (#2565)

* removed links to ../IE_DG/Introduction.md

* Removed links to tools overview page as removed

* some changes

* Remove link to Integrate_your_kernels_into_IE.md

* remove openvino_docs_IE_DG_Graph_debug_capabilities from layout as it was removed

* Fixed links to images (#2569)

* update layouts

* Added deprecation note for PassConfig class (#2593)

* Post-release fixes and installation path changes

* Added pip install documentation (#2465)

* Added pip install documentation

* Change references

* tiny fixes of links

* Update installing-openvino-pip.md

Co-authored-by: Alina Alborova <alina.alborova@intel.com>
* Update OpenVino ONNX CI check (#2599)

* Update OpenVino ONNX CI

* Change parallel execution to single

* Enlarge timeout

* Remove timeout

* Add timeout to test execution

* Added PIP installation and Build from Source to the layout

* Fixed formatting issue, removed broken link

* Renamed section EXAMPLES to RESOURCES according to review comments

* add mo faq navigation by url param

* Skip hanging test case of OpenVino ONNX CI (#2608)

* Update OpenVino ONNX CI

* Change parallel execution to single

* Enlarge timeout

* Remove timeout

* Add timeout to test execution

* Skip hanging test

* Add description to skip issue

* Removed DLDT description

* Replaced wrong links

* MInor fix for path to the cpp samples

* fixes

* Update ops.py

* Fix style

* Improve pip installation guide (#2644)

* Improve pip installation guide

* Updated after comments

* Feature/ntyukaev/separate layout (#2629)

* convert to doxygen comments

* layouts and code comments

* separate layout

* Changed layouts

* Removed FPGA from the documentation

* Updated according to CVS-38225

* some changes

* Made changes to benchmarks according to review comments

* Added logo info to the Legal_Information, updated Ubuntu, CentOS supported versions

* Updated supported Intel® Core™ processors list

* Fixed table formatting

* update api layouts

* Added new index page with overview

* Changed CMake and Python versions

* Fixed links

* some layout changes

* some layout changes

* some layout changes

* COnverted svg images to png

* layouts

* update layout

* Added a label for nGraph_Python_API.md

* fixed links

* Fixed image

* removed links to ../IE_DG/Introduction.md

* Removed links to tools overview page as removed

* some changes

* Remove link to Integrate_your_kernels_into_IE.md

* remove openvino_docs_IE_DG_Graph_debug_capabilities from layout as it was removed

* update layouts

* Post-release fixes and installation path changes

* Added PIP installation and Build from Source to the layout

* Fixed formatting issue, removed broken link

* Renamed section EXAMPLES to RESOURCES according to review comments

* add mo faq navigation by url param

* Removed DLDT description

* Replaced wrong links

* MInor fix for path to the cpp samples

* fixes

* Update ops.py

* Fix style

Co-authored-by: Nikolay Tyukaev <ntyukaev_lo@jenkins.inn.intel.com>
Co-authored-by: Tyukaev <nikolay.tyukaev@intel.com>
Co-authored-by: aalborov <alina.alborova@intel.com>
Co-authored-by: Rafal Blaczkowski <rafal.blaczkowski@intel.com>
Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
* Fixed CVS-35316 (#2072) (#2670)

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* [install_dependencies.sh] install latest cmake if current version is lower 3.13 (#2695) (#2701)

* [install_dependencies.sh] install latest cmake if current version is lower 3.13

* add shellcheck for Ubuntu

* install python 2.7 for Ubuntu

* Removed redundant file

* Exclude files that we didn't changed from merging

Co-authored-by: Sergey Shlyapnikov <sergey.shlyapnikov@intel.com>
Co-authored-by: Denis Orlov <denis.orlov@intel.com>
Co-authored-by: Kamil Magierski <kamil.magierski@intel.com>
Co-authored-by: Anna Alberska <anna.alberska@intel.com>
Co-authored-by: Edward Shogulin <edward.shogulin@intel.com>
Co-authored-by: Artyom Anokhov <artyom.anokhov@intel.com>
Co-authored-by: Tomasz Dołbniak <tomasz.dolbniak@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Roman Vyunov (Intel) <roman.vyunov@intel.com>
Co-authored-by: Maksim Doronin <maksim.doronin@intel.com>
Co-authored-by: Svetlana Dolinina <svetlana.a.dolinina@intel.com>
Co-authored-by: Evgeny Talanin <evgeny.talanin@intel.com>
Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
Co-authored-by: Maxim Kurin <maxim.kurin@intel.com>
Co-authored-by: Nikolay Shchegolev <nikolay.shchegolev@intel.com>
Co-authored-by: Andrew Bakalin <andrew.bakalin@intel.com>
Co-authored-by: Gorokhov Dmitriy <dmitry.gorokhov@intel.com>
Co-authored-by: Evgeny Latkin <evgeny.latkin@intel.com>
Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
Co-authored-by: Alexey Suhov <alexey.suhov@intel.com>
Co-authored-by: Alexander Novak <sasha-novak@yandex.ru>
Co-authored-by: Vladislav Vinogradov <vlad.vinogradov@intel.com>
Co-authored-by: Vladislav Volkov <vladislav.volkov@intel.com>
Co-authored-by: Vladimir Gavrilov <vladimir.gavrilov@intel.com>
Co-authored-by: Zoe Cayetano <zoe.cayetano@intel.com>
Co-authored-by: Dmitrii Denisov <dmitrii.denisov@intel.com>
Co-authored-by: Irina Efode <irina.efode@intel.com>
Co-authored-by: Evgeny Lazarev <evgeny.lazarev@intel.com>
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
Co-authored-by: Vitaliy Urusovskij <vitaliy.urusovskij@intel.com>
Co-authored-by: Nikolay Tyukaev <ntyukaev_lo@jenkins.inn.intel.com>
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>
Co-authored-by: Gleb Kazantaev <gleb.kazantaev@intel.com>
Co-authored-by: Rafal Blaczkowski <rafal.blaczkowski@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
Co-authored-by: Maksim Proshin <mvproshin@gmail.com>
Co-authored-by: Alina Alborova <alina.alborova@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: azhogov <alexander.zhogov@intel.com>
Co-authored-by: Alina Kladieva <alina.kladieva@intel.com>
Co-authored-by: Michał Karzyński <4430709+postrational@users.noreply.github.com>
Co-authored-by: Anton Romanov <anton.romanov@intel.com>
4 years agoMake MVN behaviour deterministic (#2458)
Alexander Peskov [Mon, 26 Oct 2020 18:01:38 +0000 (21:01 +0300)]
Make MVN behaviour deterministic (#2458)

* Change default parallel reduce alg into deternimistic way

Signed-off-by: Alexander Peskov <alexander.peskov@intel.com>
* Introduce ie::parallel_for semantic with group_id parameter

Signed-off-by: Alexander Peskov <alexander.peskov@intel.com>
* [CPU] Make MVN behaviour deterministic

Signed-off-by: Alexander Peskov <alexander.peskov@intel.com>
4 years ago[SSR] Transformation mimicking oldSetBatchSize logic (#2597)
Evgenya Stepyreva [Mon, 26 Oct 2020 17:51:59 +0000 (20:51 +0300)]
[SSR] Transformation mimicking oldSetBatchSize logic (#2597)

* [SSR] Transformation mimicking oldSetBatchSize logic

* Self-review

* gkazanta comments adressed

* support for opset1::Proposal and  opset4::Proposal. Use of pattern predicates

* Constant Folding during setBatchSize

* StridedSlice->Squeeze resolver

* SR tests added

* Squeeze->StridedSlice

* Comments

* getting rid of folding

* comment

* sq->ss transformation

* Revert "sq->ss transformation"

This reverts commit 9731b1cf524c2910bee8d3e97fe3fa46a61dbf1a.

* Revert "comment"

This reverts commit a57b4f863eb1d0e99545184a9c86c93bcee983a5.

* Revert "getting rid of folding"

This reverts commit 85405dab0aa461247f5dd06b05d059ee211cda64.

4 years ago[IE CLDNN] Improve LO rules for expected FQ format (#2790)
Jedrzej Hajduczenia [Mon, 26 Oct 2020 17:36:00 +0000 (18:36 +0100)]
[IE CLDNN] Improve LO rules for expected FQ format (#2790)

4 years agoLoop operation: IE IR Reader update (#2766)
Ivan Tikhonov [Mon, 26 Oct 2020 16:30:14 +0000 (19:30 +0300)]
Loop operation: IE IR Reader update (#2766)

* ie_ir_reader update, Loop implementation update

* fix ie ir reader

4 years ago[CPU] Added operation HSigmoid-5 (#2005)
Alexandra Sidorova [Mon, 26 Oct 2020 15:42:30 +0000 (18:42 +0300)]
[CPU] Added operation HSigmoid-5 (#2005)

4 years ago[LPT] bfloat enabling fix (#2819)
Edward Shogulin [Mon, 26 Oct 2020 13:02:11 +0000 (16:02 +0300)]
[LPT] bfloat enabling fix (#2819)

4 years agoFixed ngraph sample logical errors (#2600)
Mikhail Ryzhov [Mon, 26 Oct 2020 12:36:49 +0000 (15:36 +0300)]
Fixed ngraph sample logical errors (#2600)

* Fixed ngrapth sample logical errors

- added batch size, because sample accepts several images
- set label file as optional

4 years agoReorganize LPT: (#2803)
Ilya Lavrenov [Mon, 26 Oct 2020 11:10:17 +0000 (14:10 +0300)]
Reorganize LPT: (#2803)

- inference_engine_lp_transformations keep ngraph LPT
- inference_engine_lp_transformations_legacy keep old CNNLayer based LPT

4 years agoenable reference implementation in CTCGreedyDecoder single layer test (#2680)
Patryk Elszkowski [Mon, 26 Oct 2020 10:34:50 +0000 (11:34 +0100)]
enable reference implementation in CTCGreedyDecoder single layer test (#2680)

* enable reference implementation for CTCGreedyDecoder single layer tests

* update unit test to have blnak_index

* remove merge_repeated disable flag for CPU test because CPU impl always
merge

* add CTCGreedyDecoder single layer tests for CPU

* changes to match xPU implementations

* apply reviewers suggestions

Co-authored-by: Patryk Elszkowski <patryk.elszkowki@intel.com>
4 years ago[IE][VPU]: Add runtime precision info in MYRIAD plugin (#2535)
Aleksandr Korolev [Mon, 26 Oct 2020 08:32:43 +0000 (11:32 +0300)]
[IE][VPU]: Add runtime precision info in MYRIAD plugin (#2535)

* Add runtime precision info in MYRIAD plugin

4 years ago[IE][VPU][Myriad]: Mish layer optimization (#2648)
Evgeny Latkin [Mon, 26 Oct 2020 07:50:37 +0000 (10:50 +0300)]
[IE][VPU][Myriad]: Mish layer optimization (#2648)

* Myriad: new firmware version 1426

4 years ago[IE CLDNN] Fixed fusing config for fsv16 eltw kernel (#2807)
Vladimir Paramuzov [Mon, 26 Oct 2020 06:03:00 +0000 (09:03 +0300)]
[IE CLDNN] Fixed fusing config for fsv16 eltw kernel (#2807)

4 years agoONNX models validation tweak and test (#2798)
Tomasz Dołbniak [Mon, 26 Oct 2020 03:35:20 +0000 (04:35 +0100)]
ONNX models validation tweak and test (#2798)

* Test checking the current ONNX ir_version support

* Model stream rewinding in ONNX reader only

* Fix for CentOS

4 years agoRemove obsoleted v0::Broadcast and BroadcastLike operators (#2779)
Mateusz Tabaka [Mon, 26 Oct 2020 03:32:49 +0000 (04:32 +0100)]
Remove obsoleted v0::Broadcast and BroadcastLike operators (#2779)

* Remove obsoleted v0::Broadcast and BroadcastLike operators

* remove NGRAPH_DEPRECATED marks from autobroadcast functions

* restore NGRAPH_SUPPRESS_DEPRECATED_START in autobroadcast.cpp

4 years ago[IE CLDNN] Enabled more functional tests and added several fixes into ops implementat...
Vladimir Paramuzov [Sat, 24 Oct 2020 20:38:13 +0000 (23:38 +0300)]
[IE CLDNN] Enabled more functional tests and added several fixes into ops implementations (#2763)

4 years agoAdd hsigmoid fusing for MO (#2750)
iliya mironov [Sat, 24 Oct 2020 09:51:15 +0000 (12:51 +0300)]
Add hsigmoid fusing for MO (#2750)

* Add hsigmoid fusing for MO

* Update Bom file

* Remove comments

* Refactoring hsigmoid fusion according to review

* Add div and mul patterns for hsigmoid fusion

* Refactoring code according to review

* Fix HSigmoid fusion transformation

4 years ago[IE CLDNN] Fix narrowing conversion error on VS2017 (#2804)
Jedrzej Hajduczenia [Fri, 23 Oct 2020 21:57:30 +0000 (23:57 +0200)]
[IE CLDNN] Fix narrowing conversion error on VS2017 (#2804)

4 years agoAdd OpenCV for CentOS 8 and RHEL 8 to dependencies.cmake (#2806)
Alexey Suhov [Fri, 23 Oct 2020 20:58:33 +0000 (23:58 +0300)]
Add OpenCV for CentOS 8 and RHEL 8 to dependencies.cmake (#2806)

4 years agoAdded onnx support for C samples (#2747)
Mikhail Ryzhov [Fri, 23 Oct 2020 18:47:01 +0000 (21:47 +0300)]
Added onnx support for C samples (#2747)

* ngraph python sample

This sample demonstrates how to execute an inference using ngraph::Function to create a network
- added sample
- added readme
- added lenet weights

* Added onnx support for C samples

* Revert "ngraph python sample"

This reverts commit 8033292dc367017f6325ea4f96614fdcb797e9dd.

* Added onnx support for C samples

Fixed codestyle mistake

* Removed optional code

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
4 years ago[IE] Fix UNITY build (#2799)
Vladislav Vinogradov [Fri, 23 Oct 2020 16:21:02 +0000 (19:21 +0300)]
[IE] Fix UNITY build (#2799)

4 years agoAdded dynamic check for convertFunctionToCNNNetwork functoin (#2797)
Gleb Kazantaev [Fri, 23 Oct 2020 15:17:26 +0000 (18:17 +0300)]
Added dynamic check for convertFunctionToCNNNetwork functoin (#2797)

* Keep changes

* Added dynamic check for convertFunctionToCNNNetwork

* Fixed test

4 years agoadded third party programs files (#2751)
Tatiana Troilova [Fri, 23 Oct 2020 15:03:01 +0000 (18:03 +0300)]
added third party programs files (#2751)

* added third party programs files

* changed third party programs files location

4 years agoRemove ExtractImagePatchesToReorgYolo transformation (#2687)
Anton Chetverikov [Fri, 23 Oct 2020 14:32:54 +0000 (17:32 +0300)]
Remove ExtractImagePatchesToReorgYolo transformation (#2687)

Co-authored-by: Anton Chetverikov <anton.chetverikov@.intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
4 years ago[IE][VPU][GT][DTS]: Update MyriadPlugin to work with dynamic NMS-5 (#2698)
Andrew Bakalin [Fri, 23 Oct 2020 14:04:36 +0000 (17:04 +0300)]
[IE][VPU][GT][DTS]: Update MyriadPlugin to work with dynamic NMS-5 (#2698)

* [VPU][GT][NGraph] Get rid of DynamicNMS and transformation
* [VPU][NGraph] Update DTS for NMS
* [VPU][NGraph] Update StaticShapeNMS to be inherrited from NMS-5
* [VPU][GT] Update StaticShapeNMS stage to work with updated NGraph op
* [VPU][Tests] Update tests
* [VPU][GT] Fix StaticShapeNMS to be inherited from NonMaxSuppressionIE3
* [VPU][GT] Remove unused NonMaxSuppression

4 years agoAdd dynamic shape checks to nGraph transformations (#2735)
Gleb Kazantaev [Fri, 23 Oct 2020 12:39:47 +0000 (15:39 +0300)]
Add dynamic shape checks to nGraph transformations (#2735)

* Added dynamic shape checks for BatchNormDecompositoin pass

* Added dynamic shapes checks for FQTranspose fusion pass

* Added patter::has_static_rank predicate

* Added dynamic shapes checks for BroadcastToTiles pass

* Fixed BN inputs order

* Add dynamic shape checks for DepthToSpace/SpaceToDepth passes

* Added dynamic check for ReduceToPooling pass

* Updated BN transformation

* Fix PR comments

* size_t to int64_t

* Updated reduce to pooling pattern

4 years ago[IE][VPU]: Proposal: Implemented support for optional 2nd output (scores) (#2762)
Alexey Ershov [Fri, 23 Oct 2020 12:19:20 +0000 (15:19 +0300)]
[IE][VPU]: Proposal: Implemented support for optional 2nd output (scores) (#2762)

* Proposal stage: added support for optional 2nd output
* firmware updated

4 years agoAdd watchdog of OpenVino ONNX CI (#2550)
Rafal Blaczkowski [Fri, 23 Oct 2020 12:16:43 +0000 (14:16 +0200)]
Add watchdog of OpenVino ONNX CI (#2550)

4 years agoRemove CNN GNA1/2 compatibility enforcement when other GNA device detected (#2745)
Krzysztof Bruniecki [Fri, 23 Oct 2020 10:30:16 +0000 (12:30 +0200)]
Remove CNN GNA1/2 compatibility enforcement when other GNA device detected (#2745)

4 years agoEs/lpt/lpt to ngraph fixes2 with master (#2671)
Edward Shogulin [Fri, 23 Oct 2020 10:22:55 +0000 (13:22 +0300)]
Es/lpt/lpt to ngraph fixes2 with master (#2671)

* [LPT] Replace creation of dequantization with factory

* [ngraph][LPT] Add ScaleShift replace for dequantization operations

* [LPT] SubtractMultiplyToMultiplyAdd refactoring

* [LPT] Code style fix

* [LPT] Edit SubtractMultiplyToMultiplyAdd transformation for dequantization

* [LPT] Linux compilation quick fix

* [LPT] [WIP] runtime info applying

* [LPT] Concat transformation functional tests extending

* [LPT] MultiplyToConvolution + Subtract to add fusing + improvements in LowPrecisionTransformer

* [LPT] linux compilation error fix

* [LPT] compilation error

* [LPT] MultiplyToGroupConvolution fix: 5D support

* [LPT] Multiply transformation extending: FQ weights support - wip

* [LPT] FQ folding & precision selection

* [LPT] code style fixes

* [LPT] code style fixes

* [LPT] Linux compilation error fix

* [LPT] SubtractMultiplyToMultiplyAdd: refactoring

* [LPT] Tests fixes

* [LPT] MultiplyToGroupConvolution tests

* [LPT] Convert subtract with int inputs to Eltwise sub

* [LPT] Constant folding fix for quant models

* [LPT] 1) Asymmetric quantization improvement 2) tests extending

* [LPT] 2 fixes for se_resnext_50

* [LPT] Add transformation priority branch selection test

* [LPT] AddMultiplyFusion: legacy transformation quick fix

* [LPT] nGraph tests temporary disabling

* [LPT] Fix for eltwise inputs with multiple outputs

* [LPT] Fix for FQ fuse

* [LPT] Reshape by channel, batch temporary disabled

* [nGraph][LPT] MatMul fix for reading FP16 models

* [LPT] 1) Add (not after Convolution/GroupConvolution/MatMul with Constant) to Subtract 2) precision selection fix: MultiplyToGroupConvolution quick fix

* [LPT] DenseNet improvments: AddTransformation: Add to Subtract + tests

* [LPT] AddTransformarion refactoring

* [LPT] AddTransformation tests temporay disabled

* [LPT] ReshapeTransformation improvements: degradation fix

* [LPT] code style fix

* [LPT] Concat tests temporary disabling

* [LPT] tests unification
1) plugin tests: added test-cases and nGraph-validation for clamp, split and variadic split
2) func tests: added test-cases
3) transformNGraph: added the ability to run additional transformations

* [LPT] split & variadic split merge fix

* [LPT] Clamp: added support for asymmetric quantization

* [LPT] added DequantizationAttr run-time attribute

* [LPT] debug info removal

* [LPT] ConcatTransformation: zero point fix

* [LPT] CNNNetwork ReLU transformation quick fix

* [LPT]
1) Concat fix
2) ConcatMultiChannels fix
3) Added "Concat with Split" test-cases
4) Subgraph fix

* [LPT]
1) Concat fix
2) Added "Concat with different precision on childs" test-case

* [LPT] concat fix Ubuntu18

* [LPT] Concat test fixes

* [LPT] Not fp32 FQ input support

* [LPT] MatMul Fix + separateInStandaloneBranch Fix

* [LPT] Fix reference input types in mish fusion tests

* [LPT] Fix cpuFuncTests on CentOS building

* [nGraph][LPT] ScaleShift 2d, 3d nGraph conversion enabling

* [LPT] 1) FullyConnected workaround removing 2) validate_nodes_and_infer_types for LPT

* [ngraph] Add check for childs for ConvertSubtract

* [LPT] Squeeze/Unsqueeze tests unification

* [LPT] Squeeze/Unsqueeze change signature for getReference/getOriginal

* [LPT] Mul & Add -> ScaleShift quick fix

* [LPT] nGraph tests emporary disabling

* [LPT] code style fix

* [LPT] code style fix #2

* [LPT] nGraph tests temporary disabling

* [LPT] code styl fix #3

* [LPT] shared plugin tests temporary disabling

* [LPT] cleanup

* [LPT] nGraph unit_tests tests temproary disabling

* [LPT] nGraph unit tests disabling #2

* [LPT] nGraph tests disabling

* [LPT] nGraph tests temporary disabling

* [LPT] WA removing

* [LPT] CentOS compilation fix

* [LPT] KMB wa to avoid compilation error

* [LPT] functional test temporary disabling

* [nGraph] code style fixes

* [LPT] ConcatTransformation: data movement operation as intermediate handling

* [LPT] FuseSubtractToFakeQuantize after VariadicSplit

* [LPT] ConcatWithSplitTransformation functional test temporary disabling

* [LPT] Clamp and ConcatWithDifferentPrecisionsOnChilds: tests fix

* [LPT] MatMul: bert-nv-mlperf-quantized fix

* [LPT] Add to convolution biases fuse fix

* [LPT] GPU plugin tests fixes

* [LPT] Normalize GPU plugin tests fix

* [LPT] test-commit

* [LPT] CLDNN Plugin FP16 conversion

* [LPT] AvgPool update precision if there is not FQ after + convolution
precision limitation on activation

* [LPT] Convolution fixes

* [LPT] FuseSubtractToFakequantize & FuseMultiplyToFakeQuantize improvement

* [LPT] FuseSubtractToFakeQuantize test fix

* [LPT] FuseSubtractToFakeQuantizeTransformation tests

* [LPT] code style fix

* [LPT] AvgPool child recursive extend

* [LPT] AvgPool tests + fix

* [LPT] compilation quick fix

* [LPT] Add to convolution biases fuse fix

* [LPT] Linux issues: MatMulWithOptimizedConstantFakeQuantizeTransformation temporary disabled

* [LPT] Normalize GPU plugin tests fix

* [LPT] test-commit

* [LPT]
1) added the ability to create sub without dequantizationAttribute
2) fixed optimizeMulAfter: added copying rt_info
3) Tests Unification: Convolution transformation
4) added cleanRunTimeInfo into Network Helper

* [LPT] Tests Unification: GroupConvolution

* [LPT] removed debug info

* [LPT] functional tests for Convolution & GroupConvolution extending

* [LPT] [MatMul] Quick fix ubuntu error

* [LPT] MatMulTransformation quick test fix: one constant for both intervals

* [nGraph] code style fix

* [LPT] added output_precision to NormalizeIE

* [nGraph] NormalizeIE fix for LPT support

* [LPT] nGraph WA removal

* [LPT] fixed fillSubgraph for concat multi channels

* [LPT] MatMul fix

* [nGraph] WA removal: 1) nGraph tests enabling 2) LPT extanding: not handle in FP32

* [LPT] nGraph WA removal: function tests skip config rollback

* [LPT] WA removal: precision propagation fix

* [LPT] ConvertMulOrAddFinally transformation extending

* [nGraph] ConvolutionMultiplyFusion rollback (move from legacy to common)

* [nGraph] ConvertMulAddToScaleShiftOrPower: WA removal

* [nGraph] TypeRelaxed: WA removal

* [nGraph] WA removal: TypeRelaxed

* [LPT] WA removal: ConcatTransformation

* [nGraph] WA removal: Eltwise & ConvertMulOrAddFinally fixes to support LPT

* [nGraph] MulAddConversion fix: 2D & 3D ScaleShift are supproted

* [nGraph] VisualizeTree extending

* [LPT] FakeQuantizeDequantization extending: check element wise dequantization operation

* [LPT] FakeQuantizeDequantization extending: SubtractMultiplyToMultiplyAddTransformation & WeightableLayerTransformation

* [LPT] Convolution + test infrastructure update

* [LPT] GPU compilation error

* [nGraph] BatchNorm plugin tests: input tensor definition

* [LPT] LowPrecisionTransformer::isFunctionQuantized was added

* [nGraph] WA final cleanup

* [nGraph] ScaleShiftIE quick fix

* [LPT] Functional tests: added test-cases "Concat with intermediate with constant"

* [LPT] Transformer::isNetworkquantized fix

* [LPT] SubtractMultiplyToMultiplyAdd zero Add remove: fix for ssd300 on gpu

* [LPT] MultiplyToGroupConvolution not transform on Const

* [LPT] workaround for negative scales

* [LPT] Convert standalone dequantization Mul,Sub,Add to ScaleShift

* [LPT] SubtractMultiplyToMultiplyAdd test fix

* [LPT] Clamp transformation: GPU tests fix

* [LPT] Transformer tests

* [LPT] FakeQuantizePrecisionSelectionTransformation was disabled for GPU

* [LPT] TransformerIsFunctionQuantized refactoring

* [nGraph] code style fix

* [LPT] mobilenet_v2_tf_depthwise test update

* [LPT] TMP: dequantization folding

* [LPT] Elementwise transformation fix: dequantization operations constant folding

* [LPT] cleanup

* [LPT] denormal values fix

* [LPT] FuseFakeQuantize test fixed + negative multiply case

* [LPT] FP32 -> FP16 conversion info

* [LPT] FQ dot interval support + swapMultiplyAdd safely division

* [LPT] test fix

* [LPT] Tests for dot interval on FQ + tests for addTransformation enabling

* [LPT] Clamp transformation fix

* [LPT] FQ prec selection test fix

* [LPT] Clamp test case

* [LPT] Concat division precision fix

* [LPT] cleanup

* [LPT] merge fix

* [LPT] WIP: MatMul asymmetric quantization fix (BERT)

* [LPT] MatMulWithOptimizedConstantFakeQuantizeTransformation disabled

* [LPT] GPU Plugin set config fix

* [LPT] Fix merge mistakes

* [LPT] Rollback device specific INT8

* [LPT] ReshapeFullyConnected fix: FullyConnected output fix

* [LPT] bert-base-chinese GPU fix

* [ngraph/LPT] Tests for fix convert_mul_or_add_finally with dequantization

[ngraph/LPT] Fix convert mul_or_add_finally with dequantization

* [LPT] ScaleShift dim < 4 only dequantization conversion

* [LPT] MatMul transformation tests extensing

* [LPT] ReshapeFullyConnected legacy transformation: LPT test case addition

* [nGraph] VisualizeTree extending: property names displying to simplify search

* [LPT] getDequantization extending

* [LPT] MulAddToScaleshiftOrPower: out precision fix & tests

* [LPT] Multiply to ScaleShiftIE: Multiply transformation: remove DEQUANTIZATION if not valid

* [LPT] Concat test case

* [nGraph] try to fix opencv compatibility

* [nGraph] nGraph code style fix

* [LPT] InPlace dequantization folding

* [LPT] Multiply constant folding test

* [LPT] Fix plugin test case for MatMulWithOptimizedConstantFakeQuantize

[LPT] Enable MatMulWithOptimizedConstantFakeQuantize plugin test

* [LPT] Convolution transformation: mulConst shape fix

* [LPT] INT8 Constant folding branch for elementwise ops optimization removal

* [LPT] eltwise for const branch fix

* [LPT] linux fix

* [LPT] Multiply test refactoring

* [LPT] Convert Fuse in Constant + tests

* [LPT] function comparation: runtime info comparation rollback

* [LPT] linux build fix

* [LPT] linux build fix2

* [LPT] MatMul transformation limitation was added to be similar as CNNNetwork LPT

* [LPT] Reshape transformation update: don't broadcast by batch

* [LPT] MatMul transformation limitation was added to be similar as CNNNetwork LPT - refactoring

* [LPT] MatMul transformation: transpose input tensors fix

* [LPT] checkElementwise for AddTransformation WA: should be moved to getDequantization

* [LPT] merge fix

* [LPT] MatMul fix & tests

* [LPT] AddTransformation tests

* [LPT] Interpolate transformation enabled

* [LPT] constant folding before LPT

* [LPT] WIP: not completed tests

* [LPT] GPU degradation fix

* [LPT] FuseConvert workaround

* [LPT] code cleanup

* [LPT] Interpolate GPU test quick fix

* [LPT] GroupConvolution fix

* [LPT] Fix fusing multiply for non-dequantization layers

* [LPT] GPU pipeline update: enableInt8 initialization place update

* [LPT] tests compilation fix

* [LPT] merge fix

* [LPT] tests enabling

* [LPT] merge issue resolving

* [LPT] LPT CNNNetwork usage macros: part #1: source code

* [LPT] LPT CNNNetwork usage macros: part #2: cmake files update and tests addoption

* [LPT] LPT workaround from nGraph core removing

* [LPT] previous LPT version tests

* [LPT] inference_engine_lp_transformations was returned back

* [LPT] replace_node rollback

* [LPT] ConvertSubtract fix

* [LPT] GPU: baselineIsFP16 reuse fix

* [LPT] FakeQuantizeTransformation: GPU workaround: I32 -> FP32 Convert is not fused

* [LPT] AvgPool output precision workaround

* [LPT] Group convolution precision + Subtract to ScaleShift const fix

* [LPT] SubMulToMulAdd & Transpose: action-recognition-0001 fix

* [LPT] Transpose: added test with per-tensor quantization

Co-authored-by: Aleksandr Pertovsky <aleksandr.pertovsky@intel.com>
Co-authored-by: Zinoviev, Vladimir <vladimir.zinoviev@intel.com>
Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
Co-authored-by: Gorokhov Dmitriy <dmitry.gorokhov@intel.com>
4 years ago[IE CLDNN] Fix linear_onnx Interpolate selection (#2769)
Egor Churaev [Fri, 23 Oct 2020 10:16:47 +0000 (13:16 +0300)]
[IE CLDNN] Fix linear_onnx Interpolate selection (#2769)

4 years ago[ MO ] KSO=ON for Kaldi (#2028)
Evgenya Stepyreva [Fri, 23 Oct 2020 10:14:00 +0000 (13:14 +0300)]
[ MO ] KSO=ON for Kaldi (#2028)

* [ MO ] KSO=ON for Kaldi

* [ MO ] Kaldi KSO

* set static_shape for graph cycle making transformation

4 years agoONNX Reader supportModel() implementation (#2744)
Tomasz Dołbniak [Fri, 23 Oct 2020 10:13:04 +0000 (12:13 +0200)]
ONNX Reader supportModel() implementation (#2744)

4 years agoTransformations for hsigmoid op (#2531)
iliya mironov [Fri, 23 Oct 2020 09:35:56 +0000 (12:35 +0300)]
Transformations for hsigmoid op (#2531)

* Add hsigmoid op

* Add tests for hsigmoid

* Add fusion hsigmoid

* Add unit tests for fuse hsigmoid

* Add python api for hsigmoid. Update opset 5

* Update opset5 file

* Add hsigmoid decomposition transformation

* fix

* Move transformations for hsigmoid

* Hot fix

* Fix unit tests

* fix unit tests

* Fix unit test

* Fix code style

* Reverse changes

* Add includes for hsigmoid transformations

* Enable in cldnn

* Refactoring hsigmoid fusion

* Move hsigmoid transforms patterns to cpp file

* Reverse hsigmoid fusion refactoring

* Fix according to code review

* Refactoring transformation

* Hot fix

4 years agoReference implementation for Tile op (#2641)
Piotr Szmelczynski [Fri, 23 Oct 2020 08:39:00 +0000 (10:39 +0200)]
Reference implementation for Tile op (#2641)

4 years agoRemove obsoleted Dequantize op (#2780)
Mateusz Tabaka [Fri, 23 Oct 2020 08:25:08 +0000 (10:25 +0200)]
Remove obsoleted Dequantize op (#2780)

* Remove obsoleted Dequantize op

* apply code style

4 years agoFixed -Werror=catch-value= gcc-9 error (#2773)
Ilya Lavrenov [Fri, 23 Oct 2020 07:39:55 +0000 (10:39 +0300)]
Fixed -Werror=catch-value= gcc-9 error (#2773)

4 years ago[IE CLDNN] Fix padding in reduce fsv16 kernel (#2787)
Mikołaj Życzyński [Fri, 23 Oct 2020 07:16:21 +0000 (09:16 +0200)]
[IE CLDNN] Fix padding in reduce fsv16 kernel (#2787)

4 years agoFix the model downloader script (#2784)
Tomasz Dołbniak [Fri, 23 Oct 2020 06:58:12 +0000 (08:58 +0200)]
Fix the model downloader script (#2784)

4 years agoFix spelling errors in the API and bindings (#2781)
Roman Donchenko [Fri, 23 Oct 2020 06:17:03 +0000 (09:17 +0300)]
Fix spelling errors in the API and bindings (#2781)

4 years agoOpenvino extra module adding - refactored (#2754)
Ilya Lavrenov [Fri, 23 Oct 2020 05:54:48 +0000 (08:54 +0300)]
Openvino extra module adding - refactored (#2754)

* Rename plugin to module

* Added openvino_contrib handling

* Moved NEON flags to common place

* Fixed -Werror=catch-value= gcc-9 error

4 years agoRemoved obsolete comments from cmake (#2748)
Ilya Lavrenov [Thu, 22 Oct 2020 13:11:28 +0000 (16:11 +0300)]
Removed obsolete comments from cmake (#2748)

4 years ago[ONNX] WA for I64 images (#2411)
Jan Iwaszkiewicz [Thu, 22 Oct 2020 12:06:23 +0000 (14:06 +0200)]
[ONNX] WA for I64 images (#2411)

4 years ago[VPU][GT][Tests] Make gemmTranspose pass layout agnostic (#2666)
Andrew Bakalin [Thu, 22 Oct 2020 12:04:53 +0000 (15:04 +0300)]
[VPU][GT][Tests] Make gemmTranspose pass layout agnostic (#2666)

* [VPU][GT] Make permTranspose pass layout agnostic

* [IE][Tests] Improve MatMul common test class

* [VPU][Tests] Add tests for MatMul

* [VPU][Tests] Review fixes

* [Tests] Add combineShapes for MatMul

* [VPU][GT] Fix assertion condition

4 years ago[IE CLDNN] Base kernels refactoring (#2758)
Vladimir Paramuzov [Thu, 22 Oct 2020 11:42:42 +0000 (14:42 +0300)]
[IE CLDNN] Base kernels refactoring (#2758)

4 years agoConstant->Result networks (#2639)
Ilya Churaev [Thu, 22 Oct 2020 10:22:38 +0000 (13:22 +0300)]
Constant->Result networks (#2639)

* Added tests

* Changed iterator algorithm

* Fixed legacy tests

* Added plugin tests

* Disabled some tests

* Remover parameter tests

* Fixed conversion

* Use old approach for old tests

* Temp commit

* Fixed iterator

* Fixed some tests

* Change logic to compare iterators

* Disabled CPU functional test

* Temp commit

* Disabled test for GPU

* Fixed network copy

* Try to fix test for Windows

* Disabled test for GNA

* Disable plugin tests

* Disable legacy test

* Remove redundant code

4 years agoAdded new version of BatchNormInference (#2728)
Ilya Churaev [Thu, 22 Oct 2020 10:21:23 +0000 (13:21 +0300)]
Added new version of BatchNormInference (#2728)

* Added new version of BatchNormInference

* Fixed code style

* Fixed batch norm inference v5

* Added opset4 and opset5 to IE backend

* Fixed functional test

* Fixed cpuFunc tests

* Fixed transformation order

* Try to fix validation

* Revert some changes

* Updated python API and added tests

* Fixed code style

* Fixed python code style

* Disabled test

4 years ago[IE CLDNN] Extend supported fusing cases for scale and eltwise (#1960)
Vladimir Paramuzov [Thu, 22 Oct 2020 10:06:27 +0000 (13:06 +0300)]
[IE CLDNN] Extend supported fusing cases for scale and eltwise (#1960)

4 years agoUse MVN in GroupNorm/InstanceNorm in ONNX importer (#2711)
Mateusz Tabaka [Wed, 21 Oct 2020 10:48:53 +0000 (12:48 +0200)]
Use MVN in GroupNorm/InstanceNorm in ONNX importer (#2711)

* Use MVN in GroupNorm/InstanceNorm in ONNX importer

* Remove mosaic_8 model from xfail list

4 years ago[IE CLDNN] Another try to fix multiple-kernel implementations profiling (#2630)
Jedrzej Hajduczenia [Wed, 21 Oct 2020 10:36:32 +0000 (12:36 +0200)]
[IE CLDNN] Another try to fix multiple-kernel implementations profiling (#2630)

4 years agoUse LogSoftmax-5 in the onnx_importer (#2602)
Tomasz Dołbniak [Wed, 21 Oct 2020 08:50:16 +0000 (10:50 +0200)]
Use LogSoftmax-5 in the onnx_importer (#2602)

4 years agoSupported threading command line options for other devices (#2725)
Anton Pankratv [Wed, 21 Oct 2020 03:40:18 +0000 (06:40 +0300)]
Supported threading command line options for other devices (#2725)

* Supported thrieding command line options for ohter devices

* Fixed python benchmark

4 years ago[NGRAPH] Fix UNITY build (#2732)
Vladislav Vinogradov [Wed, 21 Oct 2020 03:34:35 +0000 (06:34 +0300)]
[NGRAPH] Fix UNITY build (#2732)

4 years agoAdd Round-5 operation (#2328)
Anton Chetverikov [Tue, 20 Oct 2020 15:36:19 +0000 (18:36 +0300)]
Add Round-5 operation (#2328)

* Add Round-5 operation

* Add ONNX Round to supported operation list

* Add ngraph implementation for Round operation

* Update MO part

* Create UnaryElementwise class, update Round Operation

* Fix mode attr in mxnet extractor

* Add tests for Round shape infer

* Update 'enable' attr

* Update MO IR Reader to support UnaryElementwise operations

* Minor test refactor

* Update ngraph Round operation

* Add reference implementation

* Add test for reference implementation

* Add test for shape infer

* Add test for IE IR Reader

* AddRound operation to python api

* Fix missed mode attr

* Update Round operation version

* Fix codestyle

* Add MxNet Round to supported layers list

* Fix error in reference

* Fix comments style

* Update CMake file

* Update Ngraph reference test

* Update IE IR Reader tests

* Return v0::Round operation

* Update shape infer tests

* Fix v0::Round reference

* Fix codestyle

* Enum instead of string

* Fix codestyle

* Add Mode attribute adapter

* Update Mode attr

* Fix reference for v0::Round

* Fix codestyle

* Fix mode attr

* Fix get() method

* Fix codestyle in python api

* Update test info

* Fix ngraph api part

* Ad round v5 to interpreter tests

* Fix codestyle is ie reader test

* Update ngraph python api __init__.py file

* Adde opser5 to dafault opsets in ie_ir reader

* Add parser for Round layer

* Remove redundant spaces

* Add round creator to appropriate list

* Remove redundant import

* Commit to bump infrastructure version

I'm sorry for this, but this commit will be squashed on merge to master anyway and it is needed for your PR to correctly pass the pipeline

* Fix import

* fix codestyle

* Fix ngraph api part

* Add shape infer tests in python api

* Add .upper() for mode attr

* Refactor MO shape infer test for Round op

* Update tests and add comments

* Revert "Commit to bump infrastructure version"

This reverts commit 56e6ae1e4c31439ba0d4636fa76782c03bf30aca.

* remove parser for Round layer

* Update Ronund-5 evaluate test

* Resolve review comments

Co-authored-by: User <user@nnlvdp-achetver.inn.intel.com>
Co-authored-by: Andrey Babushkin <andrey.babushkin@intel.com>
Co-authored-by: Anton Chetverikov <anton.chetverikov@.intel.com>
4 years agoCleanup single_layer_tests (#2716)
Irina Efode [Tue, 20 Oct 2020 11:31:59 +0000 (14:31 +0300)]
Cleanup single_layer_tests (#2716)

4 years agoAdd LogSoftmax-5 to MO and ngraph (#2409)
Maxim Vafin [Tue, 20 Oct 2020 10:40:06 +0000 (13:40 +0300)]
Add LogSoftmax-5 to MO and ngraph (#2409)

Co-authored-by: Evgeny Lazarev <evgeny.lazarev@intel.com>
4 years agoRemove deprecated Any op from nGraph (#2719)
Mateusz Tabaka [Tue, 20 Oct 2020 09:36:46 +0000 (11:36 +0200)]
Remove deprecated Any op from nGraph (#2719)

4 years ago[ONNX] Add type conversion for Pow op inputs (#2589)
Mateusz Tabaka [Tue, 20 Oct 2020 09:19:03 +0000 (11:19 +0200)]
[ONNX] Add type conversion for Pow op inputs (#2589)

Co-authored-by: mitruska <katarzyna.mitrus@intel.com>
4 years agoImplement LookupTableInsert shape inference (#2348)
Roman Kazantsev [Tue, 20 Oct 2020 06:57:55 +0000 (09:57 +0300)]
Implement LookupTableInsert shape inference (#2348)

* Implement LookupTableInsertV2 shape inference

It is needed if other nodes not beeing pruned in the graph
have a conditional dependence on LookupTableInsertV2 node.

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix after core-review #1

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix the code after review #2

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix after code review #3

4 years ago[JAVA] Fixed IECore constructor (#2685)
Anna Likholat [Mon, 19 Oct 2020 16:38:55 +0000 (19:38 +0300)]
[JAVA] Fixed IECore constructor (#2685)

4 years ago[IE CLDNN] DispatchData refactoring (#2508)
Vladimir Paramuzov [Mon, 19 Oct 2020 15:45:05 +0000 (18:45 +0300)]
[IE CLDNN] DispatchData refactoring (#2508)

4 years ago[CPU] CTCLoss performance improvement.
Nikolay Shchegolev [Mon, 5 Oct 2020 08:58:54 +0000 (11:58 +0300)]
[CPU] CTCLoss performance improvement.

4 years ago[PP GAPI] Extended plug-ins shared precision conversion tests to use (#2677)
Anton Potapov [Mon, 19 Oct 2020 09:35:59 +0000 (12:35 +0300)]
[PP GAPI] Extended plug-ins shared precision conversion tests to use (#2677)

`GetBlob()` as well

- test were extended to cover case when input tensors are copied into
Blob return by `InferRequest::GetBlob`
- channel number of input tensor is made a test parameter

4 years agoImprove GNA MT sychronization (#2553)
Krzysztof Bruniecki [Mon, 19 Oct 2020 09:21:01 +0000 (11:21 +0200)]
Improve GNA MT sychronization (#2553)

* Sync GNA lib calls to avoid multi threads and plugins crash

* Remove TODO

* Enable sync for GNA1

* Fix GNA1 sync

* Add core_threading_tests to GNA Plugin to address story 31709

* Disable and change test description

4 years agoRemove `memcheck_pregen_irs_tests` MemCheck configs due obsolescence (#2693)
Vitaliy Urusovskij [Mon, 19 Oct 2020 06:48:38 +0000 (09:48 +0300)]
Remove `memcheck_pregen_irs_tests` MemCheck configs due obsolescence (#2693)

4 years agoRevise LRN reference implementation (#2672)
Mateusz Tabaka [Mon, 19 Oct 2020 05:40:04 +0000 (07:40 +0200)]
Revise LRN reference implementation (#2672)

* fix typo in LRN docs

* fix link to reference in LRN doc

* LRN, LRN_IE types alignment with spec

* align LRN ref implementation to plugins behavior

* update LRN docs

* Improve LRN reference implementation performance

* restore LRN constructor with no axes in the input

* apply code format

* revert double->float size_t->int change

* small fix to example in doc

* revert double->float size_t->int in onnx_importer and backend tests

* Changes to docs after review

4 years ago[opset5] ngraph implementation of Loop op (#2583)
Ivan Tikhonov [Mon, 19 Oct 2020 03:53:46 +0000 (06:53 +0300)]
[opset5] ngraph implementation of Loop op (#2583)

* Loop op ngraph implementation, update IE IR Reader and ngraph to cnn converter

* refactoring SubGraphOp class

* type prop unit tests

* ngraph code style

* update comment

* single layer tests for Loop operation

* fix file name

* Add SpecialBodyPorts attribute in Loop op, update single layer tests

* add several new tests cases, strict checks in Loop impl, temporary disable single layer tests

* ngraph codestyle, refactoring, clone_new_args test

* resolve review remarks

* fix build

* fix tests

* add a new constructor of Loop op, resolve review remarks

4 years ago[IE CLDNN] Added HSigmoid operation (#2700)
Roman Lyamin [Sun, 18 Oct 2020 17:47:22 +0000 (20:47 +0300)]
[IE CLDNN] Added HSigmoid operation (#2700)

4 years agoImprove python_wheel CMake target (#2688)
Michał Karzyński [Sun, 18 Oct 2020 15:12:25 +0000 (17:12 +0200)]
Improve python_wheel CMake target (#2688)

4 years agoTweaks for ONNX scoreboard (#2697)
Michał Karzyński [Sun, 18 Oct 2020 15:08:06 +0000 (17:08 +0200)]
Tweaks for ONNX scoreboard (#2697)

4 years ago[install_dependencies.sh] install latest cmake if current version is lower 3.13 ...
Alexey Suhov [Fri, 16 Oct 2020 18:03:46 +0000 (21:03 +0300)]
[install_dependencies.sh] install latest cmake if current version is lower 3.13 (#2695)

* [install_dependencies.sh] install latest cmake if current version is lower 3.13

* add shellcheck for Ubuntu

* install python 2.7 for Ubuntu

4 years agoUpdating broken link on getting started linux doc (#2507)
Jesus Espinoza [Fri, 16 Oct 2020 16:02:41 +0000 (09:02 -0700)]
Updating broken link on getting started linux doc (#2507)

Link to build instructions was broken, updated link to the correct location.

4 years agoSmall fix for python doc (#2696)
Ilya Churaev [Fri, 16 Oct 2020 15:12:20 +0000 (18:12 +0300)]
Small fix for python doc (#2696)

4 years ago[GNA][Speech sample] Add option to specify blob names (#1529)
Andrey Dmitriev [Fri, 16 Oct 2020 12:34:22 +0000 (15:34 +0300)]
[GNA][Speech sample] Add option to specify blob names  (#1529)

* Added output names

* Add input, output, ref names

* Added zero scale factor

* Adding support for multiple reference files

4 years ago[GNA] Fix remove layer + identity layer insertion (#2626)
Kamil Magierski [Fri, 16 Oct 2020 10:23:32 +0000 (12:23 +0200)]
[GNA] Fix remove layer + identity layer insertion (#2626)

* [GNA] Fix remove layer + identity layer insertion

test stub

Test impl

style

hpp style

* disable FP16 for GPU

4 years agoRemove segfault marks form test_unary_op_scalar and test_range tests (#2692)
Michał Karzyński [Fri, 16 Oct 2020 09:34:26 +0000 (11:34 +0200)]
Remove segfault marks form test_unary_op_scalar and test_range tests (#2692)

Co-authored-by: Ewa21 <ewa.tusien@intel.com>
4 years agoAvoid unnecessary Reshape in ONNX Softmax impl (#2686)
Tomasz Dołbniak [Fri, 16 Oct 2020 09:30:20 +0000 (11:30 +0200)]
Avoid unnecessary Reshape in ONNX Softmax impl (#2686)

4 years agoUse GatherND-5 in the onnx_importer (#2634)
Tomasz Dołbniak [Fri, 16 Oct 2020 09:30:00 +0000 (11:30 +0200)]
Use GatherND-5 in the onnx_importer (#2634)

4 years agoAdded apiValidator post-build checks for WCOS compliance (#2657)
Ilya Lavrenov [Fri, 16 Oct 2020 07:58:38 +0000 (10:58 +0300)]
Added apiValidator post-build checks for WCOS compliance (#2657)

* Added apiValidator post-build checks for WCOS compiance

* WA for cmake

* Additional checks for old WDK version

4 years ago[IE CLDNN] Add FP16 axes precision to Interpolate-4 (#2681)
Egor Churaev [Fri, 16 Oct 2020 07:14:22 +0000 (10:14 +0300)]
[IE CLDNN] Add FP16 axes precision to Interpolate-4 (#2681)

JIRA: 40805

4 years agoWorkaround for Cython issue on Python 3.8 (#2684)
Michał Karzyński [Fri, 16 Oct 2020 06:44:03 +0000 (08:44 +0200)]
Workaround for Cython issue on Python 3.8 (#2684)

4 years agoSet chmod +x for model_zoo_preprocess.sh
azhogov [Fri, 16 Oct 2020 05:19:46 +0000 (08:19 +0300)]
Set chmod +x for model_zoo_preprocess.sh

4 years ago[NGRAPH] Fix UNITY build under Windows (#2678)
Vladislav Vinogradov [Fri, 16 Oct 2020 03:57:30 +0000 (06:57 +0300)]
[NGRAPH] Fix UNITY build under Windows (#2678)

4 years agoReference Implementation for RegionYolo operator (#2474)
Gabriele Galiero Casay [Thu, 15 Oct 2020 20:30:12 +0000 (22:30 +0200)]
Reference Implementation for RegionYolo operator (#2474)

4 years agoUpdate nGraph Python API build instructions (#2610)
Michał Karzyński [Thu, 15 Oct 2020 20:15:33 +0000 (22:15 +0200)]
Update nGraph Python API build instructions (#2610)

4 years agoBroadcast visit_attributes fix (#2649)
Evgenya Stepyreva [Thu, 15 Oct 2020 18:39:42 +0000 (21:39 +0300)]
Broadcast visit_attributes fix (#2649)

* Broadcast visit_attributes fix

* Broadcast: Python API adjustment

* Revert back deserialization change