Summary report generator for layer and subgraph tests (#2707)
authorMikhail Treskin <mikhail.treskin@intel.com>
Thu, 12 Nov 2020 09:33:23 +0000 (12:33 +0300)
committerGitHub <noreply@github.com>
Thu, 12 Nov 2020 09:33:23 +0000 (12:33 +0300)
commit809c504d0a314aaac04b261b252c0418ae3a196c
treea35c23177b6b680d1fbf94f6a1080cfca5904734
parentf4d399f471d93366cf023bde939be73b4c293a93
Summary report generator for layer and subgraph tests (#2707)

* Initial summary dumper implementation

* Handle Tensoriterator body + add parser script

* Add support of XML reports merging + report OP names with versions

* Remove debug device name change

* Fix windows building issue

* Add --disable_test_skips command line option

* Gtest failure with logging

* Change skipping logic and resolve linkage errors caused by extern

* Get graph body from Loop

* Fix disable_tests_skipping symbol redefinition

* Fix inline for currentTestIsDisabled

* Rollback get_body for Loop

* Handle cases with skip in test SetUp

* Report Loop and TI ops along with ops in subgraph body

* Resolve some PR comments

* Dummy commit to kick pre-commit validation

Co-authored-by: Efode, Irina <irina.efode@intel.com>
inference-engine/tests/functional/plugin/cpu/main.cpp [new file with mode: 0644]
inference-engine/tests/functional/plugin/gna/main.cpp [new file with mode: 0644]
inference-engine/tests/functional/plugin/gpu/main.cpp [new file with mode: 0644]
inference-engine/tests/functional/plugin/myriad/main.cpp [new file with mode: 0644]
inference-engine/tests/ie_test_utils/functional_test_utils/layer_test_utils.cpp
inference-engine/tests/ie_test_utils/functional_test_utils/layer_test_utils.hpp
inference-engine/tests/ie_test_utils/functional_test_utils/layer_tests_summary/summarize.py [new file with mode: 0644]
inference-engine/tests/ie_test_utils/functional_test_utils/layer_tests_summary/template/report_template.html [new file with mode: 0644]
inference-engine/tests/ie_test_utils/functional_test_utils/skip_tests_config.cpp [new file with mode: 0644]
inference-engine/tests/ie_test_utils/functional_test_utils/skip_tests_config.hpp