update Unit Test Report for completion DR (#2596)

* add test round 3 including results of unit tests for ACL C++ code generator

Signed-off-by: Roman Rusyaev <r.rusyaev@samsung.com>

diff --git a/contrib/nnc/doc/project/18_NN_Compiler_and_Optimizer_UTR.rst b/contrib/nnc/doc/project/18_NN_Compiler_and_Optimizer_UTR.rst
index e8006c4..9f06ca3 100644 (file)
--- a/contrib/nnc/doc/project/18_NN_Compiler_and_Optimizer_UTR.rst
+++ b/contrib/nnc/doc/project/18_NN_Compiler_and_Optimizer_UTR.rst
@@ -20,6 +20,8 @@ SW Unit Test Report
 +--------+---------------+----------------------------+---------------------------------------+---------------------+
 | 1.1    | 2018.10.23    | Test Round 2               | Roman Rusyaev                         | Sung-Jae Lee        |
 +--------+---------------+----------------------------+---------------------------------------+---------------------+
+| 2.0    | 2018.12.10    | Test Round 3               | Roman Rusyaev                         | Sung-Jae Lee        |
++--------+---------------+----------------------------+---------------------------------------+---------------------+
 
 
 Test Status
@@ -31,7 +33,6 @@ Summary
 .. list-table::
    :class: longtable
    :widths: 4 10 10 10 5 5 5 5 10 12 12
-   :align: center
    :header-rows: 1
 
    * - N
@@ -61,7 +62,7 @@ Summary
    * - 2
      - 0.7
      - 10/23/2018
-     - 09/23/2018
+     - 10/23/2018
      - 43
      - 43
      - 0
@@ -70,6 +71,18 @@ Summary
      - tests for CLI, frontend, soft backend, compiler driver and IR
      - commit: 84e16c9d06903ab9fb2094ea40914942e430d20a
 
+   * - 3
+     - 1.0
+     - 12/10/2018
+     - 12/10/2018
+     - 74
+     - 74
+     - 0
+     - 0
+     - 100%
+     - tests for CLI, frontend, soft backend for CPU and GPU, compiler driver and IR
+     - commit: 7974192249ce1dd46c785ba8d25506eddb5b24ad
+
 
 Details
 -------
@@ -89,7 +102,6 @@ Tests description
 .. list-table::
    :class: longtable
    :widths: 20 10 30
-   :align: center
    :header-rows: 1
 
    * - Test Name
@@ -257,7 +269,6 @@ Tests description
 .. list-table::
    :class: longtable
    :widths: 20 10 30
-   :align: center
    :header-rows: 1
 
    * - Test Name
@@ -451,6 +462,301 @@ Tests output
 NNCC Version 1.0 (12.2018)
 ~~~~~~~~~~~~~~~~~~~~~~~~~~
 
+These unit tests are from commit **7974192249ce1dd46c785ba8d25506eddb5b24ad**.
+
+Tests description
+#################
+
+``NNC`` unit tests coverage is 63.3%. For more information about what functions are covered see ``nncc/contrib/nnc/unittests``.
+
+|
+
+.. list-table::
+   :class: longtable
+   :widths: 20 10 30
+   :header-rows: 1
+
+   * - Test Name
+     - Number of Tests
+     - Tests Scope
+
+   * - nnc_cpu_cpp_backend_ops_test
+     - 20
+     - C++ CPU soft backend functionality
+
+   * - nnc_cpu_cpp_backend_general_test
+     - 4
+     - C++ CPU soft backend functionality
+
+   * - nnc_acl_cpp_backend_test
+     - 11
+     - C++ GPU soft backend functionality
+
+   * - nnc_caffe_frontend_test
+     - 1
+     - Importer of Caffe NN models
+
+   * - nnc_support_commandline_test
+     - 1
+     - CLI: parser and configuration system
+
+   * - nnc_core_test
+     - 35
+     - model IR: serializer, shape inference etc
+
+   * - nnc_pass_test
+     - 2
+     - pass manager, pass_data class
+
+Tests output
+############
+
+::
+
+[==========] Running 2 tests from 1 test case.
+[----------] Global test environment set-up.
+[----------] 2 tests from CONTRIB_PASS
+[ RUN      ] CONTRIB_PASS.PassException
+[       OK ] CONTRIB_PASS.PassException (0 ms)
+[ RUN      ] CONTRIB_PASS.PassManager
+[       OK ] CONTRIB_PASS.PassManager (0 ms)
+[----------] 2 tests from CONTRIB_PASS (0 ms total)
+[----------] Global test environment tear-down
+[==========] 2 tests from 1 test case ran. (0 ms total)
+[  PASSED  ] 2 tests.
+
+::
+
+[==========] Running 35 tests from 11 test cases.
+[----------] Global test environment set-up.
+[----------] 4 tests from Operation
+[ RUN      ] Operation.ConnectionTest
+[       OK ] Operation.ConnectionTest (0 ms)
+[ RUN      ] Operation.InputOutputShapeTest
+[       OK ] Operation.InputOutputShapeTest (0 ms)
+[ RUN      ] Operation.SoftmaxAxisTest
+[       OK ] Operation.SoftmaxAxisTest (0 ms)
+[ RUN      ] Operation.ConcatAxisTest
+[       OK ] Operation.ConcatAxisTest (0 ms)
+[----------] 4 tests from Operation (0 ms total)
+[----------] 1 test from Shape
+[ RUN      ] Shape.Base
+[       OK ] Shape.Base (0 ms)
+[----------] 1 test from Shape (0 ms total)
+[----------] 1 test from Index
+[ RUN      ] Index.Base
+[       OK ] Index.Base (0 ms)
+[----------] 1 test from Index (0 ms total)
+[----------] 9 tests from ShapeInferenceTest
+[ RUN      ] ShapeInferenceTest.ReshapeAutoDimension
+[       OK ] ShapeInferenceTest.ReshapeAutoDimension (0 ms)
+[ RUN      ] ShapeInferenceTest.ResizeWithShape
+[       OK ] ShapeInferenceTest.ResizeWithShape (0 ms)
+[ RUN      ] ShapeInferenceTest.ResizeWithScale
+[       OK ] ShapeInferenceTest.ResizeWithScale (0 ms)
+[ RUN      ] ShapeInferenceTest.ReduceChangeRank
+[       OK ] ShapeInferenceTest.ReduceChangeRank (0 ms)
+[ RUN      ] ShapeInferenceTest.ReshapeAutoDimensionShrink
+[       OK ] ShapeInferenceTest.ReshapeAutoDimensionShrink (0 ms)
+[ RUN      ] ShapeInferenceTest.ReshapeAutoDimensionExpand
+[       OK ] ShapeInferenceTest.ReshapeAutoDimensionExpand (0 ms)
+[ RUN      ] ShapeInferenceTest.SqueezeTestAllDims
+[       OK ] ShapeInferenceTest.SqueezeTestAllDims (0 ms)
+[ RUN      ] ShapeInferenceTest.SqueezeTestSpecificDims
+[       OK ] ShapeInferenceTest.SqueezeTestSpecificDims (0 ms)
+[ RUN      ] ShapeInferenceTest.SqueezeTestScalarResult
+[       OK ] ShapeInferenceTest.SqueezeTestScalarResult (0 ms)
+[----------] 9 tests from ShapeInferenceTest (1 ms total)
+[----------] 1 test from ShapeRange
+[ RUN      ] ShapeRange.Contains
+[       OK ] ShapeRange.Contains (0 ms)
+[----------] 1 test from ShapeRange (0 ms total)
+[----------] 3 tests from TensorVariant
+[ RUN      ] TensorVariant.BasicTest
+[       OK ] TensorVariant.BasicTest (0 ms)
+[ RUN      ] TensorVariant.ElementSizeDeductionTest
+[       OK ] TensorVariant.ElementSizeDeductionTest (0 ms)
+[ RUN      ] TensorVariant.DeletionTest
+[       OK ] TensorVariant.DeletionTest (0 ms)
+[----------] 3 tests from TensorVariant (0 ms total)
+[----------] 1 test from NodeMutatorTest
+[ RUN      ] NodeMutatorTest.SimpleChainTest
+[       OK ] NodeMutatorTest.SimpleChainTest (0 ms)
+[----------] 1 test from NodeMutatorTest (0 ms total)
+[----------] 3 tests from Graph
+[ RUN      ] Graph.ReplaceInputs
+[       OK ] Graph.ReplaceInputs (0 ms)
+[ RUN      ] Graph.ReplaceOutputs
+[       OK ] Graph.ReplaceOutputs (0 ms)
+[ RUN      ] Graph.ReplaceOutputNodeWithInput
+[       OK ] Graph.ReplaceOutputNodeWithInput (0 ms)
+[----------] 3 tests from Graph (0 ms total)
+[----------] 4 tests from Serializer
+[ RUN      ] Serializer.ShapeSerializationTest
+[       OK ] Serializer.ShapeSerializationTest (0 ms)
+[ RUN      ] Serializer.IntTensorSerializationTest
+[       OK ] Serializer.IntTensorSerializationTest (0 ms)
+[ RUN      ] Serializer.FloatTensorSerializationTest
+[       OK ] Serializer.FloatTensorSerializationTest (0 ms)
+[ RUN      ] Serializer.DoubleTensorSerializationTest
+[       OK ] Serializer.DoubleTensorSerializationTest (0 ms)
+[----------] 4 tests from Serializer (0 ms total)
+[----------] 4 tests from Deserializer
+[ RUN      ] Deserializer.ShapeDeserializationTest
+[       OK ] Deserializer.ShapeDeserializationTest (1 ms)
+[ RUN      ] Deserializer.IntTensorDeserializationTest
+[       OK ] Deserializer.IntTensorDeserializationTest (0 ms)
+[ RUN      ] Deserializer.FloatTensorDeserializationTest
+[       OK ] Deserializer.FloatTensorDeserializationTest (0 ms)
+[ RUN      ] Deserializer.DoubleTensorDeserializationTest
+[       OK ] Deserializer.DoubleTensorDeserializationTest (0 ms)
+[----------] 4 tests from Deserializer (1 ms total)
+[----------] 4 tests from SimpleInput/ShapeIteratorTest
+[ RUN      ] SimpleInput/ShapeIteratorTest.ElementCount/0
+[       OK ] SimpleInput/ShapeIteratorTest.ElementCount/0 (0 ms)
+[ RUN      ] SimpleInput/ShapeIteratorTest.ElementCount/1
+[       OK ] SimpleInput/ShapeIteratorTest.ElementCount/1 (0 ms)
+[ RUN      ] SimpleInput/ShapeIteratorTest.ElementCount/2
+[       OK ] SimpleInput/ShapeIteratorTest.ElementCount/2 (0 ms)
+[ RUN      ] SimpleInput/ShapeIteratorTest.ElementCount/3
+[       OK ] SimpleInput/ShapeIteratorTest.ElementCount/3 (0 ms)
+[----------] 4 tests from SimpleInput/ShapeIteratorTest (0 ms total)
+[----------] Global test environment tear-down
+[==========] 35 tests from 11 test cases ran. (2 ms total)
+[  PASSED  ] 35 tests.
+
+::
+
+[==========] Running 20 tests from 2 test cases.
+[----------] Global test environment set-up.
+[----------] 19 tests from cpp_operations_test
+[ RUN      ] cpp_operations_test.bias
+[       OK ] cpp_operations_test.bias (1 ms)
+[ RUN      ] cpp_operations_test.scale
+[       OK ] cpp_operations_test.scale (0 ms)
+[ RUN      ] cpp_operations_test.capped_relu
+[       OK ] cpp_operations_test.capped_relu (0 ms)
+[ RUN      ] cpp_operations_test.concat
+[       OK ] cpp_operations_test.concat (9 ms)
+[ RUN      ] cpp_operations_test.add2
+[       OK ] cpp_operations_test.add2 (1 ms)
+[ RUN      ] cpp_operations_test.mul3
+[       OK ] cpp_operations_test.mul3 (1 ms)
+[ RUN      ] cpp_operations_test.max4
+[       OK ] cpp_operations_test.max4 (2 ms)
+[ RUN      ] cpp_operations_test.convTransposed2d
+[       OK ] cpp_operations_test.convTransposed2d (3173 ms)
+[ RUN      ] cpp_operations_test.conv2d
+[       OK ] cpp_operations_test.conv2d (179 ms)
+[ RUN      ] cpp_operations_test.fully_connected
+[       OK ] cpp_operations_test.fully_connected (0 ms)
+[ RUN      ] cpp_operations_test.maxpool
+[       OK ] cpp_operations_test.maxpool (30 ms)
+[ RUN      ] cpp_operations_test.avgpool
+[       OK ] cpp_operations_test.avgpool (51 ms)
+[ RUN      ] cpp_operations_test.relu
+[       OK ] cpp_operations_test.relu (0 ms)
+[ RUN      ] cpp_operations_test.elu
+[       OK ] cpp_operations_test.elu (0 ms)
+[ RUN      ] cpp_operations_test.tanh
+[       OK ] cpp_operations_test.tanh (1 ms)
+[ RUN      ] cpp_operations_test.reduceMeanTst
+[       OK ] cpp_operations_test.reduceMeanTst (3 ms)
+[ RUN      ] cpp_operations_test.softmax
+[       OK ] cpp_operations_test.softmax (1 ms)
+[ RUN      ] cpp_operations_test.reshape
+[       OK ] cpp_operations_test.reshape (0 ms)
+[ RUN      ] cpp_operations_test.pad
+[       OK ] cpp_operations_test.pad (1 ms)
+[----------] 19 tests from cpp_operations_test (3453 ms total)
+[----------] 1 test from cpp_operations_tests
+[ RUN      ] cpp_operations_tests.depthwise_conv
+[       OK ] cpp_operations_tests.depthwise_conv (126 ms)
+[----------] 1 test from cpp_operations_tests (126 ms total)
+[----------] Global test environment tear-down
+[==========] 20 tests from 2 test cases ran. (3579 ms total)
+[  PASSED  ] 20 tests.
+
+::
+
+[==========] Running 4 tests from 3 test cases.
+[----------] Global test environment set-up.
+[----------] 1 test from Generator
+[ RUN      ] Generator.check_generator_call
+[       OK ] Generator.check_generator_call (7 ms)
+[----------] 1 test from Generator (7 ms total)
+[----------] 2 tests from SOFT_BACKEND
+[ RUN      ] SOFT_BACKEND.shape_and_index
+[       OK ] SOFT_BACKEND.shape_and_index (90 ms)
+[ RUN      ] SOFT_BACKEND.tensor
+[       OK ] SOFT_BACKEND.tensor (0 ms)
+[----------] 2 tests from SOFT_BACKEND (90 ms total)
+[----------] 1 test from ModelAnalyzer
+[ RUN      ] ModelAnalyzer.linearization
+[       OK ] ModelAnalyzer.linearization (0 ms)
+[----------] 1 test from ModelAnalyzer (0 ms total)
+[----------] Global test environment tear-down
+[==========] 4 tests from 3 test cases ran. (97 ms total)
+[  PASSED  ] 4 tests.
+
+::
+
+[==========] Running 11 tests from 2 test cases.
+[----------] Global test environment set-up.
+[----------] 1 test from acl_backend_dom_to_text
+[ RUN      ] acl_backend_dom_to_text.ArtifactLiteral
+[       OK ] acl_backend_dom_to_text.ArtifactLiteral (0 ms)
+[----------] 1 test from acl_backend_dom_to_text (0 ms total)
+[----------] 10 tests from acl_backend_mir_to_dom
+[ RUN      ] acl_backend_mir_to_dom.bias
+[       OK ] acl_backend_mir_to_dom.bias (2 ms)
+[ RUN      ] acl_backend_mir_to_dom.scale
+[       OK ] acl_backend_mir_to_dom.scale (1 ms)
+[ RUN      ] acl_backend_mir_to_dom.concat
+[       OK ] acl_backend_mir_to_dom.concat (0 ms)
+[ RUN      ] acl_backend_mir_to_dom.conv2d
+[       OK ] acl_backend_mir_to_dom.conv2d (1 ms)
+[ RUN      ] acl_backend_mir_to_dom.depthwise_conv
+[       OK ] acl_backend_mir_to_dom.depthwise_conv (0 ms)
+[ RUN      ] acl_backend_mir_to_dom.fully_connected
+[       OK ] acl_backend_mir_to_dom.fully_connected (1 ms)
+[ RUN      ] acl_backend_mir_to_dom.maxpool
+[       OK ] acl_backend_mir_to_dom.maxpool (0 ms)
+[ RUN      ] acl_backend_mir_to_dom.relu
+[       OK ] acl_backend_mir_to_dom.relu (0 ms)
+[ RUN      ] acl_backend_mir_to_dom.softmax
+[       OK ] acl_backend_mir_to_dom.softmax (1 ms)
+[ RUN      ] acl_backend_mir_to_dom.reshape
+[       OK ] acl_backend_mir_to_dom.reshape (0 ms)
+[----------] 10 tests from acl_backend_mir_to_dom (6 ms total)
+[----------] Global test environment tear-down
+[==========] 11 tests from 2 test cases ran. (6 ms total)
+[  PASSED  ] 11 tests.
+
+::
+
+[==========] Running 1 test from 1 test case.
+[----------] Global test environment set-up.
+[----------] 1 test from SUPPORT_NNC
+[ RUN      ] SUPPORT_NNC.verify_cl_options
+[       OK ] SUPPORT_NNC.verify_cl_options (1 ms)
+[----------] 1 test from SUPPORT_NNC (1 ms total)
+[----------] Global test environment tear-down
+[==========] 1 test from 1 test case ran. (1 ms total)
+[  PASSED  ] 1 test.
+
+::
+
+[==========] Running 1 test from 1 test case.
+[----------] Global test environment set-up.
+[----------] 1 test from CAFFE_IMPORT_UNSUPPORTED
+[ RUN      ] CAFFE_IMPORT_UNSUPPORTED.ImportAModelWithUnsupportedLayers
+[       OK ] CAFFE_IMPORT_UNSUPPORTED.ImportAModelWithUnsupportedLayers (3 ms)
+[----------] 1 test from CAFFE_IMPORT_UNSUPPORTED (3 ms total)
+[----------] Global test environment tear-down
+[==========] 1 test from 1 test case ran. (3 ms total)
+[  PASSED  ] 1 test.
+
 
 Defect Status
 =============