Introduce new NNAPI test generator (#6924)
author오형석/On-Device Lab(SR)/Staff Engineer/삼성전자 <hseok82.oh@samsung.com>
Wed, 28 Aug 2019 02:22:55 +0000 (11:22 +0900)
committerGitHub Enterprise <noreply-CODE@samsung.com>
Wed, 28 Aug 2019 02:22:55 +0000 (11:22 +0900)
commit3ee60c77ae1288bd33933b41f3d6d4b52feb893c
tree04662a9d52cc202d015572bca9dc93fa5586d8d0
parent1e57da4144b62d3990efddb926c3df98cb5cd379
Introduce new NNAPI test generator (#6924)

Move test generator into tests/nnapi/nnapi_test_generator/android-p
Introduce test generator into tests/nnapi/nnapi_test_generator/android-q-beta from current android master (not used yet)
Update README.md for introduced test generator

Signed-off-by: Hyeongseok Oh <hseok82.oh@samsung.com>
102 files changed:
tests/nnapi/nnapi_test_generator/android-p/README.md [moved from tests/nnapi/nnapi_test_generator/README.md with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/include/TestHarness.h [moved from tests/nnapi/nnapi_test_generator/include/TestHarness.h with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/slicing.py [moved from tests/nnapi/nnapi_test_generator/slicing.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/test_generator.py [moved from tests/nnapi/nnapi_test_generator/test_generator.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_conv/conv_1_h3_w2_SAME.mod.py [moved from tests/nnapi/nnapi_test_generator/tests/P_conv/conv_1_h3_w2_SAME.mod.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_conv/stderr.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_weird/stderr.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_conv/stdout.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_conv/stdout.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_depthwise_conv/depthwise_conv.bin.mod.py [moved from tests/nnapi/nnapi_test_generator/tests/P_depthwise_conv/depthwise_conv.bin.mod.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_depthwise_conv/stderr.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_quantized_conv/stderr.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_depthwise_conv/stdout.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_depthwise_conv/stdout.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_explicit/explicit_add.mod.py [moved from tests/nnapi/nnapi_test_generator/tests/P_explicit/explicit_add.mod.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_explicit/stderr.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_quantized_avgpool/stderr.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_explicit/stdout.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_explicit/stdout.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_float/addfloat.mod.py [moved from tests/nnapi/nnapi_test_generator/tests/P_float/addfloat.mod.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_float/stderr.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_lstm/stderr.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_float/stdout.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_float/stdout.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_full/addfloat.mod.py [moved from tests/nnapi/nnapi_test_generator/tests/P_full/addfloat.mod.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_full/stderr.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_full/stderr.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_full/stdout.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_full/stdout.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_lstm/lstm.mod.py [moved from tests/nnapi/nnapi_test_generator/tests/P_lstm/lstm.mod.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_lstm/stderr.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_float/stderr.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_lstm/stdout.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_lstm/stdout.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_quantized_avgpool/averpoolfloat.mod.py [moved from tests/nnapi/nnapi_test_generator/tests/P_quantized_avgpool/averpoolfloat.mod.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_quantized_avgpool/stderr.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_explicit/stderr.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_quantized_avgpool/stdout.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_quantized_avgpool/stdout.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_quantized_conv/quantized.mod.py [moved from tests/nnapi/nnapi_test_generator/tests/P_quantized_conv/quantized.mod.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_quantized_conv/stderr.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_depthwise_conv/stderr.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_quantized_conv/stdout.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_quantized_conv/stdout.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_vts_full/stderr.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_vts_operands/stderr.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_vts_full/stdout.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_vts_full/stdout.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_vts_full/vts_full.mod.py [moved from tests/nnapi/nnapi_test_generator/tests/P_vts_full/vts_full.mod.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_vts_operands/addfloat.mod.py [moved from tests/nnapi/nnapi_test_generator/tests/P_vts_operands/addfloat.mod.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_vts_operands/stderr.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_vts_full/stderr.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_vts_operands/stdout.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_vts_operands/stdout.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_weird/stderr.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_conv/stderr.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_weird/stdout.txt.expect [moved from tests/nnapi/nnapi_test_generator/tests/P_weird/stdout.txt.expect with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/P_weird/weird_add.mod.py [moved from tests/nnapi/nnapi_test_generator/tests/P_weird/weird_add.mod.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/tests/test.py [moved from tests/nnapi/nnapi_test_generator/tests/test.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-p/vts_generator.py [moved from tests/nnapi/nnapi_test_generator/vts_generator.py with 100% similarity]
tests/nnapi/nnapi_test_generator/android-q-beta/README.md [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/cts_generator.py [new file with mode: 0755]
tests/nnapi/nnapi_test_generator/android-q-beta/include/TestHarness.h [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/spec_visualizer.py [new file with mode: 0755]
tests/nnapi/nnapi_test_generator/android-q-beta/spec_viz_template.html [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/test_generator.py [new file with mode: 0755]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_backward_compatibility_float/lstm_float.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_backward_compatibility_float/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_backward_compatibility_float/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_backward_compatibility_quant8/depthwise_conv2d_quant8.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_backward_compatibility_quant8/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_backward_compatibility_quant8/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_float/conv_float.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_float/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_float/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_implicit_parameter/mean_implicit.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_implicit_parameter/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_implicit_parameter/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_implicit_variation/conv_float.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_implicit_variation/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_implicit_variation/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_internal/add_internal.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_internal/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_internal/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_naming/conv_float.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_naming/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_naming/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_quant8/conv_quant8.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_quant8/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_quant8/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_variation/conv_float.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_variation/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_variation/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_backward_compatibility_float/lstm_float.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_backward_compatibility_float/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_backward_compatibility_float/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_backward_compatibility_quant8/depthwise_conv2d_quant8.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_backward_compatibility_quant8/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_backward_compatibility_quant8/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_float/conv_float.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_float/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_float/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_implicit_parameter/mean_implicit.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_implicit_parameter/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_implicit_parameter/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_implicit_variation/conv_float.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_implicit_variation/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_implicit_variation/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_internal/add_internal.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_internal/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_internal/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_naming/conv_float.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_naming/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_naming/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_quant8/conv_quant8.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_quant8/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_quant8/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_variation/conv_float.mod.py [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_variation/stderr.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/P_vts_variation/stdout.txt.expect [new file with mode: 0644]
tests/nnapi/nnapi_test_generator/android-q-beta/tests/test.py [new file with mode: 0755]
tests/nnapi/nnapi_test_generator/android-q-beta/vts_generator.py [new file with mode: 0755]
tests/nnapi/specs/generate_test.sh