Upgraded test harness 16/59016/4
authorDavid Steele <david.steele@samsung.com>
Mon, 8 Feb 2016 11:50:10 +0000 (11:50 +0000)
committerDavid Steele <david.steele@samsung.com>
Tue, 9 Feb 2016 14:12:19 +0000 (14:12 +0000)
commitedd951c375ac2a6ec5701aa850637503ba1348c8
tree3b3397ee1bbf980ccea213496f6bf84a6b575ba6
parent2a8f032f9d3e1a78a31986a95ea72964a5b515b0
Upgraded test harness

A new Serial mode has been added to the test harness that will run
test cases in serial without using Testkit Lite. This executes all
the dali test cases in ~35 seconds, and dumps the test case output
to stdout/stderr. It can be run using "execute.sh -S"

Have changed the Parallel mode to always re-run failing test cases,
causing it to display the failing checks.

All types of execution now write to summary.xml, and display a human
readable version of it before exiting.

execute.sh's exit status has been changed - 0 means no failures,
1 means there was a test case failure.

Ensured TestGLAbstraction initialization covers all member variables.

Changed Update/Render to check if it's required and to log a warning
if not. Test cases should avoid calling application.Update() or
application.Render() when not required.

Change-Id: I391cf76211ee22472c6b87e9f7ac255d3e147dd7
Signed-off-by: David Steele <david.steele@samsung.com>
17 files changed:
automated-tests/README.md
automated-tests/build.sh
automated-tests/execute.sh
automated-tests/scripts/output_summary.pl [new file with mode: 0755]
automated-tests/scripts/summarize.pl
automated-tests/src/dali-toolkit-internal/tct-dali-toolkit-internal-core.cpp
automated-tests/src/dali-toolkit/dali-toolkit-test-utils/test-application.cpp
automated-tests/src/dali-toolkit/dali-toolkit-test-utils/test-application.h
automated-tests/src/dali-toolkit/dali-toolkit-test-utils/test-gl-abstraction.cpp
automated-tests/src/dali-toolkit/dali-toolkit-test-utils/test-gl-abstraction.h
automated-tests/src/dali-toolkit/dali-toolkit-test-utils/test-gl-sync-abstraction.cpp
automated-tests/src/dali-toolkit/dali-toolkit-test-utils/test-gl-sync-abstraction.h
automated-tests/src/dali-toolkit/dali-toolkit-test-utils/test-harness.cpp
automated-tests/src/dali-toolkit/dali-toolkit-test-utils/test-harness.h
automated-tests/src/dali-toolkit/dali-toolkit-test-utils/test-trace-call-stack.cpp
automated-tests/src/dali-toolkit/dali-toolkit-test-utils/test-trace-call-stack.h
automated-tests/src/dali-toolkit/tct-dali-toolkit-core.cpp