summary |
shortlog | log |
commit |
commitdiff |
tree
first ⋅ prev ⋅ next
MyungJoo Ham [Thu, 17 Aug 2023 08:26:46 +0000 (17:26 +0900)]
Release of 1.4.0 / Added Version info
Release of version 1.4.0
Use -v / --version to show the version info.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Thu, 17 Aug 2023 05:51:08 +0000 (14:51 +0900)]
Use the first unrecognized argument as the path name, not the second.
If there are multiple unrecognized arguments,
treat only the first one as the path.
This will allow to ignore invalid arguments if it has given
the path for backward compatibility in the future.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Thu, 17 Aug 2023 03:19:21 +0000 (12:19 +0900)]
valgrind: suppress errors with a given file
Users may want to suppress some valgrind errors.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Fri, 1 Jul 2022 06:51:55 +0000 (15:51 +0900)]
Add bmp2png utility.
SSAT API has bmp2png, which is supposed to be installed by
SSAT user.
However, this introduces circular dependency; thus,
it is refactored to have bmp2png in SSAT as a utility.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Fri, 10 Jun 2022 10:31:58 +0000 (19:31 +0900)]
Feature: GstTest in Background
Launch a gst pipeline in background for test cases with multiple
gst pipelines collaborating with each other.
Example usage:
gstTestBackground "background pipeline description" TCNAME 0 0 5
// launching the pipeline with 5s timeout for launching-timeout
// Note that the timeout only waits for the pipeline initialization.
// The pipeline shouldn't have indefinite prerolling wait.
// If this pipeline waits for inputs after the launch, make it
// async=false (at sink) so that it may skip prerolling
gstTest "foreground pipeline description, collaborating with above" ...
wait $pid
// the global variable "pid" is the PID of the background pipeline.
// alternatively
kill $pid // the background pipeline is no more needed.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
Gichan Jang [Wed, 23 Jun 2021 02:12:08 +0000 (11:12 +0900)]
[api] Add timeout function
Tizen don't provide timeout util.
Add timeout function using perl.
Signed-off-by: Gichan Jang <gichan2.jang@samsung.com>
Dongju Chae [Thu, 4 Mar 2021 07:05:32 +0000 (16:05 +0900)]
[API] Add timeout mode to gstTest command
This patch adds timeout mode to gstTest command.
It prevents from possible hanging problems.
Signed-off-by: Dongju Chae <dongju.chae@samsung.com>
MyungJoo Ham [Mon, 22 Feb 2021 08:21:49 +0000 (17:21 +0900)]
Release 1.2.0
Update version number.
Make version numbers consistent across files.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Tue, 22 Dec 2020 07:26:53 +0000 (16:26 +0900)]
Update progress mode: use >&2 instead of /dev/stderr
It appears that some Linux distros (gbs-Tizen) does not give
permissions of /dev/stderr for build daemons.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
gichan-jang [Tue, 22 Dec 2020 05:07:13 +0000 (14:07 +0900)]
Add progress log level
Changed to select the progress log level.
- 0: deactivate the log
- 1: print test group name
- 9: print all logs
Signed-off-by: gichan-jang <gichan2.jang@samsung.com>
Yongjoo Ahn [Thu, 8 Oct 2020 07:09:26 +0000 (16:09 +0900)]
[API/compareTest] Return result when files do not exist
- When the file does not exist, in BusyBox condition, the bufsize is null and results of `dd` are same error message. And unexpected PASS result follows.
- This patch prevents this unexpected behavior.
Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
MyungJoo Ham [Mon, 16 Mar 2020 10:35:41 +0000 (19:35 +0900)]
Feature: write summary with negative cases
If -cn is active, the summary file needs to include
the number of negative test cases as well.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Mon, 16 Mar 2020 08:43:26 +0000 (17:43 +0900)]
Feature: count negative test cases
The new option "-cn"/"--countnegative" allows to count
test cases with a specified postfix.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Tue, 21 Jan 2020 01:50:34 +0000 (10:50 +0900)]
Typo fix: variable name typo.
The number of critical errors have been reported incorrectly.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Wed, 18 Dec 2019 03:29:22 +0000 (12:29 +0900)]
Add "--summary <filename>" option
Write a summary of test results to the given filename.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Tue, 15 Oct 2019 04:43:28 +0000 (13:43 +0900)]
Failing ignorable case should not alarm administrators
If a case "ignorable" fails, count it seperatedly so that it does not alarm administrators.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Fri, 6 Sep 2019 04:40:47 +0000 (13:40 +0900)]
Print results of each group as soon as it's available.
Dumping out the whole results at the end may confuse users.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Fri, 6 Sep 2019 04:36:37 +0000 (13:36 +0900)]
[API] If "SILENT", don't show stderr/stdout from gstTest
stderr/stdour of gst-launch should be supressed if it's "silent".
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
Wook Song [Wed, 4 Sep 2019 15:06:42 +0000 (00:06 +0900)]
[API] Define SO_EXT that represents filename extension for shared object
A filename extension of a dynamic loadable library could differ between
system platforms such as Linux and macOS. In order to consider this
issue, this patch defines an environment variable, SO_EXT, which
represents a filename extension for a shared object according to the
system platform.
Signed-off-by: Wook Song <wook16.song@samsung.com>
Wook Song [Tue, 27 Aug 2019 07:46:18 +0000 (16:46 +0900)]
[macOS/API] Use option depending on system to get file size using stat
In order to consider differences in 'stat' between Linux (including
Tizen) and macOS, this patch defines the command line to get file size
using stat according to the system.
Signed-off-by: Wook Song <wook16.song@samsung.com>
Wook Song [Thu, 25 Jul 2019 03:28:20 +0000 (12:28 +0900)]
[API] Check not only _fail but also _criticalFail when determining PASS
In some cases, the report function is used to 'literally' report errors
that occur in test configuration procedure before terminating the test.
For the convenience, this patch makes _criticalFail be also checked when
determining PASS/FAIL of the tests. Therefore, to use for reporting
critical errors to users or systems, only one variable, _criticalFail,
is enough instead of setting both of them.
Signed-off-by: Wook Song <wook16.song@samsung.com>
jijoong.moon [Tue, 30 Apr 2019 01:46:09 +0000 (10:46 +0900)]
add compare check with dd & diff
In case of that there is not available cmp with '-n', dd and diff
compoistion could be useful to compare two file.
diff <(dd bs=1 count=$bufsize if=$1 &>/dev/null) <(dd bs=1
count=$bufsize if=$2 &>/dev/null)
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
Parichay Kapoor [Mon, 15 Apr 2019 06:01:05 +0000 (15:01 +0900)]
Added Valgrind as an option
Valgrind can be enabled by passing --enable-valgrind to ssat
Currently, --full-leaks and --suppressions are not enabled for valgrind
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
MyungJoo Ham [Wed, 6 Mar 2019 06:51:34 +0000 (15:51 +0900)]
Bugfix: do not assume that tc output ends with newline.
When a testcase generates stdout without trailing newline,
SSAT had been failing because it cannot find the tmpfile name.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Mon, 4 Mar 2019 04:25:47 +0000 (13:25 +0900)]
Prevent spinning of gst-launch with SIGSEGV
By default, gst-launch tries to handle SIGSEGV, which
incur spinning in a bare-Linux systems including the VMs of
pdebuild/gbs/obs.
For example:
```
Caught SIGSEGV
exec gdb failed: No such file or directory
Spinning. Please run 'gdb gst-launch-1.0 10693' to continue debugging, Ctrl-C to quit, or Ctrl-\ to dump core.
```
During unit-testing, we simply need to report errors,
not to handle them. Thus, we disable signal handler of
gst-launch.
This fixes https://github.com/nnsuite/nnstreamer/issues/1104
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Tue, 29 Jan 2019 10:58:54 +0000 (19:58 +0900)]
With -p (progress), print progress of each case.
Print out not just the progress of test sets, but of each test case.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Mon, 12 Nov 2018 06:27:40 +0000 (15:27 +0900)]
Added option "-p" showing the progress
With -p the progress is printed out.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Thu, 1 Nov 2018 05:35:17 +0000 (14:35 +0900)]
Doxygen Configuration for SSAT
With the given files, users may generate doxygen entries easily
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Thu, 1 Nov 2018 05:33:27 +0000 (14:33 +0900)]
Doxygen Entries Compatible with bash-doxygen
Doxygen entries are updated to comply with bash-doxygen
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Thu, 1 Nov 2018 01:01:03 +0000 (10:01 +0900)]
Doxygen entries and license clarification for templates
- Added doxygen entries for template runTest.sh
- Clarified licenses for template runTest.sh: users may designate any.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Wed, 31 Oct 2018 04:23:09 +0000 (13:23 +0900)]
[DIST] Tizen/RPM: this is noarch package.
We have bash scripts only. Thus, it is noarch.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Wed, 31 Oct 2018 02:57:07 +0000 (11:57 +0900)]
Add test case statistics at the end of result
Before:
==================================================
[PASSED] All Test Groups (14) Passed!
After:
==================================================
[PASSED] All Test Groups (14) Passed!
TC Passed: 215 / Failed: 0
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Wed, 31 Oct 2018 02:48:20 +0000 (11:48 +0900)]
[Bugfix] callCMP is no more NYI. missing shift/unset IFS
- Missing IFS caused incorrect behaviors of gstTest.
- Missing shift caused incorrect test target designation
- CallCMP is no more NYI.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Tue, 30 Oct 2018 11:52:02 +0000 (20:52 +0900)]
Add alternative semantics for testResult reporting
With the fifth argument set 1, 0 becomes "PASS".
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Tue, 30 Oct 2018 11:19:02 +0000 (20:19 +0900)]
Implement callCompareTest and support nnstreamer/gstreamer
1. Implement callCompareTest, "cmp" mode.
2. Support nnstreamer test case (tested with nnstreamer_converter cases)
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Tue, 30 Oct 2018 08:24:30 +0000 (17:24 +0900)]
[DIST] Support debian/ubuntu build
Added debian/* files.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Tue, 30 Oct 2018 08:16:51 +0000 (17:16 +0900)]
[DIST] Add RPM packaging for Tizen
This spec file can be reused for Redhat/Fedora/SUSE and other RPM distros
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Tue, 30 Oct 2018 08:15:25 +0000 (17:15 +0900)]
[Bugfix] if/then/else error with empty expressions.
Add NYI expression to avoid errors.
Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
MyungJoo Ham [Sun, 24 Jun 2018 05:14:27 +0000 (14:14 +0900)]
[API] Implement callTest*
TODO: callCompateTest is not yet implemented.
Signed-off-by: MyungJoo Ham <myungjoo.ham@gmail.com>
MyungJoo Ham [Sat, 23 Jun 2018 14:40:52 +0000 (23:40 +0900)]
[Fix] Multi Test Group
Fix bugs of handling multiple test groups.
Added "create template" for easy test group creation.
TODO: need to support "PATH" searching
Signed-off-by: MyungJoo Ham <myungjoo.ham@gmail.com>
MyungJoo Ham [Sat, 23 Jun 2018 13:55:04 +0000 (22:55 +0900)]
[Example/group1A] Allow to print out out of ssat.sh
When "runTest.sh" is executed independently (out of ssat.sh),
it can now print out its results.
Signed-off-by: MyungJoo Ham <myungjoo.ham@gmail.com>
MyungJoo Ham [Sat, 23 Jun 2018 13:43:35 +0000 (22:43 +0900)]
[Main] Options added, test group features added
- -s, -n options are added
- test group results are gathered at main
Signed-off-by: MyungJoo Ham <myungjoo.ham@gmail.com>
MyungJoo Ham [Sat, 23 Jun 2018 07:53:54 +0000 (16:53 +0900)]
Initial main skeleton with a single example
The first code commit with structure skeleton.
Signed-off-by: MyungJoo Ham <myungjoo.ham@gmail.com>
MyungJoo Ham [Fri, 22 Jun 2018 09:22:20 +0000 (18:22 +0900)]
Initial commit