Support expected failures in .test-result files.
authorJoseph Myers <joseph@codesourcery.com>
Thu, 27 Feb 2014 03:25:27 +0000 (03:25 +0000)
committerJoseph Myers <joseph@codesourcery.com>
Thu, 27 Feb 2014 03:25:27 +0000 (03:25 +0000)
commitf8c17e79fab13a3d1de976c1c3564df7f8c2a175
tree3192a7221761cb0a42279698044f338c961ccc1e
parenta5f891ac8df09e56ecc64bf18a839a06470deacd
Support expected failures in .test-result files.

This patch, an updated version of
<https://sourceware.org/ml/libc-alpha/2014-01/msg00195.html>, makes it
possible for .test-result files for individual tests to contain XPASS
and XFAIL rather than PASS and FAIL in cases where failure is
expected.  This replaces the marking of two individual tests with "-"
to cause them to be expected at makefile level to fail;
evaluate-test.sh will ensure it exits with status 0 for an expected
failure.

Tested x86_64.

* scripts/evaluate-test.sh: Take new argument indicating whether
failure is expected.
* Makeconfig (evaluate-test): Pass argument to evaluate-test.sh
indicating whether failure is expected.
* conform/Makefile (test-xfail-run-conformtest): New variable.
($(objpfx)run-conformtest.out): Don't expect to fail at makefile
level.
* posix/Makefile (test-xfail-annexc): New variable.
($(objpfx)annexc.out): Don't expect to fail at makefile level.
ChangeLog
Makeconfig
conform/Makefile
posix/Makefile
scripts/evaluate-test.sh