[lldb][tests] Make it possible to expect failure for a whole category
authorTatyana Krasnukha <tatyana@synopsys.com>
Thu, 12 Dec 2019 12:01:25 +0000 (15:01 +0300)
committerTatyana Krasnukha <tatyana@synopsys.com>
Fri, 10 Jan 2020 14:37:55 +0000 (17:37 +0300)
commit3eea082535e232b35e6b2dab45dd81728b2ae7f4
tree131a7b0723b95aae2c80ca969d80d628bde54a82
parente20a3b9b6c028ef3fea92ddb19e98db45e3d0509
[lldb][tests] Make it possible to expect failure for a whole category

There already are decorators and "--excluded" option to mark test-cases/files
as expected to fail. However, when a new test file is added and it which relates
to a feature that a target doesn't support, this requires either adding decorators
to that file or modifying the file provided as "--excluded" option value.

The purpose of this patch is to avoid any modifications in such cases.
E.g. if a target doesn't support "watchpoints" and passes "--xfail-category watchpoint"
to dotest, a testing job will not fail after a new watchpoint-related test file is added.

Differential Revision: https://reviews.llvm.org/D71906
lldb/packages/Python/lldbsuite/test/configuration.py
lldb/packages/Python/lldbsuite/test/dotest.py
lldb/packages/Python/lldbsuite/test/dotest_args.py
lldb/packages/Python/lldbsuite/test/test_result.py