[lit] Add SKIPPED test result category
authorJulian Lettner <julian.lettner@gmail.com>
Fri, 8 Mar 2019 04:48:24 +0000 (20:48 -0800)
committerJulian Lettner <julian.lettner@apple.com>
Fri, 10 Apr 2020 22:13:30 +0000 (15:13 -0700)
commitcbe42a9d5fa76eb56cbe615bd64cff2e6a8a9d65
tree1e50a5f89f3ae7c8c133e2f1e5058b259dde4cdc
parent889f6606ed54878bfcbcc6431d7eae59b05923bf
[lit] Add SKIPPED test result category

Track and print the number of skipped tests.  Skipped tests are tests
that should have been executed but weren't due to:
  * user interrupt [Ctrl+C]
  * --max-time (overall lit timeout)
  * --max-failures

This is part of a larger effort to ensure that all discovered tests are
properly accounted for.

Add test for overall lit timeout feature (`--max-time` option) to
observe skipped tests.  Extend test for `--max-failures` option.

Reviewed By: jdenny

Differential Revision: https://reviews.llvm.org/D77819
llvm/utils/lit/lit/Test.py
llvm/utils/lit/lit/main.py
llvm/utils/lit/lit/run.py
llvm/utils/lit/tests/Inputs/max-time/fast.txt [new file with mode: 0644]
llvm/utils/lit/tests/Inputs/max-time/lit.cfg [new file with mode: 0644]
llvm/utils/lit/tests/Inputs/max-time/slow.txt [new file with mode: 0644]
llvm/utils/lit/tests/max-failures.py
llvm/utils/lit/tests/max-time.py [new file with mode: 0644]