Add JIT stress mode testing using libraries tests (#36486)
authorBruce Forstall <brucefo@microsoft.com>
Tue, 16 Jun 2020 16:10:23 +0000 (09:10 -0700)
committerGitHub <noreply@github.com>
Tue, 16 Jun 2020 16:10:23 +0000 (09:10 -0700)
commit9929c07b6125ce9197e72d9b746966e6781a5ec3
tree2ae70125aa212ff7c2f4e05abf02509247844fae
parent025bf930d67345ebea031a3f96cc5d2420a58e95
Add JIT stress mode testing using libraries tests (#36486)

* Add JIT stress mode testing using libraries tests

There are three separate pipelines, with different sets of JIT
stress modes enabled for each:

- libraries-jitstress.yml
- libraries-jitstress2-jitstressregs.yml
- libraries-jitstressregs.yml

The live built Release libraries are used with a Checked CoreCLR.

The non-stress configuration is tested during normal PR testing.

The libraries `sendtohelix.proj` file is changed to take an optional
list of CoreCLR stress scenarios to run. If given, a set of environment
setting scripts is created and added to the Helix correlation payload.
Then, an auxiliary `sendtohelixhelp.proj` file is invoked for each
scenario (or just the default, empty scenario) to create and run the
Helix tasks.

* Remove remnants of old corefx-on-coreclr test run infrastructure

* Rename corefx-*.yml to libraries-*.yml

* Disable tests

```
src/libraries/System.Numerics.Vectors/tests/Matrix3x2Tests.cs
https://github.com/dotnet/runtime/issues/36587
Matrix3x2CreateRotationCenterTest()

https://github.com/dotnet/runtime/issues/36587
Matrix3x2CreateScaleCenterTest1()

https://github.com/dotnet/runtime/issues/36587
Matrix3x2CreateScaleCenterTest3()

src/libraries/System.Numerics.Vectors/tests/Matrix4x4Tests.cs
https://github.com/dotnet/runtime/issues/36586
Matrix4x4CreateFromAxisAngleTest()
```

* Fix run-test-job.yml

* Fix BuildAllConfigurations case
23 files changed:
eng/pipelines/common/platform-matrix.yml
eng/pipelines/common/templates/runtimes/run-test-job.yml
eng/pipelines/coreclr/corefx-jitstress.yml [deleted file]
eng/pipelines/coreclr/corefx-jitstress2-jitstressregs.yml [deleted file]
eng/pipelines/coreclr/corefx-jitstressregs.yml [deleted file]
eng/pipelines/coreclr/corefx.yml [deleted file]
eng/pipelines/coreclr/libraries-jitstress.yml [new file with mode: 0644]
eng/pipelines/coreclr/libraries-jitstress2-jitstressregs.yml [new file with mode: 0644]
eng/pipelines/coreclr/libraries-jitstressregs.yml [new file with mode: 0644]
eng/pipelines/coreclr/templates/build-job.yml
eng/pipelines/coreclr/templates/xplat-pipeline-job.yml
eng/pipelines/libraries/helix.yml
eng/pipelines/libraries/run-test-job.yml
src/coreclr/build-test.cmd
src/coreclr/build-test.sh
src/coreclr/tests/Directory.Build.props
src/coreclr/tests/bringup_runtest.sh
src/coreclr/tests/runtest.sh
src/libraries/System.Numerics.Vectors/tests/GenericVectorTests.cs
src/libraries/System.Numerics.Vectors/tests/Matrix3x2Tests.cs
src/libraries/System.Numerics.Vectors/tests/Matrix4x4Tests.cs
src/libraries/sendtohelix.proj
src/libraries/sendtohelixhelp.proj [new file with mode: 0644]