Add more benchmarks to JitBench (#16353)
authorNoah Falk <noahfalk@users.noreply.github.com>
Wed, 21 Feb 2018 23:15:09 +0000 (15:15 -0800)
committerGitHub <noreply@github.com>
Wed, 21 Feb 2018 23:15:09 +0000 (15:15 -0800)
commit17541a4655715b68219ca974a07af5e6a985acb1
treeae2e285518578dd9e69a0ccd4cf7a1136e279dee
parent287cff2d0908876b4dedac61d7faa871b5fbe21e
Add more benchmarks to JitBench (#16353)

* Add more JitBench Benchmarks

a) JitBench includes several more benchmarks and a refactored runner to make it easier to add more
b) A new JitBench/unofficial_dotnet SDK style build project offers simpler developer workflow at the command line and in VS when working with these Benchmarks
c) Misc build issues with local dotnet build in the test tree have workarounds now, but official CI builds still don't support it
d) run-xunit-perf.py has support to run a specific assembly from the testBinLoc folder intended to handle selecting a binary from the folder of binaries produced in the .Net Core SDK project build process. However until CI build can support building projects that way the xunit-perf support is unused.
35 files changed:
dependencies.props
tests/dir.props
tests/scripts/run-xunit-perf.py
tests/src/dirs.proj
tests/src/performance/Scenario/JitBench/Benchmarks/BuildHelloWorldBenchmark.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Benchmarks/CscBenchmark.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Benchmarks/CscHelloWorldBenchmark.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Benchmarks/CscRoslynSourceBenchmark.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Benchmarks/MusicStoreBenchmark.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/IterationData.cs [deleted file]
tests/src/performance/Scenario/JitBench/JitBench.csproj
tests/src/performance/Scenario/JitBench/JitBenchHarness.cs [deleted file]
tests/src/performance/Scenario/JitBench/JitBenchHarnessOptions.cs [deleted file]
tests/src/performance/Scenario/JitBench/Properties/launchSettings.json [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Runner/Benchmark.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Runner/BenchmarkConfiguration.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Runner/BenchmarkRunResult.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Runner/BenchviewResultExporter.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Runner/CommandLineOptions.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Runner/Program.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Runner/Statistics.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Runner/TestRun.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Utilities/ConsoleRedirector.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Utilities/ConsoleTestOutputHelper.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Utilities/DotNetSetup.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Utilities/FileTasks.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Utilities/FileTestOutputHelper.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Utilities/IProcessLogger.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Utilities/ITestOutputHelper.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Utilities/IndentedTestOutputHelper.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Utilities/ProcessRunner.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/Utilities/TestOutputProcessLogger.cs [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/unofficial_dotnet/JitBench.csproj [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/unofficial_dotnet/Properties/launchSettings.json [new file with mode: 0644]
tests/src/performance/Scenario/JitBench/unofficial_dotnet/README.md [new file with mode: 0644]