From: Mike McLaughlin Date: Fri, 2 Aug 2024 16:25:05 +0000 (-0700) Subject: Allow SOS testing against a private runtime build (#4818) X-Git-Tag: accepted/tizen/unified/20241231.014852~39^2^2~112 X-Git-Url: http://review.tizen.org/git/?a=commitdiff_plain;h=bad6880265cdfbc880df77e9748f4942fd536382;p=platform%2Fcore%2Fdotnet%2Fdiagnostics.git Allow SOS testing against a private runtime build (#4818) Added eng\privatebuild.cmd and eng/privatebuild.sh and some build changes that sets up for testing against a private build. Just the latest 9.0.x runtimes are installed and tested against. Added eng/testsos* as a short cut to running just the SOS tests. Updated the doc on the end-to-end procedure. --- diff --git a/documentation/privatebuildtesting.md b/documentation/privatebuildtesting.md index 1b5af9b11..83440d092 100644 --- a/documentation/privatebuildtesting.md +++ b/documentation/privatebuildtesting.md @@ -1,36 +1,51 @@ Private runtime build testing ============================= -Here are some instructions on how to run the diagnostics repo's tests against a locally build private .NET Core runtime based on CoreCLR. These directions will work on Windows, Linux and MacOS. +Here are some instructions on how to run the diagnostics repo's tests against a locally built private .NET Core runtime based on CoreCLR. These directions will work on Windows, Linux and MacOS. The testing is currently scoped to just the runtime not the libraries and not single-file apps. -1. Build the runtime repo (see [Workflow Guide](https://github.com/dotnet/runtime/blob/main/docs/workflow/README.md)). +1. Build the runtime repo (see [Workflow Guide](https://github.com/dotnet/runtime/blob/main/docs/workflow/README.md)) with `-configuration release -subset clr`. A release build is highly recommended. 2. Build the diagnostics repo (see [Building the Repository](../README.md)). -3. Run the diagnostics repo tests with the -privatebuildpath option. +3. Run the `eng\privatebuild.cmd` or `eng/privatebuild.sh` test runtime install script. This installs and sets up to run (just) the latest test runtimes (currently 9.0) into the `.dotnet-test` directory. +4. On Windows 11 (this doesn't work on Windows 10), add the following DWORD registry key: `HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\CurrentVersion\MiniDumpSettings\DisableAuxProviderSignatureCheck` and set it to 1. This allows the unsigned privately built DAC to be used to generate dumps. +5. Copy the private runtime binaries over the test SDK/runtimes installed in `.dotnet-test`. This step is hard to automate because there are usually 3 versions of the runtime installed: one as part of the .NET SDK, one as part of the AspNetCore runtime and one from latest runtime DARC update. +6. Run the diagnostics repo tests either: + a. `test.cmd` or `test.sh` - this runs all the diagnostics tests including SOS's. A html test report will be generated in `artifacts/TestResults/{Debug,Release}/SOS.UnitTests_net6.0_x64.html`. + b. Use the VS Test Explorer to run all the SOS tests or a specific one. + c. Use `eng\testsos.cmd` or `eng/testsos.sh` to run just the SOS tests. The html test report isn't generated in this case, but the SOS test logs are in artifacts/TestResults/{Debug,Release}/sos_*. -The following examples assume a Debug build of the runtime and diagnsotics. However any flavor can be used with the following steps: +The following examples assume a release build of the runtime. The runtime version numbers will vary. + +#### Windows x64 Example Script -On Windows: -``` -C:\diagnostics> test -privatebuildpath c:\runtime\artifacts\bin\coreclr\Windows_NT.x64.Debug ``` +copy c:\src\runtime\artifacts\bin\coreclr\windows.x64.Release\sharedFramework\* c:\src\diagnostics\.dotnet-test\shared\Microsoft.NETCore.App\9.0.0-preview.7.24366.18 +copy c:\src\runtime\artifacts\bin\coreclr\windows.x64.Release\System.Private.CoreLib.dll c:\src\diagnostics\.dotnet-test\shared\Microsoft.NETCore.App\9.0.0-preview.7.24366.18 -When you are all done with the private runtime testing, run this command to remove the Windows registry entries added in the above steps. +copy c:\src\runtime\artifacts\bin\coreclr\windows.x64.Release\sharedFramework\* c:\src\diagnostics\.dotnet-test\shared\Microsoft.NETCore.App\9.0.0-preview.7.24365.2 +copy c:\src\runtime\artifacts\bin\coreclr\windows.x64.Release\System.Private.CoreLib.dll c:\src\diagnostics\.dotnet-test\shared\Microsoft.NETCore.App\9.0.0-preview.7.24365.2 -``` -C:\diagnostics> test -cleanupprivatebuild +copy c:\src\runtime\artifacts\bin\coreclr\windows.x64.Release\sharedFramework\* c:\src\diagnostics\.dotnet-test\shared\Microsoft.NETCore.App\9.0.0-preview.4.24251.3 +copy c:\src\runtime\artifacts\bin\coreclr\windows.x64.Release\System.Private.CoreLib.dll c:\src\diagnostics\.dotnet-test\shared\Microsoft.NETCore.App\9.0.0-preview.4.24251.3 ``` -There will be some popups from regedit asking for administrator permission to edit the registry (press Yes), warning about adding registry keys from AddPrivateTesting.reg (press Yes) and that the edit was successful (press OK). +#### Linux x64 Example Script -On Linux/MacOS: ``` -~/diagnostics$ ./test.sh --privatebuildpath /home/user/runtime/artifacts/bin/coreclr/Linux.x64.Debug +cp -v $HOME/runtime/artifacts/bin/coreclr/linux.x64.Release/sharedFramework/* $HOME/diagnostics/.dotnet-test/shared/Microsoft.NETCore.App/9.0.0-preview.7.24366.18 +cp -v $HOME/runtime/artifacts/bin/coreclr/linux.x64.Release/System.Private.CoreLib.dll $HOME/diagnostics/.dotnet-test/shared/Microsoft.NETCore.App/9.0.0-preview.7.24366.18 + +cp -v $HOME/runtime/artifacts/bin/coreclr/linux.x64.Release/sharedFramework/* $HOME/diagnostics/.dotnet-test/shared/Microsoft.NETCore.App/9.0.0-preview.7.24365.2 +cp -v $HOME/runtime/artifacts/bin/coreclr/linux.x64.Release/System.Private.CoreLib.dll $HOME/diagnostics/.dotnet-test/shared/Microsoft.NETCore.App/9.0.0-preview.7.24365.2 + +cp -v $HOME/runtime/artifacts/bin/coreclr/linux.x64.Release/sharedFramework/* $HOME/diagnostics/.dotnet-test/shared/Microsoft.NETCore.App/9.0.0-preview.4.24251.3 +cp -v $HOME/runtime/artifacts/bin/coreclr/linux.x64.Release/System.Private.CoreLib.dll $HOME/diagnostics/.dotnet-test/shared/Microsoft.NETCore.App/9.0.0-preview.4.24251.3 ``` -The private runtime will be copied to the diagnostics repo and the tests started. It can be just the runtime binaries but this assumes that the private build is close to the latest published main build. If not, you can pass the runtime's testhost directory containing all the shared runtime bits i.e. `c:\runtime\artifacts\bin\coreclr\testhost\netcoreapp5.0-Windows_NT-Debug-x64\shared\Microsoft.NETCore.App\5.0.0` or `/home/user/runtime/artifacts/bin/coreclr/testhost/netcoreapp5.0-Linux-Release-x64/shared/Microsoft.NETCore.App/5.0.0` On Linux/MacOS it is recommended to test against Release runtime builds because of a benign assert in DAC (tracked by issue #[31897](https://github.com/dotnet/runtime/issues/31897)) that causes the tests to fail. -On Windows the DAC is not properly signed for a private runtime build so there are a couple of registry keys that need to be added so Windows will load the DAC and the tests can create proper mini-dumps. An example of the registry key values added are: +#### Note for Windows 10 + +Because the DAC is not properly signed for a private runtime build there are a couple of registry keys that need to be added so Windows will load the DAC and the tests can create proper mini-dumps. An example of the registry key values added are: ``` [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\CurrentVersion\KnownManagedDebuggingDlls] diff --git a/eng/GalleryManifest.xml b/eng/GalleryManifest.xml deleted file mode 100644 index cfa84037b..000000000 --- a/eng/GalleryManifest.xml +++ /dev/null @@ -1,40 +0,0 @@ - - - SOS - X.X.X.X - Debugging aid for .NET Core programs and runtimes - - - - - - - - - - - - - - - - !clrstack - Provides a stack trace of managed code only - - - - - !clrthreads - List the managed threads running - - - - - !soshelp - Displays all available SOS commands or details about the command - - - - - - diff --git a/eng/InstallRuntimes.proj b/eng/InstallRuntimes.proj index 9238b5ac4..c1f1f884b 100644 --- a/eng/InstallRuntimes.proj +++ b/eng/InstallRuntimes.proj @@ -7,6 +7,7 @@ $(MicrosoftDotnetSdkInternalVersion) - .NET SDK to use for testing $(InternalReleaseTesting) - if true, internal service release testing + $(PrivateBuildTesting) - if true, test against a locally built runtime @(RuntimeTestVersions) - runtime/aspnetcore versions to install and test against From Arcade: @@ -35,9 +36,6 @@ -NoPath -SkipNonVersionedFiles -Architecture $(BuildArch) -InstallDir $(DotNetInstallRoot) $([MSBuild]::NormalizeDirectory('$(DotNetInstallRoot)', 'shared', 'Microsoft.NETCore.App', '$(MicrosoftNETCoreAppRuntimewinx64Version)')) $(DotNetInstallRoot)Debugger.Tests.Versions.txt - $(DotNetInstallRoot)AddPrivateTesting.reg - $(DotNetInstallRoot)RemovePrivateTesting.reg - regedit.exe @@ -113,6 +111,7 @@ $(InternalReleaseTesting) + $(PrivateBuildTesting) ]]> @@ -147,7 +146,7 @@ --> + Condition="$(InternalReleaseTesting) or $(PrivateBuildTesting)"> diff --git a/eng/Versions.props b/eng/Versions.props index 0e442b413..f2311ffec 100644 --- a/eng/Versions.props +++ b/eng/Versions.props @@ -104,11 +104,12 @@ default + false false true -runtimesourcefeed '$(RuntimeSourceFeed)' -runtimesourcefeedkey '$(RuntimeSourceFeedKey)' - + $(VSRedistCommonNetCoreSharedFrameworkx6490Version) $(MicrosoftNETCoreAppRuntimewinx64Version) @@ -138,6 +139,16 @@ net6.0 + + + + $(VSRedistCommonNetCoreSharedFrameworkx6490Version) + $(MicrosoftNETCoreAppRuntimewinx64Version) + $(MicrosoftAspNetCoreAppRefInternalVersion) + $(MicrosoftAspNetCoreAppRefVersion) + net9.0 + + diff --git a/eng/build.ps1 b/eng/build.ps1 index 3c8b222ed..72886ed02 100644 --- a/eng/build.ps1 +++ b/eng/build.ps1 @@ -4,6 +4,8 @@ Param( [ValidateSet("Debug","Release")][string][Alias('c')] $configuration = "Debug", [string][Alias('v')] $verbosity = "minimal", [switch][Alias('t')] $test, + [switch] $installruntimes, + [switch] $privatebuild, [switch] $ci, [switch] $skipmanaged, [switch] $skipnative, @@ -65,6 +67,22 @@ if (-not $skipnative) { } } +if ($installruntimes -or $privatebuild) { + $privatebuildtesting = "false" + if ($privatebuild) { + $privatebuildtesting = "true" + } + Remove-Item -Force -Recurse -ErrorAction SilentlyContinue "$reporoot\.dotnet-test" + & "$engroot\common\msbuild.ps1" ` + $engroot\InstallRuntimes.proj ` + -verbosity $verbosity ` + /t:InstallTestRuntimes ` + /bl:$logdir\InstallRuntimes.binlog ` + /p:PrivateBuildTesting=$privatebuildtesting ` + /p:BuildArch=$architecture ` + /p:TestArchitectures=$architecture +} + # Run the xunit tests if ($test) { if (-not $crossbuild) { diff --git a/eng/build.sh b/eng/build.sh index 02a1ebcc1..4c9a427c6 100755 --- a/eng/build.sh +++ b/eng/build.sh @@ -26,6 +26,8 @@ __RuntimeSourceFeed= __RuntimeSourceFeedKey= __SkipConfigure=0 __SkipGenerateVersion=0 +__InstallRuntimes=0 +__PrivateBuild=0 __Test=0 __UnprocessedBuildArgs= @@ -85,6 +87,14 @@ handle_arguments() { __NativeBuild=0 ;; + installruntimes|-installruntimes) + __InstallRuntimes=1 + ;; + + privatebuild|-privatebuild) + __PrivateBuild=1 + ;; + test|-test) __Test=1 ;; @@ -224,6 +234,25 @@ if [[ "$__NativeBuild" == 1 || "$__Test" == 1 ]]; then echo "Copied SOS to $__dotnet_dump" fi +# +# Install test runtimes and set up for private runtime build +# + +if [[ "$__InstallRuntimes" == 1 || "$__PrivateBuild" == 1 ]]; then + __privateBuildTesting=false + if [[ "$__PrivateBuild" == 1 ]]; then + __privateBuildTesting=true + fi + rm -fr "$__RepoRootDir/.dotnet-test" || true + "$__RepoRootDir/eng/common/msbuild.sh" \ + $__RepoRootDir/eng/InstallRuntimes.proj \ + /t:InstallTestRuntimes \ + /bl:"$__LogsDir/InstallRuntimes.binlog" \ + /p:PrivateBuildTesting="$__privateBuildTesting" \ + /p:BuildArch="$__TargetArch" \ + /p:TestArchitectures="$__TargetArch" +fi + # # Run xunit tests # diff --git a/eng/empty.csproj b/eng/empty.csproj deleted file mode 100644 index 23ebe5a90..000000000 --- a/eng/empty.csproj +++ /dev/null @@ -1,17 +0,0 @@ - - - - - - net6.0 - - - - - diff --git a/eng/installruntimes.cmd b/eng/installruntimes.cmd new file mode 100644 index 000000000..b3347a8ee --- /dev/null +++ b/eng/installruntimes.cmd @@ -0,0 +1,3 @@ +@echo off +powershell -ExecutionPolicy ByPass -NoProfile -command "& """%~dp0build.ps1""" -installruntimes -skipmanaged -skipnative %*" +exit /b %ErrorLevel% diff --git a/eng/installruntimes.sh b/eng/installruntimes.sh new file mode 100755 index 000000000..fee153f50 --- /dev/null +++ b/eng/installruntimes.sh @@ -0,0 +1,17 @@ +#!/usr/bin/env bash + +source="${BASH_SOURCE[0]}" + +# resolve $SOURCE until the file is no longer a symlink +while [[ -h $source ]]; do + scriptroot="$( cd -P "$( dirname "$source" )" && pwd )" + source="$(readlink "$source")" + + # if $source was a relative symlink, we need to resolve it relative to the path where the + # symlink file was located + [[ $source != /* ]] && source="$scriptroot/$source" +done + +scriptroot="$( cd -P "$( dirname "$source" )" && pwd )" +"$scriptroot/../eng/build.sh" -installruntimes -skipmanaged -skipnative $@ + diff --git a/eng/privatebuild.cmd b/eng/privatebuild.cmd new file mode 100644 index 000000000..e70e07373 --- /dev/null +++ b/eng/privatebuild.cmd @@ -0,0 +1,3 @@ +@echo off +powershell -ExecutionPolicy ByPass -NoProfile -command "& """%~dp0build.ps1""" -privatebuild -skipmanaged -skipnative %*" +exit /b %ErrorLevel% diff --git a/eng/privatebuild.sh b/eng/privatebuild.sh new file mode 100755 index 000000000..61b77e763 --- /dev/null +++ b/eng/privatebuild.sh @@ -0,0 +1,16 @@ +#!/usr/bin/env bash + +source="${BASH_SOURCE[0]}" + +# resolve $SOURCE until the file is no longer a symlink +while [[ -h $source ]]; do + scriptroot="$( cd -P "$( dirname "$source" )" && pwd )" + source="$(readlink "$source")" + + # if $source was a relative symlink, we need to resolve it relative to the path where the + # symlink file was located + [[ $source != /* ]] && source="$scriptroot/$source" +done + +scriptroot="$( cd -P "$( dirname "$source" )" && pwd )" +"$scriptroot/../eng/build.sh" -privatebuild -skipmanaged -skipnative $@ diff --git a/eng/testsos.cmd b/eng/testsos.cmd new file mode 100644 index 000000000..949e58353 --- /dev/null +++ b/eng/testsos.cmd @@ -0,0 +1 @@ +%~dp0..\.dotnet\dotnet.exe test --no-build --logger "console;verbosity=detailed" %~dp0..\src\SOS\SOS.UnitTests\SOS.UnitTests.csproj diff --git a/eng/testsos.sh b/eng/testsos.sh new file mode 100755 index 000000000..273455e2f --- /dev/null +++ b/eng/testsos.sh @@ -0,0 +1,17 @@ +#!/usr/bin/env bash + +source="${BASH_SOURCE[0]}" + +# resolve $SOURCE until the file is no longer a symlink +while [[ -h $source ]]; do + scriptroot="$( cd -P "$( dirname "$source" )" && pwd )" + source="$(readlink "$source")" + + # if $source was a relative symlink, we need to resolve it relative to the path where the + # symlink file was located + [[ $source != /* ]] && source="$scriptroot/$source" +done + +scriptroot="$( cd -P "$( dirname "$source" )" && pwd )" +export LLDB_PATH=/usr/bin/lldb +$scriptroot/../.dotnet/dotnet test --no-build --logger "console;verbosity=detailed" $scriptroot/../src/SOS/SOS.UnitTests/SOS.UnitTests.csproj diff --git a/src/Microsoft.Diagnostics.TestHelpers/TestConfiguration.cs b/src/Microsoft.Diagnostics.TestHelpers/TestConfiguration.cs index 49a54bf27..c499bac11 100644 --- a/src/Microsoft.Diagnostics.TestHelpers/TestConfiguration.cs +++ b/src/Microsoft.Diagnostics.TestHelpers/TestConfiguration.cs @@ -382,6 +382,8 @@ namespace Microsoft.Diagnostics.TestHelpers private const string DebugTypeKey = "DebugType"; private const string DebuggeeBuildRootKey = "DebuggeeBuildRoot"; + public static TestConfiguration Empty { get; } = new TestConfiguration(); + public static string BaseDir { get; set; } = Path.GetFullPath("."); private static readonly Regex versionRegex = new(@"^(\d+\.\d+\.\d+)(-.*)?", RegexOptions.Compiled); @@ -486,10 +488,9 @@ namespace Microsoft.Diagnostics.TestHelpers } } - public IReadOnlyDictionary AllSettings - { - get { return _settings; } - } + public bool IsEmpty => _settings.Count == 0; + + public IReadOnlyDictionary AllSettings => _settings; /// /// Creates a new test config with the new PDB type (full, portable or embedded) diff --git a/src/SOS/SOS.UnitTests/ConfigFiles/Unix/Debugger.Tests.Config.txt b/src/SOS/SOS.UnitTests/ConfigFiles/Unix/Debugger.Tests.Config.txt index 7b9f3d7ee..c45a887ec 100644 --- a/src/SOS/SOS.UnitTests/ConfigFiles/Unix/Debugger.Tests.Config.txt +++ b/src/SOS/SOS.UnitTests/ConfigFiles/Unix/Debugger.Tests.Config.txt @@ -27,6 +27,9 @@ true false + true + false + $(RepoRootDir)/src/SOS/SOS.UnitTests/Debuggees $(RepoRootDir)/eng/AuxMsbuildFiles sdk.prebuilt @@ -43,33 +46,37 @@ - - - - - - - - diff --git a/src/SOS/SOS.UnitTests/SOS.cs b/src/SOS/SOS.UnitTests/SOS.cs index d7e8f6eb5..c665bad6e 100644 --- a/src/SOS/SOS.UnitTests/SOS.cs +++ b/src/SOS/SOS.UnitTests/SOS.cs @@ -21,7 +21,7 @@ public static class SOSTestHelpers { public static IEnumerable GetConfigurations(string key, string value) { - return TestRunConfiguration.Instance.Configurations.Where((c) => key == null || c.AllSettings.GetValueOrDefault(key) == value).Select(c => new[] { c }); + return TestRunConfiguration.Instance.Configurations.Where((c) => key == null || c.AllSettings.GetValueOrDefault(key) == value).DefaultIfEmpty(TestConfiguration.Empty).Select(c => new[] { c }); } internal static void SkipIfArm(TestConfiguration config) @@ -397,12 +397,18 @@ public class SOS UsePipeSync = true, DumpGenerator = SOSRunner.DumpGenerator.DotNetDump }, - Output); + Output); } [SkippableTheory, MemberData(nameof(SOSTestHelpers.GetConfigurations), "TestName", "SOS.DualRuntimes", MemberType = typeof(SOSTestHelpers))] public async Task DualRuntimes(TestConfiguration config) { + // This test on linux/macOS can be called with an empty config because vstest and dotnet test fail/complain about no test parameters. The + // linux/macOS config file doesn't contain a SOS.DualRuntimes TestName because this is Windows only. + if (config.IsEmpty) + { + throw new SkipTestException("Skipping DualRuntimes test"); + } if (config.PublishSingleFile) { throw new SkipTestException("Single file not supported"); diff --git a/src/SOS/SOS.UnitTests/Scripts/GCTests.script b/src/SOS/SOS.UnitTests/Scripts/GCTests.script index a1b172dff..acd1cdefc 100644 --- a/src/SOS/SOS.UnitTests/Scripts/GCTests.script +++ b/src/SOS/SOS.UnitTests/Scripts/GCTests.script @@ -53,7 +53,7 @@ VERIFY:\s+\s+\s+GCWhere\.Main\(\)\s+ SOSCOMMAND:DumpObj VERIFY:\s*Name:\s+GCWhere\s+ VERIFY:\s+MethodTable:\s+\s+ -VERIFY:\s+EEClass:\s+\s+ +VERIFY:\s+(EEClass|Canonical MethodTable):\s+\s+ VERIFY:\s+Fields:\s+ VERIFY:\s+\s+\s+\s+System\.String.*_string\s+ VERIFY:\s+\s+\s+\s+System\.UInt64.*52704621242434 _static\s+ @@ -61,12 +61,12 @@ VERIFY:\s+\s+\s+\s+System\.UInt64.*52704621242434 _stati SOSCOMMAND:DumpObj -nofields VERIFY:\s*Name:\s+GCWhere\s+ VERIFY:\s+MethodTable:\s+\s+ -VERIFY:\s+EEClass:\s+\s+ +VERIFY:\s+(EEClass|Canonical MethodTable):\s+\s+ SOSCOMMAND:DumpObj -refs VERIFY:\s*Name:\s+GCWhere\s+ VERIFY:\s+MethodTable:\s+\s+ -VERIFY:\s+EEClass:\s+\s+ +VERIFY:\s+(EEClass|Canonical MethodTable):\s+\s+ VERIFY:\s+Fields:\s+ VERIFY:\s+\s+\s+\s+System\.String.*_string\s+ VERIFY:\s+\s+\s+\s+System\.UInt64.*52704621242434 _static\s+ @@ -133,7 +133,7 @@ VERIFY:\s+\s+\s+GCWhere\.Main\(\)\s+ SOSCOMMAND:DumpObj VERIFY:\s*Name:\s+GCWhere\s+ VERIFY:\s+MethodTable:\s+\s+ -VERIFY:\s+EEClass:\s+\s+ +VERIFY:\s+(EEClass|Canonical MethodTable):\s+\s+ VERIFY:\s+Fields:\s+ VERIFY:\s+\s+\s+\s+System\.String.*_string\s+ VERIFY:\s+\s+\s+\s+System\.UInt64.*52704621242434 _static\s+ @@ -141,12 +141,12 @@ VERIFY:\s+\s+\s+\s+System\.UInt64.*52704621242434 _stati SOSCOMMAND:DumpObj -nofields VERIFY:\s*Name:\s+GCWhere\s+ VERIFY:\s+MethodTable:\s+\s+ -VERIFY:\s+EEClass:\s+\s+ +VERIFY:\s+(EEClass|Canonical MethodTable):\s+\s+ SOSCOMMAND:DumpObj -refs VERIFY:\s*Name:\s+GCWhere\s+ VERIFY:\s+MethodTable:\s+\s+ -VERIFY:\s+EEClass:\s+\s+ +VERIFY:\s+(EEClass|Canonical MethodTable):\s+\s+ VERIFY:\s+Fields:\s+ VERIFY:\s+\s+\s+\s+System\.String.*_string\s+ VERIFY:\s+\s+\s+\s+System\.UInt64.*52704621242434 _static\s+