Sung Yoon Whang [Mon, 22 Feb 2021 17:28:45 +0000 (09:28 -0800)]
Fix ThreadPool events validation test (#48588)
* Fix ThreadPool events validation test
* space
Sven Boemer [Mon, 22 Feb 2021 17:22:39 +0000 (09:22 -0800)]
Remove unaligned offsets for mapped layout (#42464)
* Remove unaligned offsets for mapped layout
* Assert on windows only
- Unix will use the mapped layout with an offset for bundled assemblies
- Windows still should't create a mapped layout for bundles
dotnet-maestro[bot] [Mon, 22 Feb 2021 17:12:32 +0000 (18:12 +0100)]
[master] Update dependencies from mono/linker (#48597)
Microsoft.NET.ILLink.Tasks
From Version 6.0.100-preview.2.21118.4 -> To Version 6.0.100-preview.2.21122.1
Co-authored-by: dotnet-maestro[bot] <dotnet-maestro[bot]@users.noreply.github.com>
Viktor Hofer [Mon, 22 Feb 2021 16:54:36 +0000 (17:54 +0100)]
Delete publish-final.proj and clean-up installer.tasks unused files (#48598)
* Delete publish-final.proj and delete unused installer.tasks files
* Avoid extra restore phase for tasks
The repo local tasks don't participate in the repo restore anymore,
hence avoiding the extra restore phase which should improve reliability
and build times.
Viktor Hofer [Mon, 22 Feb 2021 15:53:49 +0000 (16:53 +0100)]
Delete updateversions.proj (#48593)
dead code
Eric Mutta [Mon, 22 Feb 2021 13:54:03 +0000 (16:54 +0300)]
Fix doc comment typo in JsonSerializerOptions.cs (#48590)
The following sentence in the doc comments for the `IgnoreReadOnlyFields` member:
> A property is read-only if it isn't marked with the <c>readonly</c> keyword.
Should read:
> A field is read-only if it is marked with the <c>readonly</c> keyword.
Eric Mutta [Mon, 22 Feb 2021 13:52:10 +0000 (16:52 +0300)]
Fix another doc comment typo in JsonSerializerOptions.cs (#48591)
* Fix another doc comment typo in JsonSerializerOptions.cs
The following sentence in the doc comments for the `IncludeFields` member:
> Determines whether fields are handled serialization and deserialization.
Should read:
> Determines whether fields are handled **during** serialization and deserialization.
* Update src/libraries/System.Text.Json/src/System/Text/Json/Serialization/JsonSerializerOptions.cs
Co-authored-by: Eirik Tsarpalis <eirik.tsarpalis@gmail.com>
Dixin [Mon, 22 Feb 2021 13:43:14 +0000 (05:43 -0800)]
Add LINQ APIs for Index and Range (#28776) (#48559)
* Implement dotnet/runtime#28776: Implement LINQ APIs for index and range.
* Implement dotnet#28776: Implement LINQ APIs for index and range.
* Implement dotnet#28776: LINQ APIs for index and range.
* Implement dotnet#28776: LINQ APIs for index and range.
* Implement dotnet#28776: LINQ APIs for index and range.
* Implement dotnet#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range. Code review update.
* Implement dotnet/runtime#28776: LINQ APIs for index and range. Code review update.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range. Code review update.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range.
* Implement dotnet/runtime#28776: LINQ APIs for index and range. Update ElementAt, keep the original behavior.
* Implement dotnet#28776: LINQ APIs for index and range. Update ElementAt, keep the original behavior.
* Implement dotnet/runtime#28776: LINQ APIs for index and range. Update ElementAt, keep the original behavior.
* Implement dotnet/runtime#28776: LINQ APIs for index and range. Add unit tests for ElementAt, ElementAtOrDefault.
* Implement dotnet/runtime#28776: LINQ APIs for index and range. Update unit tests.
* Implement dotnet/runtime#28776: LINQ APIs for index and range. Update unit tests.
* Implement dotnet/runtime#28776: LINQ APIs for index and range. Update unit tests.
* Implement dotnet/runtime#28776: LINQ APIs for index and range. Update for merge.
* Implement #28776: LINQ APIs for index and range. Update unit tests.
Vlad Brezae [Mon, 22 Feb 2021 13:34:08 +0000 (15:34 +0200)]
[interp] Inline more AggressiveInlining methods (#48513)
* [interp] Inline more AggressiveInlining methods
By default, the interpreter stops inlining when encountering a call that it cannot inline or a throw. Inline the method anyway if the aggressive inlining attribute is present.
* [interp] Fix some long conditional branch opcodes
Viktor Hofer [Mon, 22 Feb 2021 11:49:14 +0000 (12:49 +0100)]
Delete unused installer properties (#48569)
* Delete unused msbuild properties, targets and files
Dan Moseley [Mon, 22 Feb 2021 01:25:21 +0000 (17:25 -0800)]
Improve S.DS.P tests, fix async API, and improve error messages (#47703)
Geoff Kizer [Mon, 22 Feb 2021 00:17:48 +0000 (16:17 -0800)]
Simplify connection usability logic (#48446)
* simplify connection usability logic
Co-authored-by: Geoffrey Kizer <geoffrek@windows.microsoft.com>
Andy Ayers [Sun, 21 Feb 2021 23:32:34 +0000 (15:32 -0800)]
JIT: remove JitGuardedDevirtualizationGuessBestClass (#48574)
And slightly rearrange the two bits of code that consider guarded
devirualization with the goal of eventually unifying them.
Fixes #48564.
Anirudh Agnihotry [Sun, 21 Feb 2021 21:47:14 +0000 (13:47 -0800)]
Add disabling test policy to the docs (#48575)
* add disabling test policy
* Update docs/infra/buildtriage.md
Co-authored-by: Dan Moseley <danmose@microsoft.com>
Badre BSAILA [Sun, 21 Feb 2021 21:45:59 +0000 (22:45 +0100)]
Fix #28035 Refactor DLL imports interop classes (#48556)
* refactor interop classes
* move interop files to subdirectory
Tomáš Rylek [Sun, 21 Feb 2021 21:05:37 +0000 (22:05 +0100)]
Enable CG2 determinism tests on all architectures (#48526)
I have noticed that these two tests are still conditionally
executed on x64 only. I don't see why they shouldn't work on
other architectures.
Thanks
Tomas
Anirudh Agnihotry [Sun, 21 Feb 2021 19:00:48 +0000 (11:00 -0800)]
update branding to preview3 (#48530)
Adeel Mujahid [Sun, 21 Feb 2021 12:06:16 +0000 (14:06 +0200)]
Reuse SDK target for latest commit hash (#48561)
* Reuse SDK target for latest commit hash
Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
* Further clean-up corehost.proj
Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
Bruce Forstall [Sat, 20 Feb 2021 21:56:50 +0000 (11:56 -1000)]
Add assembly name to SuperPMI collection (#48534)
* Add assembly name to SuperPMI collection
For each class, add JIT/EE calls to getAssemblyName so the SuperPMI
collections contain this information. This can be useful to try and track
down where a particular function in a large method context hive came
from.
Only do this when `COMPlus_EnableExtraSuperPmiQueries=1` is set.
* Formatting
Mike McLaughlin [Sat, 20 Feb 2021 21:51:39 +0000 (13:51 -0800)]
Enable Hot Reload API on Linux (#48497)
Enable Hot Reload API on Linux
Only define EnC_SUPPORTED for vm/ee on xplat. Doesn't enable the ENC ICorDebug API.
Enable hotreload api tests on Linux/MacOS. API not implemented on arm/arm64
Remove all the ENC_DELTA_HACK code. Remove more ENC_DELTA_HACK code from ilasm
Aleksey Kliger (λgeek) [Sat, 20 Feb 2021 20:26:30 +0000 (15:26 -0500)]
[mono] Remove MonoRuntimeUnhandledExceptionPolicy (#48555)
policy was always set to MONO_UNHANDLED_POLICY_CURRENT. The
legacy (pre-.NET 2.0) policy was not used.
Andy Ayers [Sat, 20 Feb 2021 17:17:32 +0000 (09:17 -0800)]
JIT: workaround for unreliable change detection in fgReorderBlocks (#48516)
This method costs trees, which can in turn modify the IR by swapping operands.
As a result the bool value returned doesn't properly reflect whether any
changes happened.
This impacts proper reporting phase status by `optOptimizeLayout'. Since phase
status just gates post-phase dumps and checks, we'll just claim this phase
always modifies IR.
Add similar workaround for `optInvertLoops`.
Fixes #48494.
Fixes #48495.
Adeel Mujahid [Sat, 20 Feb 2021 16:34:53 +0000 (18:34 +0200)]
Fix JIT rolling build (#48552)
Viktor Hofer [Sat, 20 Feb 2021 12:18:35 +0000 (13:18 +0100)]
Update hardcoded rids for targeting/runtime pks (#48459)
* Update hardcoded rids for targeting/runtime pks
Next Turn [Sat, 20 Feb 2021 05:07:06 +0000 (13:07 +0800)]
Format (#48548)
Vladimir Sadov [Sat, 20 Feb 2021 04:40:14 +0000 (20:40 -0800)]
Building singlefilehost with clr partition. (#48254)
* building single file host with clr partition
* make coreclr_static a STATIC lib again
Aleksey Kliger (λgeek) [Fri, 19 Feb 2021 20:11:03 +0000 (15:11 -0500)]
[mono] Implement public hot reload API (#48380)
* [mono] Implement public hot reload API
Also add ApplyUpdateSdb that takes byte[] arguments for use with
mono/debugger-libs as its awkward to call a ROS<byte> method from the debugger.
Contributes to https://github.com/dotnet/runtime/issues/45689
* Update src/mono/System.Private.CoreLib/src/System/Reflection/Metadata/AssemblyExtensions.cs
Co-authored-by: Marek Safar <marek.safar@gmail.com>
* Don't allow changes to System.Private.CoreLib
* formatting
* more formatting
* Add a TODO to remove ApplyUpdateSdb
* update DeltaHelper
* don't use ApplyUpdateSdb in DeltaHelper
* throw InvalidOpertionException for corlib changes with hot reload disabled
* Run the test on mono on all platoforms; CoreCLR windows only
* Use resource string
* Address review feedback
Co-authored-by: Marek Safar <marek.safar@gmail.com>
Matt Galbraith [Fri, 19 Feb 2021 20:09:10 +0000 (12:09 -0800)]
Temporarily work around publishing issues with disk space (#48521)
Drew Scoggins [Fri, 19 Feb 2021 19:08:57 +0000 (11:08 -0800)]
Wasm download fix (#48514)
* Don't use container for WASM
* Remove dashes
* Remove comments for testing
Dan Moseley [Fri, 19 Feb 2021 18:59:19 +0000 (10:59 -0800)]
Disable TestOnExecuteCustomCommand() for WSC (#48501)
Stephen Toub [Fri, 19 Feb 2021 18:38:31 +0000 (13:38 -0500)]
Remove StringBuilderCache from Version.ToString (#48511)
Rather than using a StringBuilder in both ToString and TryFormat, we can just write ToString in terms of TryFormat and use stack space for the small string being generated. As part of this, I removed the extra code optimizing ToString(0) and ToString(1), as I can't find any real code anywhere that does that and it's not worth the extra lines.
Egor Bogatov [Fri, 19 Feb 2021 18:00:28 +0000 (21:00 +0300)]
Fix EqualityComparer<T>.Default for nullable (#48161)
Alex Covington [Fri, 19 Feb 2021 17:55:18 +0000 (09:55 -0800)]
No const arg to temp (#48308)
* Starting to add IsInvariant helper
* Finished IsInvariant helper. Starting testing
* Removed IsInvariant from GenTree to avoid asserts
* Formatting
* Fixed missing not operator
* Changed AsOp() call to 'this' to avoid failing assertions
* Formatting
* Update src/coreclr/jit/morph.cpp
Co-authored-by: Sergey Andreenko <seandree@microsoft.com>
* Update src/coreclr/jit/compiler.h
Co-authored-by: Sergey Andreenko <seandree@microsoft.com>
* Apply suggestions from code review
Co-authored-by: Sergey Andreenko <seandree@microsoft.com>
* Change arguments to const to avoid cast
* Formatting
* delete `IsInvariant` from Compiler.
Co-authored-by: Sergey Andreenko <seandree@microsoft.com>
Marek Safar [Fri, 19 Feb 2021 17:46:58 +0000 (18:46 +0100)]
Don't build Quic for platforms where it's not supported (#48480)
Sven Boemer [Fri, 19 Feb 2021 17:27:41 +0000 (09:27 -0800)]
Annotate framework assemblies as trimmable (#48428)
* Annotate framework assemblies as trimmable
This will opt them into trimming with the behavior described at https://github.com/mono/linker/blob/main/docs/design/trimmed-assemblies.md#assemblymetadataistrimmable-true.
* Add a condition to let projects opt out
A project just needs to set <SetIsTrimmable>false</SetIsTrimmable>, and
it won't get the trimmable metadata.
I also got rid of the SkipFrameworkAssemblyMetadata check since I don't
think the IsTrimmable metadata should be tied to whether we are building
a framework assembly, and this property was unused as far as I could tell.
Anton Firszov [Fri, 19 Feb 2021 16:37:05 +0000 (17:37 +0100)]
Fix Socket.SendFile test: SliceBuffers_Success (#48457)
* do not expect a single receive
* use expected.Length
* enable test
Eric Erhardt [Fri, 19 Feb 2021 15:10:48 +0000 (09:10 -0600)]
Remove trimming attributes from any assembly. (#48424)
* Remove trimming attributes from any assembly.
These attributes are allowed to be in any assembly, for assemblies that are built using older TFMs where the attributes didn't exist.
Fix #48399
* Remove nullable attributes as well.
Nathan Ricci [Fri, 19 Feb 2021 14:41:27 +0000 (09:41 -0500)]
Normalized names SIMD_OP_LLVM_* -> SIMD_OP_ARM64_* (#48489)
Co-authored-by: Nathan Ricci <naricc@xam-emag-01.redmond.corp.microsoft.com>
dotnet-maestro[bot] [Fri, 19 Feb 2021 10:51:53 +0000 (10:51 +0000)]
[master] Update dependencies from dotnet/xharness (#48452)
[master] Update dependencies from dotnet/xharness
Eirik Tsarpalis [Fri, 19 Feb 2021 10:02:52 +0000 (10:02 +0000)]
Expand PriorityQueue test coverage (#48420)
* make comparer field readonly
* abstract IComparer in PriorityQueue generic tests
does minor refactorings and adds new tests
* add PriorityQueue property tests
* address feedback
* add seed for deterministic runs
* apply var fixes in property tests
* replace FsCheck properties with theories
David Karlaš [Fri, 19 Feb 2021 09:24:33 +0000 (10:24 +0100)]
Removing myself from codeowners file (#48502)
In past I was involved in mono/debugger-agent.c, but not anymore, hence removing myself from CODEOWNERS file
Vlad Brezae [Fri, 19 Feb 2021 09:07:44 +0000 (11:07 +0200)]
[interp] Small interp tweaks (#48412)
* [interp] Fix overflow in PROFILE_INTERP log
* [interp] Replace LDFLDA of offset 0 field with MOV
Commonly used when accessing first field of valuetypes, eg span operations. Will help with cprop and remove redundant instruction.
* [interp] Remove redundant opcode
Marek Safar [Fri, 19 Feb 2021 08:51:54 +0000 (09:51 +0100)]
Remove redundant static ctor from LoggerFactory (#48478)
dotnet-maestro[bot] [Fri, 19 Feb 2021 05:04:51 +0000 (05:04 +0000)]
Update dependencies from https://github.com/mono/linker build
20210218.4 (#48493)
[master] Update dependencies from mono/linker
Elinor Fung [Fri, 19 Feb 2021 04:57:25 +0000 (20:57 -0800)]
Make ApkBuilder optionally generate debuggable apk (#48486)
Zoltan Varga [Fri, 19 Feb 2021 04:13:58 +0000 (23:13 -0500)]
[mono] More domain cleanups. (#48291)
* Remove the MonoClassRuntimeInfo structure, store the runtime vtable directly in MonoClass.
* Remove the 'domain' argument from mono_class_vtable_checked ().
* Remove the 'domain' argument from the object allocation functions.
* Remove the 'domain' argument from the m_.._alloc methods.
* Revert accidental changes.
* Remove more unused 'domain' parameters.
* Remove more remoting code.
* Remove shared code support.
* Remove the 'domain' argument from the IMT builder functions.
* Remove the 'domain' argument from the m_method_ functions.
* Remove more domain usage from the JIT backends.
* Remove the MONO_ARCH_HAVE_PATCH_CODE_NEW ifdef, all architectures support it now.
* Remove 'domain' argument from mini_jit_info_table_find ().
* Remove 'domain' argument from mono_arch_unwind_frame ().
* Remove unused/unfinished AOT cache code.
* Remove the 'domain' argument from mono_resolve_patch_target ().
* Remove domains from the stack walk/exception handling code.
* Remove domains from mono-debug.c.
The memory in mono-debug.c is now owned by a MonoMemoryManager instead of by a domain.
* Remove unused mono-mlist.{h,c}.
* Fix the coverage profiler build.
* Fix the build.
daveMueller [Fri, 19 Feb 2021 03:35:00 +0000 (04:35 +0100)]
JSON Console Logger not requiring scopes to implement IReadOnlyCollection (#48453)
Ankit Jain [Fri, 19 Feb 2021 02:40:41 +0000 (21:40 -0500)]
[wasm] Improve AOT builds (#48184)
* [wasm] pack: Let the workload configure the runtime pack path
* [wasm] update webassembly pack description
* [wasm] Makefile: fix being able to `make build`
* [wasm] Fix AOT compilation to work before publish
Instead of using runtime pack, and other assemblies from the
publish folder, we are now using them directly from the source
location. This means that `System.Private.CoreLib` can be in a different
directory, than the assembly being precompiled.
So, we need to set `MONO_PATH` to the relevant paths that will have the assemblies.
This manifests during blazor workload based builds.
* [wasm][aot] Don't strip the source assemblies in place
Currently we run `mono-cil-strip` on assemblies, in the AOT case, but we
do that in-place.
This is problematic because the assemblies from the runtime pack will
get modified in their original location (nuget/etc), since we don't use
them from the publish folder anymore.
- This would mean that a subsequent attempt to build with AOT would fail
because now the original assemblies are already stripped!
- this also becomes apparent if you have the runtime pack installed in a
system dotnet folder, eg. as a pack - `/usr/local/share/dotnet/packs/Microsoft.NETCore.App.Runtime.browser-wasm/`,
because a regular user wouldn't have permissions to modify that.
Solution: Write the stripped assemblies into the obj dir
* [wasm] Make the final list of wasm assemblies as an item
- Blazor skips the generation of the app bundle when running
`WasmBuildApp` target.
- Because of the previous commit, the locations for the final assemblies
could be different (when aot+stripping), which needs to be surfaced
for blazor. So, generate a `@(WasmAssembliesFinal)` item for that.
* [wasm] Allow enabling assert messages with $(MonoEnableAssertMessages)
* [wasm][aot] WasmApp.targets: check that we have .bc file for each assembly
Just a sanity check to ensure that due to some build authoring error, we
are not building dotnet.js/wasm with no .bc files! That just shows up as
an assert:
`* Assertion at /Users/radical/dev/r3/src/mono/mono/mini/aot-runtime.c:2651, condition `<disabled>' not met`
.. which is:
`g_assert (info->version == MONO_AOT_FILE_VERSION);`
.. `0 != MONO_AOT_FILE_VERSION`
* [wasm] remove UsingTask for non-exitant WasmAOT
* MonoCrossAot pkg: use mono-aot-cross.exe on windows
* [wasm] Fix up emscripten command invocations for windows
* [wasm] WasmApp.targets: move some property inits closer to their use
* [wasm] fix build for browser-profile sample
* [wasm] fix emcc invocation for getting the version
* [wasm] Add new RunWithEmSdkEnv task
* [wasm] Use `RunWithEmSdkEnv` to run `emcc` commands
* [wasm] AotCompiler: use platform specific path separator
* [wasm] RunWithEmSdkEnv: quote path on windows
* [wasm] Use new ReadEmccVersion to get the versions
This simplifies the target too, and works on windows.
* Update src/installer/pkg/sfx/Microsoft.NETCore.App/Microsoft.NETCore.App.MonoCrossAOT.Sdk.props
Co-authored-by: Pranav K <prkrishn@hotmail.com>
* fix messageimportance for debug msg
* Fix emcc invocation on windows, thanks to @pranavkm
* Don't strip assemblies with mono-cil-strip for aotinterp mode
* [wasm] Remove ReadEmccVersion task, and use msbuild to get the version
.. string instead. We do this by looking for the line with `'emcc'` in
it, since the other lines are the license text. Hopefully, this isn't
too brittle, since we are invoking `emcc --version`.
* Fix emcc version extraction to not depend on a specific string
Co-authored-by: Pranav K <prkrishn@hotmail.com>
Egor Chesakov [Fri, 19 Feb 2021 02:27:07 +0000 (18:27 -0800)]
Do not emit Avx2 instruction `vpcmpeqd ymmReg, ymmReg, ymmReg` for `Vector256<T>.AllBitsSet` intrinsic when Avx2 is not supported (#48383)
Emit `vcmptrueps ymmReg, ymmReg, ymmReg` instead
Adeel Mujahid [Fri, 19 Feb 2021 01:41:07 +0000 (03:41 +0200)]
Probe libnuma.so.1.0.0 before its symlinks (#48133)
On Linux, libnuma.so{.1} are symlinks to libnuma.so.1.0.0.
When installed from default package manager; Ubuntu (libnuma-dev) and
Alpine (numactl-dev), found these two symlinks:
`{libnuma.so,libnuma.so.1} -> libnuma.so.1.0.0`
On Fedora (numactl-libs):
`libnuma.so.1 -> libnuma.so.1.0.0`
(there is no version-less variant)
PR adjusts probing fallback flow based on this info.
Kevin Jones [Fri, 19 Feb 2021 01:28:30 +0000 (20:28 -0500)]
Use newer microsoft.com certificate chain in X.509 tests
The old certificate chain used a root certificate that is deprecated
and is starting to disappear from some trust stores. The removal of
the root certificate led to a few failing tests, and other tests not
running since they were conditional on the trust of that certificate.
Drew Scoggins [Fri, 19 Feb 2021 00:47:58 +0000 (16:47 -0800)]
Add runs for Alpine performance measurement (#47304)
* WIP
* Add Alpine specific steps
* Fix musl string
* Fix musl string
* Add comment block
* Update Helix precommand for Alpine
* Add container support for Perf leg
* Remove dupe container
* Add apk installs
* Add libgdiplus
* Fix typo and remove --force-install from pip command
* Remove --force-reinstall from Alpine job
* Add pip upgrade step
* Add cargo install
* Add back full runs
* Remove PR line
* Remove temp files
* Fix spacing issue
Eric Erhardt [Thu, 18 Feb 2021 23:52:11 +0000 (17:52 -0600)]
Resolve ILLink warnings in System.Linq.Queryable (#48305)
* Resolve ILLink warnings in System.Linq.Queryable
Contributes to #45623
* Respond to PR feedback.
Annotate public AsQueryable() method as RequiresUnreferencedCode.
Mike McLaughlin [Thu, 18 Feb 2021 23:02:17 +0000 (15:02 -0800)]
Add hot reload apply changes API: AssemblyExtensions.ApplyUpdate (#48366)
Add hot reload apply changes API: AssemblyExtensions.ApplyUpdate
Issue: https://github.com/dotnet/runtime/issues/45689
Currently Windows only. Fail hot reload API if debugging.
Added some simple invalid parameter testing to the new ApplyUpdate API.
Sung Yoon Whang [Thu, 18 Feb 2021 22:38:43 +0000 (14:38 -0800)]
Fix AV in NativeRuntimeEventSource QCalls (#48414)
* Fix AV in NativeRuntimeEventSource QCalls
* Add test
* Use WriteEventCore APIs to emit events on Mono
* Separate out Mono/CoreCLR implementations to different files
* Fix wasm build
Stephen Toub [Thu, 18 Feb 2021 22:00:38 +0000 (17:00 -0500)]
Remove partitioning from CancellationTokenSource (#48251)
When CancellationTokenSource was original created, the expectation was that a majority use case would be lots of threads in parallel registering and unregistering handlers. This led to a design where CTS internally partitions its registrations to minimize contention between threads contending on its internal data structures. While that certainly comes up in practice, a much more common case is just one thread registering and unregistering at a time as a CancellationToken unique to a particular operation (e.g. a linked token source) is passed down through it, with various levels of the chain registering and unregistering from that non-concurrently-used token source. And having such partitioning results in non-trivial allocation overheads, in particular for a short-lived CTS with which only one or a few registrations are employed in its lifetime. This change removes that partitioning scheme; all scenarios end up with less memory allocation, and non-concurrent scenarios end up measurably faster... scenarios where there is contention do take a measurable hit, but given that's the rare case, it's believed to be the right trade-off (when in doubt, it's also the simpler implementation).
As long as I was refactoring a bunch of code, I fixed up a few other things along the way:
- Avoided allocating while holding the instance's spin lock
- Made WaitForCallbackAsync into a polling async method rather than an async-over-sync method
- Changed the state values to be 0-based to avoid needing to initialize _state to something other than 0 in the common case
- Used existing throw helpers in a few more cases
- Renamed a few methods, and made a few others to be local functions
Bruce Forstall [Thu, 18 Feb 2021 21:56:57 +0000 (11:56 -1000)]
Remove !CPU_HAS_FP_SUPPORT code (#48436)
* Remove !CPU_HAS_FP_SUPPORT code
CPU_HAS_FP_SUPPORT is always defined and we don't anticipate needing
the emulation support.
Fixes #47708
* Remove fgMorphToEmulatedFP declaration
Anirudh Agnihotry [Thu, 18 Feb 2021 21:54:06 +0000 (13:54 -0800)]
Disable slicebuffers_success and RunContinueWithStressTestsNoState test (#48442)
* disable long failing tests
* keeping the skipOncoreclr attribute
Anirudh Agnihotry [Thu, 18 Feb 2021 21:53:36 +0000 (13:53 -0800)]
make symbolsPath to default pack path (#48384)
Maxim Lipnin [Thu, 18 Feb 2021 20:53:18 +0000 (23:53 +0300)]
Fix test failures (#48302)
* Fix test failures
* Remove iOS/tvOS-specific platform detection
Andy Ayers [Thu, 18 Feb 2021 20:34:35 +0000 (12:34 -0800)]
JIT: change loop inversion edge weight updates and add phase (#48364)
Rename `fgOptWhileLoop` to `optInvertWhileLoop` (using terminology from
Muchnick). Split off this transformation into a new phase so it is easier
to see its impact. Make the block updates / reorderings that follow into
a proper phase as well.
Use the test block exit likelihoods to update the profile weights for the
edges involved in loop inversion. Because edge weight updates are now
consistent we no longer need to recompute edge weights afterwards.
Rename `optOptimizeLoops` to `optFindLoops` since it no longer optimizes.
Adeel Mujahid [Thu, 18 Feb 2021 20:34:00 +0000 (22:34 +0200)]
Use llvm-objcopy on Linux x64 (#48444)
Fan Yang [Thu, 18 Feb 2021 20:33:37 +0000 (15:33 -0500)]
Support remaining Sha1 intrinsics on Arm (#48413)
* Add support for Sha1 API with vector64 arguments
* Promote return to vector64
* Return a 2 x i32 instead of i64
* Update src/mono/mono/mini/mini-llvm.c
* Fix format
Co-authored-by: imhameed <imhameed@microsoft.com>
Jeremy Koritzinsky [Thu, 18 Feb 2021 20:15:23 +0000 (12:15 -0800)]
Fix all remaining System.Security.Cryptography.Algorithms test suite crashes. (#48432)
* Fix all remaining System.Security.Cryptography.Algorithms test suite crashes.
With this + PR #48348, the test suite runs to completion and reports the following results:
> Tests run: 2527 Passed: 1285 Inconclusive: 0 Failed: 1227 Ignored: 7
So we've got a ways to go to get things passing, but now we can easily track it at least for this assembly.
* PR Feedback.
Aleksey Kliger (λgeek) [Thu, 18 Feb 2021 20:12:25 +0000 (15:12 -0500)]
[coop] Enter GC Unsafe mode in mono_gc_init_finalizer_thread (#48465)
when lazy thread creation is used, this external API function is called
from a thread in GC Safe mode, so enter GC Unsafe before calling runtime
functions.
Fixes a double transition to GC Safe in mono_gc_pthread_create.
Fixes https://github.com/dotnet/runtime/issues/47121
Bruce Forstall [Thu, 18 Feb 2021 19:14:55 +0000 (09:14 -1000)]
Improve SuperPMI asserts (#48449)
Include `GetIndex` method calls in the assert message, to distinguish
the different assert cases in error output. E.g., the asserts
change from:
```
'index != -1' failed ...
```
(which was identical for several cases), to:
```
'GetClassAttribs->GetIndex(CastHandle(classHandle)) != -1' failed ...
```
This makes it easier to know where the problem is without debugging the failure.
Bruce Forstall [Thu, 18 Feb 2021 19:13:37 +0000 (09:13 -1000)]
Display more SuperPMI details in log file (#48448)
In particular, display missing info asserts, which give some hint
about what change might have caused the missing info to be requested.
Bruce Forstall [Thu, 18 Feb 2021 19:13:18 +0000 (09:13 -1000)]
Fix SuperPMI SEH exception handling (#48447)
Capture data in the filter; don't save a PEXCEPTION_POINTERS
that points to data that is is transient to the filter.
Bruce Forstall [Thu, 18 Feb 2021 19:10:27 +0000 (09:10 -1000)]
Run dotnet.sh/cmd script before running dotnet restore (#48375)
* Fix SuperPMI Linux collections
1. Run dotnet for jitutils with jitutils dir as the current working dir.
2. Run dotnet.sh/cmd script before running bootstrap (and `dotnet restore`)
to ensure `.dotnet` directory exists.
Tomáš Rylek [Thu, 18 Feb 2021 19:03:58 +0000 (20:03 +0100)]
Fix PerfMap file naming in Crossgen2 to match Crossgen1 (#48426)
For single-file builds, PerfMap file name is expected to have
the file name <output file>.ni.{managed assembly MVID}.map.
This change fixes Crossgen2 to conform to that naming style.
Thanks
Tomas
Mikhail Pilin [Thu, 18 Feb 2021 18:47:24 +0000 (19:47 +0100)]
Support profiler activation for same bitness architectures (x64+arm64 and x86+arm) on Windows ARM64 and macOS Apple Silicon. #39699 (#46868)
Mateo Torres-Ruiz [Thu, 18 Feb 2021 18:10:47 +0000 (10:10 -0800)]
Fix usage of relative path on bundle extraction (#47200)
* Don't append boolean
* Set working dir for the command only
Test different bunddle options when extracting to relative path
* Add error message
Use bundleOption parameter
* Normalize extraction dir path
Look for expected extracted files
* Only test for bundle options that extract files to disk
Update GetExtractedFiles
* Don't change value of env var
* On windows, forward slashes should be converted to standard dir sep
* Set COREHOST_TRACE in test
* Fixup path after appending rel path
Remove COREHOST_TRACE
* Add extension
* Remove netcoreappcompatmode test with backslash
* Don't modify dir sep
* Update GetFilesNeverExtracted
Skip 'foo/bar' in Windows
Katelyn Gadd [Thu, 18 Feb 2021 17:17:27 +0000 (09:17 -0800)]
Fix issue #48345 (#48391)
Fix issue #48345: Return value marshaling was incorrect for bound methods
Nathan Ricci [Thu, 18 Feb 2021 16:34:26 +0000 (11:34 -0500)]
Implemented abs saturate, absolute compare intrinsics. (#48361)
Co-authored-by: Nathan Ricci <naricc@xam-emag-01.redmond.corp.microsoft.com>
Maxim Lipnin [Thu, 18 Feb 2021 15:27:52 +0000 (18:27 +0300)]
Add tvOS functional tests (#48331)
Viktor Hofer [Thu, 18 Feb 2021 14:38:27 +0000 (15:38 +0100)]
Fix OOB src project configurations (#48318)
* Fix OOB src project configurations
* Optimize netstandard2.1 DI assembly
* Move netcoreapp3.0 tfm to netstandard2.1
* Remove NetCoreAppCurrent config from M.E.DI
Stephen Toub [Thu, 18 Feb 2021 14:01:06 +0000 (09:01 -0500)]
Delete a few lines of dead code in ListDictionaryInternal (#48404)
Vitek Karas [Thu, 18 Feb 2021 13:47:09 +0000 (05:47 -0800)]
Improve error message when bundler fails due to duplicate entries (#48336)
There are multiple possible cases which will make the bundler fail with duplicate entries. Currently there's no indication of which entries caused the problem, making it really hard to diagnose these failures.
This change prints out the source file paths and the colliding relative bundle path in the error message. This should help with diagnosing the failures.
Mateo Torres-Ruiz [Thu, 18 Feb 2021 08:59:47 +0000 (00:59 -0800)]
Fix ILLink descriptors filename (#48430)
Vladimir Sadov [Thu, 18 Feb 2021 07:25:31 +0000 (23:25 -0800)]
Check that rsp is within stack limits when redirecting a thread. (#48433)
* Check that rsp is within stack limits when redirecting a thread.
* move the check after/if SetThreadContext has failed
* just return FALSE after failed SetThreadContext
Co-authored-by: Jan Kotas <jkotas@microsoft.com>
Co-authored-by: Jan Kotas <jkotas@microsoft.com>
Jeff Handley [Thu, 18 Feb 2021 07:19:21 +0000 (23:19 -0800)]
Clarify the behavior of FilePatternMatch Path and Stem (#48093)
* Add theories that illustrate globbing Path/Stem behavior
* Update Path/Stem docs for FilePatternMatch
* Apply suggestions from code review
Co-authored-by: Carlos Sanchez <1175054+carlossanlop@users.noreply.github.com>
Co-authored-by: Carlos Sanchez <1175054+carlossanlop@users.noreply.github.com>
David Cantú [Thu, 18 Feb 2021 04:04:19 +0000 (20:04 -0800)]
Add option to ignore reference cycles on serialization (#46101)
* Add option to ignore reference cycles on serialization
* Fix whitespace
* Combine IsValueType check on WriteCoreAsObject
* Add missing null-forgiving operator
* Fix perf regression by using ReferenceHandlerStrategy field in JsonSerializerOptions
* Address suggestions
* Rename API to IgnoreCycles
* Add missing letter to test class name
* Fix CI issue with nullable annotation
Eric Soros [Thu, 18 Feb 2021 03:24:18 +0000 (22:24 -0500)]
Setting Thread.Name sets the native thread name on MacOS. (#47465)
* Setting Thread.Name sets the native thread name on MacOS.
Setting Thread.Name will now set the name of the native thread
on MacOS - due to API constraints this will not work cross thread.
Fix #47087
* adding tests and formatting fixes
David Wrighton [Thu, 18 Feb 2021 03:03:19 +0000 (19:03 -0800)]
Adjust logic in cor.h, corhdr.h, corinfo.h, corjit.h and such so that they may be included without the PAL (#46055)
This was done via simple substitution of the standard sized integer types, and dealing with the fallout. It is tested by using the ICorJitInfo interface directly within the crossgen2 jitinterface thunk library.
Effort was made to use a minimum number of casts, as casts in such a large change are likely to be wrong somewhere.
- Exceptions are the use of casting to handle some calls to the existing internal metadata api and around use of char16_t.
In addition, a small amount of logic from the PAL headers were pulled into the proper header to allow compilation in the presence of some SAL annotation, and other small details.
SingleAccretion [Thu, 18 Feb 2021 02:45:35 +0000 (05:45 +0300)]
Add debug checking of the loop table (#48060)
* Add fgDebugCheckLoopTable()
* Minify some logging
* Add checking of the loop table to some phases
* Ignore removed loops in fgDebugCheckLoopTable
Elinor Fung [Thu, 18 Feb 2021 00:39:43 +0000 (16:39 -0800)]
Remove libraries test build from AndroidCrypto staging job (#48422)
Bruce Forstall [Thu, 18 Feb 2021 00:38:26 +0000 (14:38 -1000)]
Update SuperPMI license headers (#48417)
Prashanth Govindarajan [Thu, 18 Feb 2021 00:36:25 +0000 (16:36 -0800)]
Fix parsing of trailing zeros: TryParseNumber (#47666)
* Fix parsing of numbers to detect trailing zeros
* sq
* Typo
* Fix a bug
Calculate number of trailing zeros only when number.Digits is updated
* Test case should be culture agnostic
* Address feedback
* More unit tests
* Bug fix and unit tests
* sq
* Address feedback.
* Get more debug info to track down build break
* Turn off consistency check at 1 spot
* Skip consistency check for decimal
* Turn off trailing zero check
Jeremy Koritzinsky [Wed, 17 Feb 2021 22:58:12 +0000 (14:58 -0800)]
Fix various test crashes and asserts when running the Algorithms test suite with the Android Crypto PAL (#48370)
* Fix various test crashes and asserts when running the Algorithms test suite.
* Replace the key/iv if it is initialized multiple times.
Egor Bogatov [Wed, 17 Feb 2021 21:17:20 +0000 (00:17 +0300)]
[RyuJIT] Track exact class for special intrinsics (EqulityComparer, Comparer) (#48279)
Maryam Ariyan [Wed, 17 Feb 2021 20:46:42 +0000 (12:46 -0800)]
Add Eager Options Validation: ValidateOnStart API (#47821)
Steve MacLean [Wed, 17 Feb 2021 19:09:22 +0000 (14:09 -0500)]
Fix PInvoke GenericTest (#48382)
imhameed [Wed, 17 Feb 2021 18:08:36 +0000 (10:08 -0800)]
[mono] Developer convenience MSBuild property (#48381)
Adds a property, named `MonoCMakeExtraArgs`, which is passed through to the CMake configure command invocation.
Example usage:
```
MonoCMakeExtraArgs="-DCMAKE_EXE_LINKER_FLAGS=-fuse-ld=$HOME/clang-9.x/out/bin/ld.lld -DCMAKE_SHARED_LINKER_FLAGS=-fuse-ld=$HOME/clang-9.x/out/bin/ld.lld -DCMAKE_LINKER=$HOME/clang-9.x/out/bin/ld.lld -DCMAKE_AR=$HOME/clang-9.x/out/bin/llvm-ar -DCMAKE_RANLIB=$HOME/clang-9.x/out/bin/llvm-ranlib" \
./build.sh
-configuration Release \
--subset mono \
/p:MonoLLVMUseCxx11Abi=true /p:MonoEnableLLVM=true \
/p:MonoLLVMDir="$LLVM_PREFIX"
```
`touch src/mono/mono/mini/mini-llvm.c && time ninja -C artifacts/obj/mono/Linux.x64.Release` reports 5.3 seconds when using lld, llvm-ar, and llvm-ranlib; this takes 18 seconds when using GNU tools.
Note that GCC doesn't support full paths for fuse-ld, [unlike Clang](https://reviews.llvm.org/D17952).
Andy Ayers [Wed, 17 Feb 2021 16:43:47 +0000 (08:43 -0800)]
Add MCS verb to dump jit flags histogram (#48281)
Useful for determining what sorts of jit compilations are found in an SPMI
collection.
Neale Ferguson [Wed, 17 Feb 2021 13:43:38 +0000 (23:43 +1000)]
Further fixes for s390x that correct some test suite failures (#48196)
## Further s390x Fixes
This set up patches enables s390x to pass more of the test suite.
### 1. Mono array layout
The array "raw data" layout is defined in two places, one for the Mono C++ code, and one for C# code (which should match!):
```
struct _MonoArray {
MonoObject obj;
/* bounds is NULL for szarrays */
MonoArrayBounds *bounds;
/* total number of elements of the array */
mono_array_size_t max_length;
/* we use mono_64bitaligned_t to ensure proper alignment on platforms that need it */
mono_64bitaligned_t vector [MONO_ZERO_LEN_ARRAY];
};
```
vs.
```
private class RawData
{
public IntPtr Bounds;
public IntPtr Count;
public byte Data;
}
```
However, this only actually matches perfectly on 32-bit platforms if `MONO_BIG_ARRAYS` is false and 64-bit platforms if `MONO_BIG_ARRAYS` is true. In the dotnet build, `MONO_BIG_ARRAYS` is false, so we have a problem on 64-bit platforms. On little-endian 64-bit platforms the mismatch is mostly harmless, but on big-endian 64-bit platforms this causes test case failures in `System.Tests.ArrayTests.Clear_Invalid`.
The patch fixes this for s390x, but it should be possible to implement this in a cleaner way ...
### 2. Tail call implementation
There were actually two bugs here. First of all, the `tailcall_reg` instruction was not marked in `cpu-s390x.md` to have an sreg1 input, which meant that the target address was never actually loaded up.
More problematically, the way the tailcall implementation handles call-saved argument registers was fundamentally broken. This is a problem on s390x with the r6 register, which is call-saved even though it is also used as argument register. This is a problem for tail calls, because you have to restore the old value before performing the tail call, which conflicts with loading the required argument value. The same problem also applies for the RGCTX/IMT register, which is likewise both call-saved and used to hold an _implicit_ argument.
The current Mono code simply does not restore the old value and only loads the argument value. But that is an ABI break and may cause failures in a caller higher up on the stack once the tail-called routine finally returns. Consider three functions A, B, C where
#### A:
```
[...]
define R6
call B (does not use R6 as argument)
use R6
[...]
```
##### B:
```
save R6
[...]
load R6 with argument value
tail call C (uses R6 as argument)
```
#### C:
```
save R6
[...]
use R6 argument value
[...]
restore R6
return
```
Once C finally returns to A, the value in R6 will be the value it had on entry to C, not that on entry to B, which is what the code in A relies on.
The following patch fixes this by disabling tail calls in those cases where R6 is used as argument register, as well as in all cases where the RGCTX/IMT register is used.
Note that it might be possible to re-enable the latter cases by using a call-clobbered register as RGCTX/IMT register. One option might be `%r1`, which is also used by GCC as the static chain pointer for nested functions (which is a somewhat similar purpose). This would also match what x86_64 is doing: they likewise use the static chain register for RGCTX/IMT.
I haven't implemented this since there might be a problem with other intervening trampolines clobbering %r1 -- this would need careful review and possibly some reshuffling. I guess this can be done later as an optimization.
### 3. Crashes due to corrupted sigaltstack
When sigaltstack is enabled, the kernel provides the address of the alternate stack to signal handlers in the `uc_stack.ss_sp` field. More importantly, the kernel also *reads* out that field once the signal handler returns and updates its notion of what alternate stack is to be used for future signals! This is a problem with current Mono code, which writes the user-code stack pointer into `ss_sp` -- causing the kernel to attempt to use that part of the user stack as alternate stack for the next signal. If that then overlaps then regular stack (which is likely), the kernel will consider this value corrupted and deliver a SIGSEGV instead.
Looking into this, I'm not really sure why Mono (the s390x code only) even writes to `ss_sp` in the first place. This is apparently read out in just one place, where we actually want to know the user stack, so I guess we can just use r15 directly instead.
#### 4. Codegen problem with floating-point to integer conversions
The Mono back-end uses `cegbr`/`cdgbr` (64-bit int to float conversion instructions) even in the case where the source is actually a 32-bit integer. It really should be using `cefbr`/`cdfbr` in those cases, which is what the following patch implements.
Note that I'm a bit unclear about the intention of the original code here: there appears to be some effort made to hold 32-bit integers in 64-bit sign-extended form in registers, in which case the `cegbr`/`cdgbr` would probably be also correct (but still not really preferable). However, this doesn't seem to be done consistently.
#### 5. Codegen problems with integer overflow detection
There were two separate bugs with properly detecting integer overflows. First of all, the `OP_IADD_OVF_UN` implementation used the 64-bit `algr` instead of the 32-bit `alr` instruction. While the (32-bit) numerical result is of course the same, the detected overflow is incorrect.
More problematic is the overflow detection for signed multiplication. The code seems to only verify whether the sign of the result matches the product of the signs of the inputs -- but this doesn't reliably detect overflow! While of course there must have been an overflow if the sign doesn't match, there can still be an overflow if the sign *does* match, for example in the case from the test suite: 1.000.000.000 * 10
Now, on recent machines we have hardware support to detect overflow: `msgrkc` and `msrkc`. While Mono was already using `msgrkc` (so the problem doesn't occur for 64-bit multiplication) it didn't use `msrkc`. The following patch just adds that case. Note that this still only fixes the problem on z14 on higher; the code for older machines really also ought to be fixed at some point.
#### 6. Codegen problems with interlocked add
Finally, there is a subtle problem with the code currently generated for the interlocked add primitives, if the machine supports the laa(g) instruction. Those handle the whole interlocked-add operation in hardware, so the only thing Mono codegen needs to handle in addition is the proper return value. The laa(g) instructions return the value the memory location had *before* the addition, while the Mono interlocked-add primitive is specified to return the value the memory location has *after* the addition.
To fix this discrepancy, the code generated by Mono will perform another load from the memory location immediately after the laa(g). This usually returns the correct value, but it creates a race condition: in between the laa(g) and the load, another thread might have changed the value! This violates the atomicity guarantee of the interlocked-add primitive.
To fix this, the following patch instead uses the (atomically loaded) result of the laa(g) instruction and then simply performs the original addition a second time in registers.
dotnet-maestro[bot] [Wed, 17 Feb 2021 13:36:59 +0000 (13:36 +0000)]
[master] Update dependencies from dotnet/xharness dotnet/llvm-project dotnet/icu (#48333)
[master] Update dependencies from dotnet/xharness dotnet/llvm-project dotnet/icu
Marek Safar [Wed, 17 Feb 2021 11:35:24 +0000 (12:35 +0100)]
Clean up libraries trimming illink configuration (#48153)
Peter Sollich [Wed, 17 Feb 2021 10:27:11 +0000 (11:27 +0100)]
Fix issue 41928 (#48295)
Details:
The issue was that verify_heap called copy_brick_card_table while another thread was growing these tables, so we ended up with a mark_array where the sections for a new segment were not committed, leading to an AV in bgc_verify_mark_array_cleared.
The fix is to take the gc_lock *before* calling veriy_heap. To avoid a deadlock, the lock has to be taken before we suspend the EE. This only affects the end of a background GC, the verify_heap at the start of a background GC already happens under the gc_lock.
I factored out common code into new methods enter_gc_lock_for_verify_heap and leave_gc_lock_for_verify_heap.
Marek Safar [Wed, 17 Feb 2021 09:36:43 +0000 (10:36 +0100)]
Add default linker substitutions for ios like targets (#48215)
Marek Safar [Wed, 17 Feb 2021 09:34:06 +0000 (10:34 +0100)]
Update NonVersionableAttribute attribute trimming (#48213)