platform/upstream/dotnet/runtime.git
4 years agoRevert "Revert "Dynamic generic dictionary expansion feature (#32270) (#33343)
Jan Kotas [Mon, 9 Mar 2020 17:34:36 +0000 (10:34 -0700)]
Revert "Revert "Dynamic generic dictionary expansion feature (#32270) (#33343)

* Revert "Revert "Dynamic generic dictionary expansion feature (#32270)" (#33310)"

This reverts commit dca34293ad3741dfa4a4f7b81ac821d28460801e.

* Fix race condition in dynamic dictionary resizing

4 years agoRemove redundant mono_gc_collect during domain unload (#33229)
monojenkins [Mon, 9 Mar 2020 15:49:12 +0000 (11:49 -0400)]
Remove redundant mono_gc_collect during domain unload (#33229)

During unload_thread_main, **mono_gc_collect** is called 3 times.

First: https://github.com/mono/mono/blob/280e9d2423549d86686716f0818bcdbac9702ea1/mono/metadata/gc.c#L455

Second: https://github.com/mono/mono/blob/b4c506c3045516349d03ce8f3fe9fa5b79a7271c/mono/metadata/appdomain.c#L3305

Third: https://github.com/mono/mono/blob/b4c506c3045516349d03ce8f3fe9fa5b79a7271c/mono/metadata/appdomain.c#L3324

This PR #ifdefs the Second GC Collect for Boehm as it does not use remsets, and removes the third one completely.

The comment for the second gc_collect existence mentions that:

> We need to make sure that we don't have any remsets pointing into static data...(cont)
> However, Unity uses Boehm so it can be defined out.

There seems to be no good reason for the third GC collect, as it is already called before in mono_domain_finalize, It seems like it doesn't do anything using Visual Studio Profiler to check the heap size before and after the gc_collect. **mono_get_heap_size** also remains the same before and after as well (for the second and third at least).

Co-authored-by: Rares95 <Rares95@users.noreply.github.com>
4 years agoRespect -runtimeconfiguration with -vs switch (#33355)
Viktor Hofer [Mon, 9 Mar 2020 14:15:58 +0000 (15:15 +0100)]
Respect -runtimeconfiguration with -vs switch (#33355)

When using the -vs switch, the -runtimeconfiguration value will now be
respected so that building with mixed configurations between libraries
and the runtime inside VS is possible.

4 years agoms-vscode.csharp to ms-dotnettools.csharp (#33354)
Mattias Karlsson [Mon, 9 Mar 2020 13:00:22 +0000 (14:00 +0100)]
ms-vscode.csharp to ms-dotnettools.csharp (#33354)

C# extension has changed its name from "ms-vscode.csharp" to "ms-dotnettools.csharp".

4 years agoFix ARM64 intrinsic namespace in crossgen and crossgen2 (#32942)
Anton Lapounov [Mon, 9 Mar 2020 10:15:04 +0000 (03:15 -0700)]
Fix ARM64 intrinsic namespace in crossgen and crossgen2 (#32942)

We did not update the hard-coded intrinsic namespace in crossgen and crossgen2 when moved ARM64 intrinsics to a different namespace.

4 years agoWorkaround inefficient codegen for thread statics in latest MSVC (#33347)
Jan Kotas [Mon, 9 Mar 2020 06:50:05 +0000 (23:50 -0700)]
Workaround inefficient codegen for thread statics in latest MSVC (#33347)

GetThread() is no longer getting in latest MSVC and includes unnecessary call
to __dyn_tls_on_demand_init. Removing the extern "C" and applying a __declspec(selectany)
makes the compiler to generate same code as before.

Fixes for #33341

4 years agoGCC compilation fixes (#33345)
Sinan Kaya [Mon, 9 Mar 2020 04:37:23 +0000 (00:37 -0400)]
GCC compilation fixes (#33345)

* Multiply defined

* Cast to size_t

* operator precedence

4 years agoDelete .NET Framework-specific hosting flags (#33353)
Jan Kotas [Mon, 9 Mar 2020 03:56:18 +0000 (20:56 -0700)]
Delete .NET Framework-specific hosting flags (#33353)

There is only one way to host CoreCLR. These hosting flags always ended up being set the same way in CoreCLR.

4 years agoDelete dead code (#33348)
Jan Kotas [Mon, 9 Mar 2020 03:55:20 +0000 (20:55 -0700)]
Delete dead code (#33348)

* Delete remoting left-overs

* Delete StressOn

* Delete API thread stress

* Delete unused variables

* Delete REGUTIL::s_fUseRegistry

4 years agoMerge pull request #33306 from NikolaMilosavljevic/osx.version
Nikola Milosavljevic [Sun, 8 Mar 2020 21:41:33 +0000 (14:41 -0700)]
Merge pull request #33306 from NikolaMilosavljevic/osx.version

Change minimum required OSX version to 10.13

4 years agoFix the guid for the transaction (#32573)
Saurabh Singh [Sun, 8 Mar 2020 07:03:34 +0000 (23:03 -0800)]
Fix the guid for the transaction (#32573)

* Fix the guid for the transaction

* Remove unused using

* Remove duplicate interfaces

* Release the com objects after we are done using them

4 years agoRemove my ownership of System.Reflection.Metadata (#33340)
Nick Guerrera [Sat, 7 Mar 2020 20:56:06 +0000 (12:56 -0800)]
Remove my ownership of System.Reflection.Metadata (#33340)

4 years agoDelete unnecessary CLSCompliant attributes (#33326)
Jan Kotas [Sat, 7 Mar 2020 20:55:36 +0000 (12:55 -0800)]
Delete unnecessary CLSCompliant attributes (#33326)

All members of non-CLSCompliant types are non-CLSCompliant

4 years agoJIT: remove GTF_INX_REFARR_LAYOUT (#33098)
Andy Ayers [Sat, 7 Mar 2020 18:34:05 +0000 (10:34 -0800)]
JIT: remove GTF_INX_REFARR_LAYOUT (#33098)

When morphing `GT_INDEX` nodes, we were inadvertently also setting
`GTF_IND_NONFAULTING` for the `GT_IND` subtree for ref type arrays, because
`GTF_IND_NONFAULTING` has the same value as `GTF_INX_REFARR_LAYOUT`.

This turns out to be safe since in general there is an upstream bounds check to
cover the null check from the indexing operation, so the fact that we were
claiming the `GT_IND` can't fault is ok.

A no diff change would remove the `GTF_INX_REFARR_LAYOUT` flag and then modify
`fgMorphArrayIndex` to set `GTF_IND_NONFAULTING` for ref type arrays with bounds
checks:
```
    // If there's a bounds check, the the indir won't fault.
    if (bndsChk && (tree->gtType == TYP_REF))
    {
        tree->gtFlags |= GTF_IND_NONFAULTING;
    }

    tree->gtFlags |= GTF_EXCEPT;
```

But there's no good reason to limit the above change to ref type arrays and no
good reason to OR in `GTF_EXCEPT` when there are bounds checks.

Closes #32647.

4 years agoFix test for COM + dynamic keyword (#33334)
Elinor Fung [Sat, 7 Mar 2020 17:20:03 +0000 (09:20 -0800)]
Fix test for COM + dynamic keyword (#33334)

4 years agoImplement new COM interop API for RCW/CCW creation/management (#32091)
Aaron Robinson [Sat, 7 Mar 2020 07:37:47 +0000 (23:37 -0800)]
Implement new COM interop API for RCW/CCW creation/management (#32091)

* Implement RuntimeHelpers.AllocateTypeAssociatedMemory().

* Add tests for RuntimeHelpers.AllocateTypeAssociatedMemory().

* Implement ComWrappers API.

* Add tests for ComWrappers API.

* Add a FEATURE_COMWRAPPERS feature flag.

4 years ago[llvm] Move intrinsics definitions into a template header file llvm-intrinsics.h...
monojenkins [Sat, 7 Mar 2020 05:49:07 +0000 (00:49 -0500)]
[llvm] Move intrinsics definitions into a template header file llvm-intrinsics.h. (#33235)

Co-authored-by: vargaz <vargaz@users.noreply.github.com>
4 years agoFix artifact paths in doc (#33324)
Next Turn [Sat, 7 Mar 2020 04:50:42 +0000 (12:50 +0800)]
Fix artifact paths in doc (#33324)

4 years agoDon't inline StelemRef_Helper. (#33319)
Eugene Rozenfeld [Sat, 7 Mar 2020 04:49:18 +0000 (20:49 -0800)]
Don't inline StelemRef_Helper. (#33319)

Under some jit stress modes the jit tries to inline StelemRef_Helper into
StelemRef. StelemRef is jitted very early and the jit is not yet prepared
to handle this inline.

Fixes #33298.

4 years agoin a case of error reporting `load_library` should pass `char*`, not `string_t` ...
Vladimir Sadov [Sat, 7 Mar 2020 04:21:18 +0000 (20:21 -0800)]
in a case of error reporting `load_library` should pass `char*`, not `string_t` (#33323)

4 years agoenable Path tests (#33313)
Anirudh Agnihotry [Sat, 7 Mar 2020 01:24:28 +0000 (17:24 -0800)]
enable Path tests (#33313)

4 years agoenable tests (#33314)
Anirudh Agnihotry [Sat, 7 Mar 2020 01:24:00 +0000 (17:24 -0800)]
enable tests (#33314)

4 years agoRevert "Dynamic generic dictionary expansion feature (#32270)" (#33310)
Fadi Hanna [Sat, 7 Mar 2020 01:00:48 +0000 (17:00 -0800)]
Revert "Dynamic generic dictionary expansion feature (#32270)" (#33310)

This reverts commit 718255964a078883e49ba2c06dfa739aadbfea3b.

4 years agoRuntime composite support, 2nd attempt (fixing DAC) (#33304)
Tomáš Rylek [Sat, 7 Mar 2020 00:59:23 +0000 (01:59 +0100)]
Runtime composite support, 2nd attempt (fixing DAC) (#33304)

[2nd attempt after the initial version was rolled back]

This change changes CoreCLR runtime to support running
composite R2R apps with standalone MSIL produced by
Crossgen2. It introduces the new concept of a NativeImage
representing the composite R2R with native executable header
and adds basic support for loading these native images
upon loading the original MSIL assemblies and for using
the R2R code information therein as the native code cache
for the component MSIL assemblies.

Thanks

Tomas

4 years agoUse lib prefix in all native library names (#33236)
Adeel Mujahid [Sat, 7 Mar 2020 00:32:36 +0000 (02:32 +0200)]
Use lib prefix in all native library names (#33236)

Also consolidated related MSBuild properties in
`/eng/native/naming.props` file.

4 years agoRemove "Interop.winsock" from platform-agnostic Socket tracing (#33289)
Stephen Toub [Sat, 7 Mar 2020 00:30:02 +0000 (19:30 -0500)]
Remove "Interop.winsock" from platform-agnostic Socket tracing (#33289)

This tracing could stand to be overhauled in general, but for now I'm cleaning up the Windows-specific references in the platform-agnostic tracing.

4 years agoTemporarily disable Interop\COM\Dynamic test on x86 (#33301)
Elinor Fung [Sat, 7 Mar 2020 00:10:46 +0000 (16:10 -0800)]
Temporarily disable Interop\COM\Dynamic test on x86 (#33301)

4 years agoEnable starting SampleProfiler from startup EventPipe session (#33200)
Sung Yoon Whang [Fri, 6 Mar 2020 23:10:00 +0000 (15:10 -0800)]
Enable starting SampleProfiler from startup EventPipe session (#33200)

* Enable SampleProfiler to be enabled from startup

* Remove EventPipeController.cs

* PR feedback

4 years agoImprove stack overflow stack trace dumping (#33281)
Jan Vorlicek [Fri, 6 Mar 2020 22:48:35 +0000 (23:48 +0100)]
Improve stack overflow stack trace dumping (#33281)

It was discovered that the stack overflow stack trace dumping to console
doesn't work properly in some cases due to the fact that there was not
enough stack space left to display more complex method signatures on the
call stack.

To remove such fragility, this change updates the stack trace dumping by
running the actual dumping and stack walking on a new thread and
waiting for its completion. That means that we should be able to dump
any stack trace reliably.

4 years agoMerge pull request #32669 from steveharter/NullConvertersAndNotSupportedException
Steve Harter [Fri, 6 Mar 2020 22:46:48 +0000 (16:46 -0600)]
Merge pull request #32669 from steveharter/NullConvertersAndNotSupportedException

Don't allow null converters and add Path support to NotSupportedException

4 years agoReduce thread consumption for sync HTTP/2 reads (#32917)
Stephen Toub [Fri, 6 Mar 2020 22:38:39 +0000 (17:38 -0500)]
Reduce thread consumption for sync HTTP/2 reads (#32917)

The response Stream returned from SocketsHttpHandler.SendAsync supports all of the various forms of read operations, including synchronous reads.

For HTTP/1.x, we're able to implement these as sync all the way down to synchronous calls on the underlying Socket, as every request/response owns its own connection (at least for the duration of the operation; the connection may be returned to the pool for subsequent reuse after).

For HTTP/2, however, a single connection is shared across all requests multiplexed onto it, and as such, reads on those individual responses need to coordinate, which can mean waiting one's turn.  Such waiting for asynchronous operations is implemented via async/await and a ManualResetValueTaskSource-based implementation.  For the sync operations, though, they're implemented as simply blocking waiting on the async equivalent, aka sync-over-async.  This not only blocks the calling thread, but because the MRVTS-based implementation specifies RunContinuationsAsynchronously==true (which is important for reliability with how the async code paths are structured) it means that, in order to unblock this waiter, another thread pool thread needs to be available to run the small continuation that will in turn unblock the sync primitive being blocked on.

This PR tweaks the use of MRVTS so that when we perform a synchronous read, we set MRVTS.RunContinuationsAsynchronously to false.  Since the only action that will be taken as part of the continuation is to set a sync primitive, we don't need to worry about arbitrary code running as part of the completing call stack.  This in turn means that in the common case, sync reads will still end up blocking the calling thread _but_ won't require an additional thread pool thread to unblock it, other than for the task running the main connection loop.

4 years agoAdd Socket.Get/SetRawSocketOption (#33261)
Stephen Toub [Fri, 6 Mar 2020 22:35:39 +0000 (17:35 -0500)]
Add Socket.Get/SetRawSocketOption (#33261)

4 years agoChange minimum required OSX version to 10.13
Nikola Milosavljevic (CLR) [Fri, 6 Mar 2020 22:07:28 +0000 (14:07 -0800)]
Change minimum required OSX version to 10.13

4 years agoFix uname usage and add binlogs (#33223)
Juan Hoyos [Fri, 6 Mar 2020 20:20:08 +0000 (12:20 -0800)]
Fix uname usage and add binlogs  (#33223)

* Add binlogs back to PGO reads and native version header generation
* Use POSIX compliant `uname -m`

4 years agoFix error logging in referenceFromRuntime.targets (#33290)
Viktor Hofer [Fri, 6 Mar 2020 19:34:03 +0000 (20:34 +0100)]
Fix error logging in referenceFromRuntime.targets (#33290)

The RuntimeProjectFile property is used in the FilterReferenceFromRuntime target for error logging but is only available in the AddRuntimeProjectReference target. Moving this out onto the project level.

4 years agoUpdate SDK version to 5.0.100-preview.2.20155.14 (#33277)
Juan Hoyos [Fri, 6 Mar 2020 17:53:07 +0000 (09:53 -0800)]
Update SDK version to 5.0.100-preview.2.20155.14 (#33277)

4 years agoupdate branding to preview3 (#33262)
Anirudh Agnihotry [Fri, 6 Mar 2020 17:30:25 +0000 (09:30 -0800)]
update branding to preview3 (#33262)

4 years agoCorrects interim prerelease version for Extensions packages (#33278)
Maryam Ariyan [Fri, 6 Mar 2020 17:20:50 +0000 (09:20 -0800)]
Corrects interim prerelease version for Extensions packages (#33278)

4 years agoPrevent null converters and add Path support to NotSupportedException
Steve Harter [Fri, 21 Feb 2020 18:40:55 +0000 (12:40 -0600)]
Prevent null converters and add Path support to NotSupportedException

4 years agoFix re-declations of builtin functions with clang 10 (#32837)
Omair Majid [Fri, 6 Mar 2020 14:50:28 +0000 (09:50 -0500)]
Fix re-declations of builtin functions with clang 10 (#32837)

Clang commit 39aa8954a4846b317d3da2f0addfce8224b438de has moved
exception handling mismatches under the -fms-compatibility flag. This
breaks compilation of pal under clang 10 (and newer).

The compilation error looks like this:

In file included from .../pal/src/misc/tracepointprovider.cpp:19:
In file included from .../pal/src/include/pal/palinternal.h:620:
In file included from /usr/bin/../lib/gcc/x86_64-redhat-linux/10/../../../../include/c++/10/stdlib.h:30:
/usr/include/stdlib.h:112:36: error: exception specification in declaration does not match previous declaration
__extension__ extern long long int atoll (const char *__nptr)
                                   ^
.../pal/inc/pal.h:4227:33: note: previous declaration is here
PALIMPORT long long int __cdecl atoll(const char *) THROW_DECL;
                                ^

The simplest fix seems to be to make clang do the same thing as gcc and
define THROW_DECL as 'throw()'.

Testing via https://godbolt.org shows that even clang 3.3 compiles this
successfully without additional compiler options:

    extern "C" long long atoll(char const*) throw();
    #include <stdlib.h>

An alternative fix would be to use -fms-compatibility.

More details at https://bugzilla.redhat.com/show_bug.cgi?id=1807176

4 years agoSupport rodata relocations in crossgen2 for ARM32 (#33153)
Dong-Heon Jung [Fri, 6 Mar 2020 14:09:55 +0000 (23:09 +0900)]
Support rodata relocations in crossgen2 for ARM32 (#33153)

4 years agoChanged signedness of iterator to fix warnings. (#32742)
pi1024e [Fri, 6 Mar 2020 13:19:02 +0000 (08:19 -0500)]
Changed signedness of iterator to fix warnings. (#32742)

numOperands is an unsigned integer. In addition, getArgOperand has unsigned int arguments. As a result, I have no idea why i is an int, but to fix compiler warnings, I made it an unsigned int.

4 years ago[jit] Use OP_EXTRACT_R4 in simd-intrinsics.c when using LLVM. (#33213)
monojenkins [Fri, 6 Mar 2020 12:32:39 +0000 (07:32 -0500)]
[jit] Use OP_EXTRACT_R4 in simd-intrinsics.c when using LLVM. (#33213)

Co-authored-by: vargaz <vargaz@users.noreply.github.com>
4 years agoRemove more OSGroup usages from src/mono (#33247)
Alexander Köplinger [Fri, 6 Mar 2020 11:03:08 +0000 (12:03 +0100)]
Remove more OSGroup usages from src/mono (#33247)

* Remove more OSGroup usages from src/mono

Follow-up to https://github.com/dotnet/runtime/pull/32833

* PR feedback

4 years agoCopy UCRT from versioned directory as fallback and fully incremental (#33209)
Juan Hoyos [Fri, 6 Mar 2020 08:38:59 +0000 (00:38 -0800)]
Copy UCRT from versioned directory as fallback and fully incremental (#33209)

4 years agoFix build warnings (#32208)
Next Turn [Fri, 6 Mar 2020 04:02:53 +0000 (12:02 +0800)]
Fix build warnings (#32208)

4 years agoAdd missing IAsyncDisposable interfaces to System.Data.Common (#33265)
Eric StJohn [Fri, 6 Mar 2020 02:08:25 +0000 (18:08 -0800)]
Add missing IAsyncDisposable interfaces to System.Data.Common (#33265)

4 years agoOverride SerializeToStreamAsync(..., cancellationToken) on Utf8StringContent (#32987)
Stephen Toub [Fri, 6 Mar 2020 01:19:41 +0000 (20:19 -0500)]
Override SerializeToStreamAsync(..., cancellationToken) on Utf8StringContent (#32987)

4 years agoMove Utf8String and Utf8Span code to src/libraries. (#33254)
Stephen Toub [Fri, 6 Mar 2020 01:19:08 +0000 (20:19 -0500)]
Move Utf8String and Utf8Span code to src/libraries. (#33254)

This is the first step in getting Utf8String and Utf8Span working on netstandard2.0.

Contributes to #29442

4 years agoAdd new properties for Obsolete Attribute (#33248)
buyaa-n [Fri, 6 Mar 2020 00:46:50 +0000 (16:46 -0800)]
Add new properties for Obsolete Attribute (#33248)

* Add DiagnosticId UrlFormat propertites for Obsolete attribute

4 years agoRemove Array.IsValueOfElementType internal call (#33239)
Jan Kotas [Fri, 6 Mar 2020 00:28:51 +0000 (16:28 -0800)]
Remove Array.IsValueOfElementType internal call (#33239)

4 years agoFix for solving lock contention issue in GC statics scanning. (#32795)
Jan Kotas [Fri, 6 Mar 2020 00:10:01 +0000 (16:10 -0800)]
Fix for solving lock contention issue in GC statics scanning. (#32795)

* Fix for solving lock contention issue in GC statics scanning.

* Comment change to clarify benefit of switching order in GcScanRoots.

4 years agoSupport COM objects with dynamic keyword (#33060)
Elinor Fung [Thu, 5 Mar 2020 23:02:23 +0000 (15:02 -0800)]
Support COM objects with dynamic keyword (#33060)

4 years agoFix allocation of RuntimeTypeCache GC handle (#33243)
Jan Vorlicek [Thu, 5 Mar 2020 20:57:16 +0000 (21:57 +0100)]
Fix allocation of RuntimeTypeCache GC handle (#33243)

When there is a race calling RuntimeType.InitializeCache, each of the
racing threads creates a new GC handle using
new RuntimeTypeHandle(this).GetGCHandle(GCHandleType.WeakTrackResurrection);
This ends up calling RuntimeTypeHandle::GetGCHandle native method that
adds the allocated handle into the handle cleanup list of the
AssemblyLoaderAllocator specific for the runtime type.
All but the winning thread then call GCHandle.InternalFree on the just
allocated handle. That frees the handle, but leaves it on the cleanup
list of the loader allocator. The same handle can be later allocated for some
other purpose. When the AssemblyLoaderAllocator is being destroyed, all
the handles on the cleanup list are destroyed too. So it destroys also
the handle that was left on the cleanup list incorrectly. That can cause
all kinds of hard to diagnose issues, like the #32171.

This change fixes it by adding a FreeGCHandle method on the
RuntimeTypeHandle that besides freeing the handle also removes it from
the cleanup list of the related AssemblyLoadContext.

4 years agoChanges to excluded test failures when using mono runtime. (#33176)
Nathan Ricci [Thu, 5 Mar 2020 20:20:20 +0000 (15:20 -0500)]
Changes to excluded test failures when using mono runtime. (#33176)

4 years agoFix an assert in ReadyToRunReader constructor (#33203)
Andrew Au [Thu, 5 Mar 2020 19:37:20 +0000 (11:37 -0800)]
Fix an assert in ReadyToRunReader constructor (#33203)

4 years agoCalculate if we're in an instance method in one place to support reverse IL stubs...
msftbot[bot] [Thu, 5 Mar 2020 18:42:02 +0000 (18:42 +0000)]
Calculate if we're in an instance method in one place to support reverse IL stubs. (#33199)

4 years agoMove elfreader assertions (#33195)
Steve MacLean [Thu, 5 Mar 2020 18:20:30 +0000 (13:20 -0500)]
Move elfreader assertions (#33195)

* Move elfreader assertions

Assert before operating on parsed program header

* Remove blank lines

4 years agoMake HPackEncoder stateless and optimize :status writing (#33170)
Cory Nelson [Thu, 5 Mar 2020 18:19:22 +0000 (10:19 -0800)]
Make HPackEncoder stateless and optimize :status writing (#33170)

Make HPackEncoder stateless and optimize :status writing (#33170)

4 years agoRemove "virtual" from GregorianCalendarHelper (#33241)
Jan Kotas [Thu, 5 Mar 2020 18:00:38 +0000 (10:00 -0800)]
Remove "virtual" from GregorianCalendarHelper (#33241)

4 years agoFix cross targeting for depproj (#33238)
Viktor Hofer [Thu, 5 Mar 2020 17:41:14 +0000 (18:41 +0100)]
Fix cross targeting for depproj (#33238)

* Fix cross targeting for depproj

* Fix cross-targeting for ilproj

4 years agoRevert "Initial runtime changes for composite support (#32500)" (#33214)
Tomáš Rylek [Thu, 5 Mar 2020 17:35:15 +0000 (18:35 +0100)]
Revert "Initial runtime changes for composite support (#32500)" (#33214)

This reverts commit f0f33999dea0c1188b30c5e2705d3d3217aeae67.

4 years agoReplacing OSGroup with TargetOS for coreclr, libraries and installer (#32833)
Anirudh Agnihotry [Thu, 5 Mar 2020 15:51:06 +0000 (07:51 -0800)]
Replacing OSGroup with TargetOS for coreclr, libraries and installer (#32833)

* Remove OSGroup from coreclr and corefx

* remove from installer

* fixing coreclr tests

* Some documentation changes

Co-Authored-By: Viktor Hofer <viktor.hofer@microsoft.com>
* moving buildos calculation to config.props

* BuildOS -> TargetOS

* remove osgroup suffix

* removing comment and correcting typo

* dotnet msbuild -> dotnet build at relevant places in docs

* moving more properties to configuration.props

* refactoring properties

* moving TargetArchitecture property to loveBuildd.Targets

* adding configuration.props to signing

* Fix installer build

* BuildOS -> Target os and removing slash

Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
4 years ago[llvm] Don't set the LLVM JIT TLS variable in AOT. (#33201)
Sam Patel [Thu, 5 Mar 2020 13:35:04 +0000 (08:35 -0500)]
[llvm] Don't set the LLVM JIT TLS variable in AOT. (#33201)

Should fix https://github.com/mono/mono/issues/19115. This bug was
introduced in https://github.com/mono/mono/pull/18824, which
conditionally initalized an LLVM JIT-related TLS slot while preserving
unconditonal stores to that same slot.

The value stored in this TLS slot should only be used during JIT
compilation, so set/reset it in `mono_llvm_compile_method` instead of
during IR construction in `mono_llvm_emit_method`. No non-JIT code
should depend on the existence or presence of this TLS variable, so
remove `mono_llvm_jit_set_tls_cfg`.

Co-authored-by: imhameed <imhameed@microsoft.com>
4 years agoRemove non-existent references (#33204)
Stephen Toub [Thu, 5 Mar 2020 12:30:46 +0000 (07:30 -0500)]
Remove non-existent references (#33204)

4 years agoUpdate area owners (#33219)
Stephen Toub [Thu, 5 Mar 2020 12:29:47 +0000 (07:29 -0500)]
Update area owners (#33219)

1. RussKeldorph => echesakovMSFT
2. jeffschw => jeffschwMSFT

4 years agoUpdate error message on failing to find hostpolicy for self-contained (#33193)
Elinor Fung [Thu, 5 Mar 2020 07:32:44 +0000 (23:32 -0800)]
Update error message on failing to find hostpolicy for self-contained (#33193)

- Specify if the config wasn't found versus didn't have a framework
- Show message for apphost (not just dotnet)

4 years agoDelete support for old GCInfo version from the runtime (#33202)
Jan Kotas [Thu, 5 Mar 2020 04:50:45 +0000 (20:50 -0800)]
Delete support for old GCInfo version from the runtime (#33202)

We do not support old R2R images anymore

4 years agoUse prefixed hex format in asm (#33205)
Dan Moseley [Thu, 5 Mar 2020 04:39:24 +0000 (20:39 -0800)]
Use prefixed hex format in asm (#33205)

* Use prefixed hex format in asm

* Use prefixed hex format in asm

4 years agoTweak coreclr runtime build (#33190)
Bruce Forstall [Thu, 5 Mar 2020 02:35:16 +0000 (18:35 -0800)]
Tweak coreclr runtime build (#33190)

1. Output log file names to look at if a build fails.
2. Don't 'mkdir' if the directory already exists.
3. Always save !errorlevel! before running any other command.

4 years ago[merp] Add a test for Mono.Runtime.ExceptionToState() (#32045)
Aleksey Kliger (λgeek) [Thu, 5 Mar 2020 02:25:02 +0000 (21:25 -0500)]
[merp] Add a test for Mono.Runtime.ExceptionToState() (#32045)

Contributes to https://github.com/mono/mono/issues/18078

Co-authored-by: Alexis Christoforides <alexis@thenull.net>
4 years agoMake Crossgen2 built in the VS runnable (and debuggable) (#33194)
Tomáš Rylek [Thu, 5 Mar 2020 01:26:12 +0000 (02:26 +0100)]
Make Crossgen2 built in the VS runnable (and debuggable) (#33194)

4 years agoUse xmm for stack prolog zeroing rather than rep stos (#32538)
Andy Ayers [Thu, 5 Mar 2020 01:24:21 +0000 (17:24 -0800)]
Use xmm for stack prolog zeroing rather than rep stos (#32538)

Use 16 byte xmm stores for prolog zeroing on xarch.

Zeroing strategy varies depending on target arch, isa target, block size, block alignment, and stack alignment.

x86 does unaligned xmm stores (vmovdqu/vmovups); x64 uses aligned stores (vmovdqa/vmovaps) for non-small cases.

* For small blocks [4-32) bytes:  discrete stores are used (16, 8, or 4 byte as appropriate);
* For medium blocks [32 to 96) bytes: 4 and 8 byte discrete stores are used to zero leading and trailing parts that are not 16 byte aligned; an inline sequence of 16 byte stores does the rest;
* For large blocks: small leading and trailing stores are zeroed as is done for medium blocks, then one or two 16 byte stores to leave a region to zero that is a multiple of 48 bytes. This is then handled by a 3x16 unrolled store loop.

4 years agoFix typo (#33192)
msftbot[bot] [Thu, 5 Mar 2020 01:17:38 +0000 (01:17 +0000)]
Fix typo (#33192)

DAC_COMPILE -> DACCESS_COMPILE

4 years agoUpdate API review process image (corefx->runtime) (#33173)
Carlos Sanchez Lopez [Thu, 5 Mar 2020 01:12:21 +0000 (17:12 -0800)]
Update API review process image (corefx->runtime) (#33173)

* Update API Review Process image

* Update docs/project/api-review-process.md

Co-Authored-By: Stephen Toub <stoub@microsoft.com>
Co-authored-by: Stephen Toub <stoub@microsoft.com>
4 years agoUpdate shared code with runtime (#33187)
Justin Kotalik [Thu, 5 Mar 2020 01:04:44 +0000 (17:04 -0800)]
Update shared code with runtime (#33187)

4 years agoFix Crossgen2 build of framework assemblies (issue 33155) (#33169)
Tomáš Rylek [Thu, 5 Mar 2020 01:01:50 +0000 (02:01 +0100)]
Fix Crossgen2 build of framework assemblies (issue 33155) (#33169)

4 years agoAdded PerfScore support for IF_LARGExxx instruction formats (#33161)
Brian Sullivan [Wed, 4 Mar 2020 23:23:40 +0000 (15:23 -0800)]
Added PerfScore support for IF_LARGExxx instruction formats (#33161)

4 years agoManaged StelemRef and LdelemaRef (#32722)
Vladimir Sadov [Wed, 4 Mar 2020 22:19:47 +0000 (14:19 -0800)]
Managed StelemRef and LdelemaRef (#32722)

* Managed `LdelemaRef` and `StelemRef`

* support ARM64 and OSX

* removed old JIT_Stelem_Ref implementation

* removed JIT_Ldelema_Ref

* Attributes for stack/debug hiding.

* PR feedback

* Avoid needing static initializer.

* couple small tweaks

* Avoid PreStub indirection in array element JIT helpers.

* Initialize `gcCoverLock` a bit earlier

* Added comment about revisiting after #5857 is fixed

4 years ago[loader] Clean up locking around adding assemblies to domain/ALC (#32622)
Ryan Lucia [Wed, 4 Mar 2020 22:08:59 +0000 (17:08 -0500)]
[loader] Clean up locking around adding assemblies to domain/ALC (#32622)

This cleans up three components of assembly loading that could potentially cause races/crashes.

First, both `add_assemblies_to_domain` and `add_assembly_to_alc` now ignore resolved references on netcore. We were seeing a crash on CI related to an assertion in here that resulted from two threads using the same MonoImage simultaneously as one is being loaded in with LoadFile, and this should solve that. Fixes #2305

Second, we take both the domain and ALC loaded assemblies locks simultaneously around the assembly being added to both lists, ensuring they stay in sync.

Finally, MonoImage now takes the image lock when writing to references instead of using the global `assemblies_mutex` in assembly.c for all images. This potentially helps reduce contention. Work here is not complete, but for this PR it's good enough. See #32889

4 years agoFix locating Python on Windows when py.exe not found (#33163)
Jeremy Koritzinsky [Wed, 4 Mar 2020 21:53:02 +0000 (13:53 -0800)]
Fix locating Python on Windows when py.exe not found (#33163)

4 years agoAdd ConcurrentDictionary outerloop test for torn values (#33157)
Stephen Toub [Wed, 4 Mar 2020 21:38:24 +0000 (16:38 -0500)]
Add ConcurrentDictionary outerloop test for torn values (#33157)

4 years agoDelete obsolete doc (#33166)
Stephen Toub [Wed, 4 Mar 2020 21:34:30 +0000 (16:34 -0500)]
Delete obsolete doc (#33166)

4 years agoMake cross DAC subsets obey the- runtimeConfiguration flag. (#33168)
Jeremy Koritzinsky [Wed, 4 Mar 2020 21:33:55 +0000 (13:33 -0800)]
Make cross DAC subsets obey the- runtimeConfiguration flag. (#33168)

4 years agoRename JsonSerializer.Read\Write.cs to JsonConverterOfT.Read\WriteCore.cs
Steve Harter [Fri, 21 Feb 2020 18:37:22 +0000 (12:37 -0600)]
Rename JsonSerializer.Read\Write.cs to JsonConverterOfT.Read\WriteCore.cs

4 years agoJIT: Optimize range checks for a[i & C], a[i % c] and a[(i & c1)>>c2)] patterns ...
Eugene Rozenfeld [Wed, 4 Mar 2020 19:22:03 +0000 (11:22 -0800)]
JIT: Optimize range checks for a[i & C], a[i % c] and a[(i & c1)>>c2)] patterns (#1644)

* Optimize range checks for array[x & c]

* Handle more cases...

* Fix possible crash

* Formatting

* Allow only [0..31] range for RSH operator

* Address feedback

* Add tests, also handle GT_LSH

* Address feedback

* Add a comment

4 years agoAdded support for tests to check if they are running under the mono interpreter ...
Steve Pfister [Wed, 4 Mar 2020 19:10:54 +0000 (14:10 -0500)]
Added support for tests to check if they are running under the mono interpreter (#33106)

The mono interpreter is activated by passing --interpreter into the MONO_ENV_OPTIONS
environment variable.

4 years agoRemove BuildAndTest and RebuildAndTest target in favor of Test (#33151)
Viktor Hofer [Wed, 4 Mar 2020 18:40:19 +0000 (19:40 +0100)]
Remove BuildAndTest and RebuildAndTest target in favor of Test (#33151)

* Implicitly build when invoking the test target

To get closer to the VSTest behavior this changes the Test target to
implicitly invoke the Build target unless /p:TestNoBuild is passed in.
(VSTest uses VSTestNoBuild which is controlled by the
dotnet test --no-build flag)

* Fix error logging for test outputs

* Update dotnet msbuild to build docs

* Update ReportGenerator global tool version

Updating ReportGenerator's version to 4.5.0 which removes unnecessary
logging (args passed in).

4 years agoMerge pull request #33065 from nattress/crossgen2_test_baseline
Simon Nattress [Wed, 4 Mar 2020 18:28:43 +0000 (10:28 -0800)]
Merge pull request #33065 from nattress/crossgen2_test_baseline

Baseline Crossgen2 outer loop failing tests

4 years agoPrevent ArrayPool<RegexOptions>.Shared creation (#33093)
Stephen Toub [Wed, 4 Mar 2020 18:21:26 +0000 (13:21 -0500)]
Prevent ArrayPool<RegexOptions>.Shared creation (#33093)

* Prevent ArrayPool<RegexOptions>.Shared creation

* Missed one

4 years agoUpdate dependencies from https://github.com/dotnet/arcade build 20200303.1 (#33156)
Stephen Toub [Wed, 4 Mar 2020 18:19:55 +0000 (13:19 -0500)]
Update dependencies from https://github.com/dotnet/arcade build 20200303.1 (#33156)

- Microsoft.DotNet.XUnitExtensions - 5.0.0-beta.20153.1
- Microsoft.DotNet.VersionTools.Tasks - 5.0.0-beta.20153.1
- Microsoft.DotNet.ApiCompat - 5.0.0-beta.20153.1
- Microsoft.DotNet.Arcade.Sdk - 5.0.0-beta.20153.1
- Microsoft.DotNet.Build.Tasks.Feed - 5.0.0-beta.20153.1
- Microsoft.DotNet.Build.Tasks.Packaging - 5.0.0-beta.20153.1
- Microsoft.DotNet.Build.Tasks.SharedFramework.Sdk - 5.0.0-beta.20153.1
- Microsoft.DotNet.Build.Tasks.TargetFramework.Sdk - 5.0.0-beta.20153.1
- Microsoft.DotNet.CodeAnalysis - 5.0.0-beta.20153.1
- Microsoft.DotNet.GenAPI - 5.0.0-beta.20153.1
- Microsoft.DotNet.GenFacades - 5.0.0-beta.20153.1
- Microsoft.DotNet.Helix.Sdk - 5.0.0-beta.20153.1
- Microsoft.DotNet.RemoteExecutor - 5.0.0-beta.20153.1
- Microsoft.DotNet.XUnitConsoleRunner - 2.5.1-beta.20153.1

4 years ago[dim] Class overriding interface method that was already override by another interfac...
monojenkins [Wed, 4 Mar 2020 15:48:17 +0000 (10:48 -0500)]
[dim] Class overriding interface method that was already override by another interface (#32609)

The problem was a parent class overriding an interface that was already override by another interface.
Refactor class-init.c

Fix mono/mono#18917

Co-authored-by: Thays Grazia <thaystg@gmail.com>
4 years agoInitial runtime changes for composite support (#32500)
Tomáš Rylek [Wed, 4 Mar 2020 14:28:31 +0000 (15:28 +0100)]
Initial runtime changes for composite support (#32500)

This change changes CoreCLR runtime to support running
composite R2R apps with standalone MSIL produced by
Crossgen2. It introduces the new concept of a NativeImage
representing the composite R2R with native executable header
and adds basic support for loading these native images
upon loading the original MSIL assemblies and for using
the R2R code information therein as the native code cache
for the component MSIL assemblies.

Thanks

Tomas

4 years agoInitial implementation of stateful CBOR writer and reader classes (#32803)
Eirik Tsarpalis [Wed, 4 Mar 2020 12:57:08 +0000 (12:57 +0000)]
Initial implementation of stateful CBOR writer and reader classes (#32803)

* initial CborReader commit

* rename PositiveInteger to UnsignedInteger

* fix indices in unsigned integer encoding

* use an enum for AdditionalInfo constants

* s/ArgumentException/InvalidOperationException/

* make utf8 decoder throw on invalid bytes

* remove property-based tests

* address style

* just copy the header struct for now

* s/CborReader/CborValueReader/

* address feedback

* add more test cases in the happy path

* remove using declaration

* fix the seed parameter

* add `EnsureBuffer()` method in reader

* add tests for artihmetic overflow and type exceptions

* rename CborDateItem to CborInitialByte and expose reader Peek() methods

* add tests for non-canonical integer encodings

* use hex representation when asserting byte array equality

* add format and invalidop exception tests

* consistent test terminology

* add invalid unicode writing test

* add string reader failure tests

* fix failing test

* add peek tests

* implement ReadCborNegativeIntegerEncoding(); remove TryRead() methods for integer types

* add span overloads for string reader methods

* update string reader span overload signatures

* add format and invalidop exception tests for TryRead() string methods

* add tests for failure modes

* Update src/libraries/System.Security.Cryptography.Encoding/tests/Cbor/CborReader.String.cs

Co-Authored-By: Jeremy Barton <jbarton@microsoft.com>
* Update src/libraries/System.Security.Cryptography.Encoding/tests/Cbor/CborReader.String.cs

Co-Authored-By: Jeremy Barton <jbarton@microsoft.com>
* fix build

Co-authored-by: Jeremy Barton <jbarton@microsoft.com>
4 years agoAdd IReadOnlySet<T> interface (#32488)
Jacob Lalonde [Wed, 4 Mar 2020 12:07:46 +0000 (07:07 -0500)]
Add IReadOnlySet<T> interface (#32488)

* Add read only set interface

* Rebase and fix conflicts

* Add Implementations into specs

Added to immutable set and spec

Spacing for Spec

Drop code snippets that I re-added accidentally during rebase

Re add code snippets that I dropped instead of squashed

* Add for sorted set in impl

* Refactor interface declarations, change ifdef for immutable

* Fix indentation

* One more indenting change

* Add ifdef to spec, re-order interfaces

* Remove from IImmutablespec

* Replace ISet<T> to immutable hashset spec that was erroneously removed

* Add read only set to system.runtime ref

* Add comments on IReadOnlySet<T>

* Add lang words to comments and fix spelling

4 years ago[cxx] Remove static initializers. (#33022)
monojenkins [Wed, 4 Mar 2020 11:54:18 +0000 (06:54 -0500)]
[cxx] Remove static initializers. (#33022)

In a current shipping Visual C++, 19.21.27702.2,
there is a bug involving const member data in structs, where for example:

static const struct a { // const on this line in either case
  const int b; // const on this line
} c = {1};

will have a static initializer, run usually reliably before main, but:

static const struct a { // const on this line in either case
  int b; // no const on this line
} c = {1};

will not.
The semantic difference is minuscule, so much so, that the first form
is relatively rare, and the bug shipped.

Just always use the second form.

The difference is that if you have a non-const a, b is still const, I guess.
If you have a const a, then no difference.

You can find these easily:

cd ...
for %a in (*.exe *.dll) do link /dump /disasm %a > %a.txt
findstr /c:"dynamic initializer" *.txt

Which could be automated and tested in CI.

This probably not an actual problem, but it is needlessly inefficient,
and potentially a problem. The timing/ordering of the initializers
is a bit not deterministic. You get writable data where you expect
read only.

It is in fact a compiler bug, fixed in later releases.
But it has been shipping for a while, I first noticed it over two years
ago, in code of mine that it caused to not work (a delayload implementation
which runs before main).

Co-authored-by: Jay Krell <jay.krell@cornell.edu>
4 years agoMove EventPipe environment variable parsing logic to native code (#32516)
Sung Yoon Whang [Wed, 4 Mar 2020 11:16:43 +0000 (03:16 -0800)]
Move EventPipe environment variable parsing logic to native code (#32516)

* Move environment variable parsing logic to native code

* Fix multiple provider issue

* Use env vars to set up eventpipe config

* Add default provider configuration if eventpipeconfig is not set

* Remove EventPipeController

* Add Argument parsing logic to XplatEventLoggerConfiguration

* cleanup

* Fix Linux build

* Check provider configuration before enabling them

* wrap new code under ifdef, put EventPipeController back

* pr feedback

* fix x86 build

* fix typo

* Fix loop condition

* ifdef out call to EnableViaEnvironmentVariables()

* Use CLRConfigStringHolder

* pr comments

* use NewHolder to avoid leak

4 years agoAdd -msse2 compile option (#33135)
Next Turn [Wed, 4 Mar 2020 08:48:01 +0000 (16:48 +0800)]
Add -msse2 compile option (#33135)

4 years agoRemove fallback resource (#33123)
Elinor Fung [Wed, 4 Mar 2020 06:57:21 +0000 (22:57 -0800)]
Remove fallback resource (#33123)

* Stop using fallback resource DLL
* Rename mscorrc.debug -> mscorrc

4 years agoFix missing TransitionBlock methods (#33134)
Next Turn [Wed, 4 Mar 2020 05:43:37 +0000 (13:43 +0800)]
Fix missing TransitionBlock methods (#33134)