platform/upstream/llvm.git
18 months ago[InstCombine] Support vectors in icmp of GEP fold
Nikita Popov [Mon, 2 Jan 2023 14:28:10 +0000 (15:28 +0100)]
[InstCombine] Support vectors in icmp of GEP fold

EmitGEPOffset() supports vector GEPs nowadays, so we don't need
any further code changes.

compare_gep_with_base_vector1 shows a weakness in folding the
resulting comparison if an index splat has to be performed.

18 months ago[InstCombine] Add tests for icmp of vector GEP (NFC)
Nikita Popov [Mon, 2 Jan 2023 14:17:34 +0000 (15:17 +0100)]
[InstCombine] Add tests for icmp of vector GEP (NFC)

These show up as regressions with opaque pointers.

18 months ago[JITLink][RISCV] Order EdgeKind_riscv the same way as relocations
Jonas Hahnfeld [Sat, 31 Dec 2022 12:41:51 +0000 (13:41 +0100)]
[JITLink][RISCV] Order EdgeKind_riscv the same way as relocations

There were basically four different orderings: one defined by the
relocations, one by the enum definition of EdgeKind_riscv, one for
mapping the enum values to their names, and one when mapping the
relocations to edge kinds and finally processing them. Chose the
ordering defined by the relocations in the riscv-elf-psabi-doc as
the canonical one.

Differential Revision: https://reviews.llvm.org/D140802

18 months ago[ValueTracking] Use SmallVector for non-undef/poison ops
Nikita Popov [Mon, 2 Jan 2023 13:37:02 +0000 (14:37 +0100)]
[ValueTracking] Use SmallVector for non-undef/poison ops

The way these APIs are used, there isn't really a benefit to
deduplicating the ops as part of the API. The only place that
benefits from this is PoisonChecking, and for that particular
use the assertion emission was potentially non-deterministic.
We should populate a vector for deterministic order and then
deduplicate via a separate set.

18 months ago[mlir] NFC use the correct markdown header in BufferizationTransformOps.td
Oleksandr "Alex" Zinenko [Mon, 2 Jan 2023 13:14:40 +0000 (14:14 +0100)]
[mlir] NFC use the correct markdown header in BufferizationTransformOps.td

18 months ago[llvm-objcopy] Use getNumberOfSymbols() instead of getRawNumberOfSymbols()
Daan De Meyer [Mon, 19 Dec 2022 11:53:02 +0000 (11:53 +0000)]
[llvm-objcopy] Use getNumberOfSymbols() instead of getRawNumberOfSymbols()

getRawNumberOfSymbols() assumes that a symbol table exists, which isn't
always guaranteed, while getNumberOfSymbols() handles and tolerates objects
without a symbol table. When there is a symbol table, both methods return
the same value.

Also add a test to ensure we don't regress in this regard. The test
generates a basic COFF object with symbols and overrides the symbol table
pointer with zeros to craft the input required to verify llvm-objcopy works
as expected in this scenario.

18 months ago[mlir][Bazel] Port cf487cce6f64
Adrian Kuegel [Mon, 2 Jan 2023 12:05:26 +0000 (13:05 +0100)]
[mlir][Bazel] Port cf487cce6f64

18 months ago[ValueTracking] Treat branch on undef as UB as well
Nikita Popov [Mon, 2 Jan 2023 10:16:09 +0000 (11:16 +0100)]
[ValueTracking] Treat branch on undef as UB as well

We were already treating branch on poison as UB, but branch on
undef is also UB. Move the checks into the correct function.

From LangRef for br:

> If ‘cond’ is poison or undef, this instruction has undefined behavior.

From LangRef for switch:

> If ‘value’ is poison or undef, this instruction has undefined behavior.

There is a minor regression in dont-distribute-phi.ll, apparently
we handle that pattern in logical but not bitwise form.

18 months ago[SimpleLoopUnswitch] Perform poison query before transform
Nikita Popov [Mon, 2 Jan 2023 11:19:39 +0000 (12:19 +0100)]
[SimpleLoopUnswitch] Perform poison query before transform

I think this doesn't make any difference right now, but once
we take into account that branch on undef is UB in
programUndefinedIfUndefOrPoison() the new position of the branch
would imply that the condition can't be poison, which would
defeat the purpose of the freeze insertion here. We need to
perform the check before the branch is moved.

18 months ago[clang-tidy] Support std::string_view in readability-redundant-string-cstr
Tamas Berghammer [Mon, 2 Jan 2023 11:24:00 +0000 (06:24 -0500)]
[clang-tidy] Support std::string_view in readability-redundant-string-cstr

Previously we were matching constructor calls for std::string and
llvm::StringRef and this change extends this set with including
std::string_view as well.

Reviewed By: njames93, carlosgalvezp

Differential Revision: https://reviews.llvm.org/D140018

18 months ago[mlir][llvm] Make the import of LLVM IR intrinsics extensible.
Tobias Gysi [Mon, 2 Jan 2023 10:34:51 +0000 (11:34 +0100)]
[mlir][llvm] Make the import of LLVM IR intrinsics extensible.

The revision introduces the LLVMImportDialectInterface to make the
import of LLVM IR intrinsics extensible. It uses a dialect interface
that enables external projects to provide their own conversion functions
for custom intrinsics. These conversion functions can rely on the
ModuleImport class to perform support tasks such as mapping LLVM
values to MLIR values or for converting types between the two worlds.

The implementation largely mirrors the export implementation. One major
difference is the dispatch to the appropriate dialect interface, since
LLVM IR intrinsics have no direct association to an MLIR dialect. The
dialect interfaces thus have to publish the supported intrinsics to
ensure incoming conversion calls are dispatched to the right dialect
interface.

The revision implements the extensible intrinsic import discussed as
part of the "extensible llvm ir import" rfc:
https://discourse.llvm.org/t/rfc-extensible-llvm-ir-import/67256/6

Reviewed By: ftynse

Differential Revision: https://reviews.llvm.org/D140374

18 months ago[ValueTracking] Remove branch-on-poison-as-ub flag (NFC)
Nikita Popov [Mon, 2 Jan 2023 10:02:27 +0000 (11:02 +0100)]
[ValueTracking] Remove branch-on-poison-as-ub flag (NFC)

This has been enabled by default without issue for a while now,
remove the flag.

18 months ago[LLD][Windows]Feature "checksum" for Windows PE
Qfrost [Mon, 2 Jan 2023 09:20:15 +0000 (17:20 +0800)]
[LLD][Windows]Feature "checksum" for Windows PE

Differential Revision: https://reviews.llvm.org/D139184

18 months ago[mlir][MemRef] Apply ClangTidy performance fix (NFC).
Adrian Kuegel [Mon, 2 Jan 2023 07:41:31 +0000 (08:41 +0100)]
[mlir][MemRef] Apply ClangTidy performance fix (NFC).

18 months ago[JITLink][RISCV] Fix incorrectly use of uint32_t
luxufan [Mon, 2 Jan 2023 05:48:39 +0000 (13:48 +0800)]
[JITLink][RISCV] Fix incorrectly use of uint32_t

18 months ago[clang-format][docs] Fix indentation for the Sphinx build
Owen Pan [Sun, 1 Jan 2023 23:13:36 +0000 (15:13 -0800)]
[clang-format][docs] Fix indentation for the Sphinx build

See https://reviews.llvm.org/D140543#4021209.

18 months ago[clang-format][NFC] Clean up IntegerLiteralSeparatorFixer::process
Owen Pan [Sun, 1 Jan 2023 06:06:28 +0000 (22:06 -0800)]
[clang-format][NFC] Clean up IntegerLiteralSeparatorFixer::process

18 months ago[libc] [nfc] Fix heading underline.
Jeff Bailey [Sun, 1 Jan 2023 20:48:24 +0000 (20:48 +0000)]
[libc] [nfc] Fix heading underline.

Differential Revision: https://reviews.llvm.org/D140825

18 months ago[DAGCombiner][X86] Fold a CONCAT_VECTORS of SHUFFLE_VECTOR and it's operand into...
Roman Lebedev [Sun, 1 Jan 2023 19:36:49 +0000 (22:36 +0300)]
[DAGCombiner][X86] Fold a CONCAT_VECTORS of SHUFFLE_VECTOR and it's operand into wider SHUFFLE_VECTOR

This was showing as a source of *many* regressions
with more aggressive ZERO_EXTEND_VECTOR_INREG recognition.

18 months ago[NFC][X86] Add tests for concatenation of shuffle's operand to the shuffle
Roman Lebedev [Sun, 1 Jan 2023 18:34:02 +0000 (21:34 +0300)]
[NFC][X86] Add tests for concatenation of shuffle's operand to the shuffle

18 months ago[VPlan] Adjust mergeReplicateRegions to be in line with mergeBlock (NFC)
Florian Hahn [Sun, 1 Jan 2023 19:48:48 +0000 (19:48 +0000)]
[VPlan] Adjust mergeReplicateRegions to be in line with mergeBlock (NFC)

Adjust mergeReplicateRegions to be in line with
mergeBlocksIntoPredecessors added in 36d70a6aea6b by collecting only the
valid candidates first.

Also rename to mergeReplicateRegionsIntoSuccessors and add missing
doc-comment.

This addresses post-commit suggestions by @Ayal.

18 months ago[clangd] Add extension for adding context (enclosing function or class) in references...
Tom Praschan [Sat, 31 Dec 2022 15:24:55 +0000 (16:24 +0100)]
[clangd] Add extension for adding context (enclosing function or class) in references results

Relevant issue: https://github.com/clangd/clangd/issues/177

Reviewed By: nridge

Differential Revision: https://reviews.llvm.org/D137894

18 months ago[OpenMP][libomptarget] Add TargetParser as dependency in NextGen's JIT
Kevin Sala [Sat, 31 Dec 2022 20:07:56 +0000 (21:07 +0100)]
[OpenMP][libomptarget] Add TargetParser as dependency in NextGen's JIT

This patch fixes an undefined reference to llvm::Triple::Triple(llvm::Twine const&).

Differential Revision: https://reviews.llvm.org/D140810

18 months ago[lld][ELF] Support relocation R_AVR_LDS_STS_16 on AVRTiny devices
Ben Shi [Mon, 12 Dec 2022 03:40:57 +0000 (11:40 +0800)]
[lld][ELF] Support relocation R_AVR_LDS_STS_16 on AVRTiny devices

The relocation 'R_AVR_LDS_STS_16' is introduced for the compact
16-bit LDS/STS instructions on AVRTiny devices.

Reviewed By: MaskRay, aykevl

Differential Revision: https://reviews.llvm.org/D139807

18 months ago[X86] Revert -fno-plt __tls_get_addr workaround for old GNU ld
Fangrui Song [Sun, 1 Jan 2023 06:39:20 +0000 (22:39 -0800)]
[X86] Revert -fno-plt __tls_get_addr workaround for old GNU ld

ENABLE_X86_RELAX_RELOCATIONS has defaulted to on in 2020.
This workaround is not exercised for a long time.

18 months ago[clang] Change CodeGenOptions::RelaxELFRelocations/assembler defaults to match MC...
Fangrui Song [Sun, 1 Jan 2023 06:24:37 +0000 (22:24 -0800)]
[clang] Change CodeGenOptions::RelaxELFRelocations/assembler defaults to match MC default

MC default was flipped in 2016.
CMake ENABLE_X86_RELAX_RELOCATIONS defaults to on in 2020 (c41a18cf61790fc898dcda1055c3efbf442c14c0).
It makes sense for the CodeGenOptions::RelaxELFRelocations to match, so
that most -cc1/-cc1as command lines won't have this option.

This also fixes a minor issue: -fno-plt -S will now use GOT for
__tls_get_addr calls, matching -fno-plt -c.

18 months ago[ELF] Support TLS GD/LD relaxations for x86-32 -fno-plt
Fangrui Song [Sun, 1 Jan 2023 04:50:54 +0000 (20:50 -0800)]
[ELF] Support TLS GD/LD relaxations for x86-32 -fno-plt

For x86-32, {clang,gcc} -fno-plt uses `call *___tls_get_addr@GOT(%reg)` instead
of `call ___tls_get_addr@PLT`. GD to IE/LE relaxations need to shift the offset
by one while LD to LE relaxation needs to use a different code sequence.

While here, fix some comments.

Fix https://github.com/llvm/llvm-project/issues/59769

Differential Revision: https://reviews.llvm.org/D140813

18 months ago[gn build] Port 89aad1e6a397
LLVM GN Syncbot [Sun, 1 Jan 2023 01:57:45 +0000 (01:57 +0000)]
[gn build] Port 89aad1e6a397

18 months agoReland [clang-format] Add an option to format integer literal separators
Owen Pan [Thu, 22 Dec 2022 09:21:17 +0000 (01:21 -0800)]
Reland [clang-format] Add an option to format integer literal separators

Previously committed in 46c94e5067b5 which was reverted in f0756e086010
due to a memory bug.

Closes #58949.

Differential Revision: https://reviews.llvm.org/D140543

18 months ago[clang][NFC] Fix warning due to initializing a pointer with `false`
Markus Böck [Sat, 31 Dec 2022 14:04:31 +0000 (15:04 +0100)]
[clang][NFC] Fix warning due to initializing a pointer with `false`

18 months ago[VPlan] Move GraphTraits definitions to separate header (NFC).
Florian Hahn [Sat, 31 Dec 2022 15:14:57 +0000 (15:14 +0000)]
[VPlan] Move GraphTraits definitions to separate header (NFC).

This reduces the size of VPlan.h and avoids future growth of the file
when the graph traits are extended in future patches.

Reviewed By: Ayal

Differential Revision: https://reviews.llvm.org/D140500

18 months ago[MLIR] Fix affine LICM pass for unknown region holding ops
Uday Bondhugula [Sat, 31 Dec 2022 14:56:40 +0000 (20:26 +0530)]
[MLIR] Fix affine LICM pass for unknown region holding ops

Fix affine LICM pass for unknown region-holding ops. The logic was
completely ignoring regions of unknown ops leading to generation of
invalid IR on hoisting. Handle affine.parallel op among those with
regions that are supported.

Reviewed By: ftynse

Differential Revision: https://reviews.llvm.org/D140738

18 months agoNFC. Fix/improve style in affine-licm pass
Uday Bondhugula [Sat, 24 Dec 2022 10:23:36 +0000 (15:53 +0530)]
NFC. Fix/improve style in affine-licm pass

The code here appears to be out of line with proper style and
guidelines. Fix this.

18 months ago[NFC][libc++] Removes concepts tests.
Mark de Wever [Fri, 23 Dec 2022 17:10:00 +0000 (18:10 +0100)]
[NFC][libc++] Removes concepts tests.

Concepts should be supported by all supported compilers. This is
probably a left over from an older version of the expected patch.

Reviewed By: #libc, philnik

Differential Revision: https://reviews.llvm.org/D140632

18 months ago[docs] TestingGuide.rst: Fix incorrect description
Jie Fu [Sat, 31 Dec 2022 07:31:33 +0000 (23:31 -0800)]
[docs] TestingGuide.rst: Fix incorrect description

This patch fixes two incorrect descriptions in TestingGuide.rst.

1. test/lit.site.cfg --> test/lit.site.cfg.py
   After https://reviews.llvm.org/D37838 , the `test/lit.site.cfg` had been added a .py extension.
   So it should be `test/lit.site.cfg.py`.

2. $(LLVM_OBJ_ROOT)/$(BuildMode)/bin --> $(LLVM_OBJ_ROOT)/bin
   The current build system doesn't create a $(BuildMode) directory any more.
   So it should be removed.

Reviewed By: mehdi_amini, MaskRay

Differential Revision: https://reviews.llvm.org/D140780

18 months ago[test] Opaquify cgprofile.ll
Fangrui Song [Sat, 31 Dec 2022 04:33:27 +0000 (20:33 -0800)]
[test] Opaquify cgprofile.ll

18 months agollvm-readobj COFFDumper print PEHeader CheckSum
Qfrost [Sat, 31 Dec 2022 03:48:58 +0000 (11:48 +0800)]
llvm-readobj COFFDumper print PEHeader CheckSum
Differential Revision:https://reviews.llvm.org/D140555

18 months ago[msan] Remove non-working MSAN_LINUX_X86_64_OLD_MAPPING
Fangrui Song [Sat, 31 Dec 2022 03:43:19 +0000 (19:43 -0800)]
[msan] Remove non-working MSAN_LINUX_X86_64_OLD_MAPPING

r249754 (2015) added this macro (not set anywhere) for an escape hatch.
This old layout has been non-working for many years (Linux
arch/x86/include/asm/elf.h ELF_ET_DYN_BASE is outside the APP range):

    FATAL: Code 0x558547327980 is out of application range. Non-PIE build?
    FATAL: MemorySanitizer can not mmap the shadow memory.
    FATAL: Make sure to compile with -fPIE and to link with -pie.
    FATAL: Disabling ASLR is known to cause this error.
    FATAL: If running under GDB, try 'set disable-randomization off'.

Non-pie doesn't work either.

18 months ago[RISCV] Use tail agnostic if inserting subvector/element at the end of a vector.
Yeting Kuo [Mon, 26 Dec 2022 09:52:56 +0000 (17:52 +0800)]
[RISCV] Use tail agnostic if inserting subvector/element at the end of a vector.

The patch tries to make more vslidup nodes use tail agnostic. The idea comes
from D125546 authored by Zack Chen.

Reviewed By: craig.topper

Differential Revision: https://reviews.llvm.org/D140669

18 months ago[CMake] Remove unused ALL_SCUDO_SUPPORTED_ARCH after D138157
Fangrui Song [Sat, 31 Dec 2022 02:23:54 +0000 (18:23 -0800)]
[CMake] Remove unused ALL_SCUDO_SUPPORTED_ARCH after D138157

18 months ago[CVP] When expanding `urem`, always freeze the nominator
Roman Lebedev [Sat, 31 Dec 2022 01:58:22 +0000 (04:58 +0300)]
[CVP] When expanding `urem`, always freeze the nominator

As per the post-commit feedback - that was not the correct precondition
to avoid it here. I think we should generally start changing mentality
about `freeze`, the fact that we have been conditioned to be afraid of it
(or of anything in LLVM in general) is the key problem here.

18 months ago[NFC][CVP] Add more tests for urem expansion
Roman Lebedev [Sat, 31 Dec 2022 01:43:29 +0000 (04:43 +0300)]
[NFC][CVP] Add more tests for urem expansion

As mentioned in post-commit feedback.

18 months ago[DAGCombiner][TLI] Do not fuse bitcast to <1 x ?> into a load/store of a vector
Roman Lebedev [Sat, 31 Dec 2022 00:23:54 +0000 (03:23 +0300)]
[DAGCombiner][TLI] Do not fuse bitcast to <1 x ?> into a load/store of a vector

Single-element vectors are legalized by splitting,
so the the memory operations would also get scalarized.
While we do have some support to reconstruct scalarized loads,
we clearly don't catch everything.

The comment for the affected AArch64 store suggests that
having two stores was the desired outcome in the first place.

This was showing as a source of *many* regressions
with more aggressive ZERO_EXTEND_VECTOR_INREG recognition.

18 months ago[NFC][Codegen][x86] Add tests for load/store of a single-element vectors
Roman Lebedev [Sat, 31 Dec 2022 00:10:43 +0000 (03:10 +0300)]
[NFC][Codegen][x86] Add tests for load/store of a single-element vectors

18 months ago[NFC][TLI] Move `isLoadBitCastBeneficial()` implementation into source file
Roman Lebedev [Fri, 30 Dec 2022 23:07:50 +0000 (02:07 +0300)]
[NFC][TLI] Move `isLoadBitCastBeneficial()` implementation into source file

... so any change to it does not cause 700 source files to be recompiled.

18 months ago[DAG] BUILD_VECTOR: absorb ZERO_EXTEND of a single first operand if all other ops...
Roman Lebedev [Fri, 30 Dec 2022 00:49:48 +0000 (03:49 +0300)]
[DAG] BUILD_VECTOR: absorb ZERO_EXTEND of a single first operand if all other ops are zeros

This kind of pattern seems to come up as regressions
with better ZERO_EXTEND_VECTOR_INREG recognition.

For initial implementation, this is quite restricted
to the minimal viable transform, otherwise there are
too many regressions to be dealt with.

18 months ago[NFC] Test case intended to cover SLP cost for chain with masked gather loads.
Valery N Dmitriev [Fri, 30 Dec 2022 19:07:04 +0000 (11:07 -0800)]
[NFC] Test case intended to cover SLP cost for chain with masked gather loads.

SLP produces two gather loads (one feeds another).
For the first set of scalar loads GEP indices are all constant.
The result of the second load is then fed into reduction (as a seed).

Differential Revision: https://reviews.llvm.org/D140785

18 months ago[mlir] Add a test for default valued dictionary attributes
Eugene Zhulenev [Thu, 29 Dec 2022 21:24:45 +0000 (13:24 -0800)]
[mlir] Add a test for default valued dictionary attributes

+ Replace special placeholders ($_builder, etc...) in default attribute string

Reviewed By: ftynse

Differential Revision: https://reviews.llvm.org/D140765

18 months ago[NFC][X86] Add exhaustive-ish coverage for broadcast of implicitly aext/zext element
Roman Lebedev [Fri, 30 Dec 2022 18:25:14 +0000 (21:25 +0300)]
[NFC][X86] Add exhaustive-ish coverage for broadcast of implicitly aext/zext element

Some of these even crash instruction selection for AVX512.
This is one of the patterns that comes up as regressions
with more aggressive ZERO_EXTEND_VECTOR_INREG recognition.

https://godbolt.org/z/x88aqfrT5

18 months agoRevert "[CodeGen] Temporarily disable-lsr in HWASAN build"
Vitaly Buka [Fri, 30 Dec 2022 18:57:12 +0000 (10:57 -0800)]
Revert "[CodeGen] Temporarily disable-lsr in HWASAN build"

We can do the same with cmake on the bot.

This reverts commit 8f70b848d339cabfaa8f1379d41dae11b9b75014.

18 months ago[Sema] Avoid double hash lookup. NFCI
Benjamin Kramer [Fri, 30 Dec 2022 18:07:19 +0000 (19:07 +0100)]
[Sema] Avoid double hash lookup. NFCI

18 months ago[VPlan] Also consider operands of sink candidates in same block.
Florian Hahn [Fri, 30 Dec 2022 18:24:34 +0000 (18:24 +0000)]
[VPlan] Also consider operands of sink candidates in same block.

Even if the the sink candidate is already in the target block, its
operands can be candidates for sinking. Queue them up as well. Also
moves the queuing logic to a helper.

18 months ago[NFC][AMDGPU] Make method declarations in SIInstrInfo equivalent to their definitions.
Thomas Symalla [Fri, 30 Dec 2022 13:25:51 +0000 (14:25 +0100)]
[NFC][AMDGPU] Make method declarations in SIInstrInfo equivalent to their definitions.

Some functions from SIInstrInfo have their operands named different in
their declarations vs. their defs. This was caught by cppcheck.

Reviewed By: arsenm

Differential Revision: https://reviews.llvm.org/D140778

18 months ago[AArch64] Stringref'ize AArch64Subtarget constructor. NFCI
Benjamin Kramer [Fri, 30 Dec 2022 17:02:26 +0000 (18:02 +0100)]
[AArch64] Stringref'ize AArch64Subtarget constructor. NFCI

18 months ago[mlir][gpu][spirv] Lower gpu reduction ops to spirv
Ivan Butygin [Thu, 22 Dec 2022 19:50:52 +0000 (20:50 +0100)]
[mlir][gpu][spirv] Lower gpu reduction ops to spirv

Supports only "add" and "mul" ops for now. More ops will be added later.

Differential Revision: https://reviews.llvm.org/D140576

18 months ago[CVP] Expand bound `urem`s
Roman Lebedev [Fri, 30 Dec 2022 16:06:59 +0000 (19:06 +0300)]
[CVP] Expand bound `urem`s

This kind of thing happens really frequently in LLVM's very own
shuffle combining methods, and it is even considered bad practice
to use `%` there, instead of using this expansion directly.
Though, many of the cases there have variable divisors,
so this won't help everything.

Simple case: https://alive2.llvm.org/ce/z/PjvYf-
There's alternative expansion via `umin`:
https://alive2.llvm.org/ce/z/hWCVPb

BUT while we can transform the first expansion
into the `umin` one (e.g. for SCEV):
https://alive2.llvm.org/ce/z/iNxKmJ
... we can't go in the opposite direction.

Also, the non-`umin` expansion seems somewhat more codegen-friendly:
https://godbolt.org/z/qzjx5bqWK
https://godbolt.org/z/a7bj1axbx

There's second variant of precondition:
https://alive2.llvm.org/ce/z/zE6cbM
but there the numerator must be non-undef / must be frozen.

18 months ago[NFC][CVP] `processURem()`: add statistic and increase readability
Roman Lebedev [Fri, 30 Dec 2022 16:15:43 +0000 (19:15 +0300)]
[NFC][CVP] `processURem()`: add statistic and increase readability

18 months ago[NFC][CVP] Add tests for urem expansion
Roman Lebedev [Fri, 30 Dec 2022 16:03:11 +0000 (19:03 +0300)]
[NFC][CVP] Add tests for urem expansion

18 months ago[NFC][PhaseOrdering] Re-autogenerate check lines in one test
Roman Lebedev [Fri, 30 Dec 2022 14:12:21 +0000 (17:12 +0300)]
[NFC][PhaseOrdering] Re-autogenerate check lines in one test

18 months agoValueTracking: Fix canCreateUndefOrPoison for saturating shifts
Matt Arsenault [Fri, 30 Dec 2022 16:08:33 +0000 (11:08 -0500)]
ValueTracking: Fix canCreateUndefOrPoison for saturating shifts

These need to consider the shift amount.

18 months ago[AMDGPU][AsmParser] Refine parsing cache policy modifiers.
Ivan Kosarev [Fri, 30 Dec 2022 15:05:21 +0000 (15:05 +0000)]
[AMDGPU][AsmParser] Refine parsing cache policy modifiers.

Reviewed By: dp, arsenm

Differential Revision: https://reviews.llvm.org/D140108

18 months ago[MemProf] Fix inline propagation of memprof metadata
Teresa Johnson [Thu, 29 Dec 2022 20:11:38 +0000 (12:11 -0800)]
[MemProf] Fix inline propagation of memprof metadata

It isn't correct to always remove memprof metadata MIBs from the
original allocation call after inlining.

Let's say we have the following partial call graph:

C     D
 \   /
  v v
   B   E
   |  /
   v v
    A

where A contains an allocation call. If both contexts including B have
the same allocation behavior, the context in the memprof metadata on the
allocation will be pruned, and we will have 2 MIBs with contexts:
A,B and A,E.

Previously, if we inlined A into B we propagate the matching MIBs onto
the inlined allocation call in B' (A,B in this case), and remove it from
the original out of line allocation in A. This is correct if we have a
single round of bottom up inlining.

However, in the compiler we can have multiple invocations of the inliner
pass (e.g. LTO). We may also inline non-bottom up with an alternative
inliner such as the ModuleInliner. In that case, we could end up first
inlining B into C, without having inlined A into B. The call graph then
looks like:

    D
    |
    v
C'  B   E
 \  |  /
  v v v
    A

If we subsequently (perhaps on a later invocation of bottom up inlining)
inline A into B, the previous handling would propagate the memprof MIB
context A,B up into the inlined allocation in B', and remove it from the
original allocation in A. The propagation into B' is fine, however, by
removing it from A's allocation, we no longer reflect the context coming
from C'.

To fix this, simply prevent the removal of MIB from the original
allocation callsites.

Note that the memprof_inline.ll test has some changes to existing
checking to replace "noncold" with "notcold" in the metadata. The
corresponding CHECK was accidentally commented out in the old version
and thus this mistake was not previously detected.

Differential Revision: https://reviews.llvm.org/D140764

18 months ago[SLP]Do not emit many extractelements, reuse the single one emitted.
Alexey Bataev [Thu, 22 Dec 2022 20:07:44 +0000 (12:07 -0800)]
[SLP]Do not emit many extractelements, reuse the single one emitted.

We do not need to emit many extractelements for each particular use, we
can reuse the only one, just need to adjust it to make it dominate on
all uses.

Differential Revision: https://reviews.llvm.org/D140580

18 months ago[InstSimplify] fold selects where true/false arm is the same as condition
Sanjay Patel [Fri, 30 Dec 2022 13:47:51 +0000 (08:47 -0500)]
[InstSimplify] fold selects where true/false arm is the same as condition

We managed to fold related patterns in issue #59704,
but we were missing these more basic folds:
https://alive2.llvm.org/ce/z/y6d7SN

18 months ago[InstSimplify] add tests for select-of-bool; NFC
Sanjay Patel [Thu, 29 Dec 2022 19:51:30 +0000 (14:51 -0500)]
[InstSimplify] add tests for select-of-bool; NFC

18 months agoIROutliner: Convert tests to opaque pointers
Matt Arsenault [Fri, 30 Dec 2022 13:40:31 +0000 (08:40 -0500)]
IROutliner: Convert tests to opaque pointers

Some of these show improvements. outlining-bitcasts.ll might not be
relevant anymore (or should be rewritten to test some other type of
non-pointer bitcast).

18 months ago[AMDGPU][GFX11] Correct tied src2 of v_fmac_f16_e64
Dmitry Preobrazhensky [Fri, 30 Dec 2022 13:29:47 +0000 (16:29 +0300)]
[AMDGPU][GFX11] Correct tied src2 of v_fmac_f16_e64

src2 was incorrectly defined as VSrc_f16 but it is tied to dst which is VGPR_32. As a result, disassembler failed to decode src2.

Differential Revision: https://reviews.llvm.org/D140299

18 months agoAMDGPU: Use default attributes on image dim intrinsics
Matt Arsenault [Fri, 30 Dec 2022 13:07:33 +0000 (08:07 -0500)]
AMDGPU: Use default attributes on image dim intrinsics

These were missing nocallback and willreturn

18 months ago[AMDGPU][MC][GFX11] Correct encoding of neg modifier for v_dot2_f32_bf16
Dmitry Preobrazhensky [Fri, 30 Dec 2022 13:20:38 +0000 (16:20 +0300)]
[AMDGPU][MC][GFX11] Correct encoding of neg modifier for v_dot2_f32_bf16

Fix a bug with neg_lo:[0,1,0] and neg_hi:[0,1,0] modifiers - they are accepted but not encoded.

Differential Revision: https://reviews.llvm.org/D140470

18 months ago[NFC][IR] Remove unused assignment to Offset
Alfonso Gregory [Tue, 21 Sep 2021 15:15:00 +0000 (11:15 -0400)]
[NFC][IR] Remove unused assignment to Offset

This value is overwritten anyway, so let's remove it

18 months ago[ScheduleDAG] Support REQ_SEQUENCE unscheduling
Filipp Zhinkin [Tue, 27 Dec 2022 15:08:54 +0000 (19:08 +0400)]
[ScheduleDAG] Support REQ_SEQUENCE unscheduling

REG_SEQUENCE node requires special treatment during the
unscheduling because the node is untyped and neither its
class, nor cost could be retrieved the same way as for
typed nodes.

Related issue: https://github.com/llvm/llvm-project/issues/58911

Reviewed By: efriedma

Differential Revision: https://reviews.llvm.org/D138837

18 months ago[mlir][Arith] Fold integer shift op with zero.
jacquesguan [Thu, 29 Dec 2022 02:51:05 +0000 (10:51 +0800)]
[mlir][Arith] Fold integer shift op with zero.

This revision folds arith.shrui, arith.shrsi and arith.shli with zero
rhs to lhs.

Reviewed By: ftynse

Differential Revision: https://reviews.llvm.org/D140749

18 months ago[mlir][Arith] Remove redundant defination, NFC.
jacquesguan [Fri, 30 Dec 2022 08:38:52 +0000 (16:38 +0800)]
[mlir][Arith] Remove redundant defination, NFC.

Reviewed By: ftynse

Differential Revision: https://reviews.llvm.org/D140774

18 months ago[Flang] Add ppc64 support to Optimizer/CodeGen/Target.cpp for AIX 64 bit
Mark Danial [Fri, 30 Dec 2022 07:50:46 +0000 (09:50 +0200)]
[Flang] Add ppc64 support to Optimizer/CodeGen/Target.cpp for AIX 64 bit

Adding support for ppc64 (big endian) in order to support flang on 64 bit AIX

Reviewed By: clementval, kiranchandramohan

Differential Revision: https://reviews.llvm.org/D138390

18 months ago[mlir] Simplify a test for vectorizing tensor.extract
Andrzej Warzynski [Thu, 29 Dec 2022 10:28:47 +0000 (10:28 +0000)]
[mlir] Simplify a test for vectorizing tensor.extract

Remove unused arguments and the corresponding logic (e.g. affine maps).

Differential Revision: https://reviews.llvm.org/D140755

18 months ago[CodeGen] Temporarily disable-lsr in HWASAN build
Vitaly Buka [Fri, 30 Dec 2022 07:25:22 +0000 (23:25 -0800)]
[CodeGen] Temporarily disable-lsr in HWASAN build

HWASAN exposes some non-determinism in the pass and triggers:
ScalarEvolution.cpp:11540: bool llvm::ScalarEvolution::isLoopEntryGuardedByCond(const Loop *, ICmpInst::Predicate, const SCEV *, const SCEV *): Assertion `isAvailableAtLoopEntry(LHS, L) && "LHS is not available at Loop Entry"' failed.

E.g.
https://lab.llvm.org/buildbot/#/builders/236/builds/1629/steps/16/logs/stdio
is broken after D137838. I tried to split D137838 into smaller patches
and the one which reproduced was just a move of cpp from one dir to another.

Maybe it has something do to with comparison of tagged pointeres and
PtrSets used in pass.

Issues is hard to reproduce, even slight changes in path, or preprocessing
cpp file hide it.

18 months ago[clang][dataflow] Fix crash when having boolean-to-integral casts.
Jun Zhang [Thu, 29 Dec 2022 06:40:40 +0000 (14:40 +0800)]
[clang][dataflow] Fix crash when having boolean-to-integral casts.

Since now we just ignore all (implicit) integral casts, treating the
resulting value as the same as the underlying value, it could cause
inconsistency between values after `Join` if in some paths the type
doesn't strictly match. This could cause intermittent crashes.

std::optional<bool> o;
int x;
if (o.has_value()) {
  x = o.value();
}

Fixes: https://github.com/llvm/llvm-project/issues/59728

Signed-off-by: Jun Zhang <jun@junz.org>
Differential Revision: https://reviews.llvm.org/D140753

18 months ago[Bazel] Exclude lib/Headers/openmp_wrappers/stdlib.h out of builtin_headers
NAKAMURA Takumi [Fri, 30 Dec 2022 04:21:10 +0000 (13:21 +0900)]
[Bazel] Exclude lib/Headers/openmp_wrappers/stdlib.h out of builtin_headers

It has been there since llvmorg-16-init-14999-g07ff3c5ccce6

18 months ago[MLIR][Arith][NFC] Use the interface of 'getElementTypeOrSelf' to get the resType
liqinweng [Fri, 30 Dec 2022 03:54:06 +0000 (11:54 +0800)]
[MLIR][Arith][NFC] Use the interface of 'getElementTypeOrSelf' to get the resType

Reviewed By: ftynse

Differential Revision: https://reviews.llvm.org/D140608

18 months ago[RISCV] Use SUB instead of XOR in lowerShiftLeftParts/lowerShiftRightParts./
Craig Topper [Fri, 30 Dec 2022 00:56:43 +0000 (16:56 -0800)]
[RISCV] Use SUB instead of XOR in lowerShiftLeftParts/lowerShiftRightParts./

isel is now capable of turning the SUB into XOR for shift amounts.
Though it uses NOT instead of XOR with ShiftSize-1.

By using SUB during lowering we enable more DAG combines with
other arithmetic on the shift amount.

18 months ago[RISCV] RISCVDAGToDAGISel::selectShiftMask to shift by (sub size-1, X).
Craig Topper [Fri, 30 Dec 2022 00:33:18 +0000 (16:33 -0800)]
[RISCV] RISCVDAGToDAGISel::selectShiftMask to shift by (sub size-1, X).

If the shift amount is (sub C, X) where C is -1 modulo the size of
the shift, we can replace the sub with a NOT.

We could also use XORI X, size-1, but NOT would work better with
c.not from the future Zce extension.

18 months agoAMDGPU/clang: Remove target features from address space test builtins
Matt Arsenault [Mon, 28 Nov 2022 22:26:14 +0000 (17:26 -0500)]
AMDGPU/clang: Remove target features from address space test builtins

It turns out we can codegen these on targets without flat addressing,
although the runtime probably didn't put anything useful there. The
proper diagnostic would be to disallow flat pointer uses or languages
with them, not this one edge case. Allows removing one of the special
cases requiring subtarget support in the device libraries.

18 months ago[mlir][spirv] Fail vector.bitcast conversion with different bitwidth
Lei Zhang [Thu, 29 Dec 2022 23:27:29 +0000 (15:27 -0800)]
[mlir][spirv] Fail vector.bitcast conversion with different bitwidth

Depending on the target environment, we may need to emulate certain
types, which can cause issue with bitcast.

Reviewed By: ThomasRaoux

Differential Revision: https://reviews.llvm.org/D140437

18 months agolibclc: Add parentheses to silence warning
Matt Arsenault [Thu, 29 Dec 2022 23:11:14 +0000 (18:11 -0500)]
libclc: Add parentheses to silence warning

Fixes #59209

18 months agoDAG: Prevent store value forwarding to distinct addrspace load
Dmitry Borisenkov [Thu, 29 Dec 2022 23:04:55 +0000 (18:04 -0500)]
DAG: Prevent store value forwarding to distinct addrspace load

DAGCombiner replaces (load const_addr1) directly chained with (store
(val, const_addr2)) with val if address space stripped const_addr1 ==
const_addr2. The patch fixes the issue by checking address spaces as
well.  However, it might makes sense to not to chain together side
effects that belong to different address spaces in the first place and
make SelectionDAG::root address space aware.

18 months ago[RISCV] Teach RISCVDAGToDAGISel::selectShiftMask to bypass adds with constant.
Craig Topper [Thu, 29 Dec 2022 22:45:04 +0000 (14:45 -0800)]
[RISCV] Teach RISCVDAGToDAGISel::selectShiftMask to bypass adds with constant.

If the shift amount is (add X, C) where C is 0 modulo the size of
the shift, we can bypass the add.

Similar to other targets like AArch64 and X86.

18 months agoAMDGPU/clang: Add builtins for llvm.amdgcn.ballot
Matt Arsenault [Thu, 18 Jun 2020 01:46:28 +0000 (21:46 -0400)]
AMDGPU/clang: Add builtins for llvm.amdgcn.ballot

Use explicit _w32/_w64 suffixes for the wave size to be consistent
with the existing other wave dependent intrinsics. Also start
diagnosing trying to use both wave32 and wave64.

I would have preferred to avoid the +wavefrontsize64 spam on targets
where that's the only option, but avoiding this seems to be more work
than I expected.

18 months ago[NFC][Codegen][X86] zero_extend_vector_inreg.ll: add SSE4.2 runline
Roman Lebedev [Thu, 29 Dec 2022 22:43:20 +0000 (01:43 +0300)]
[NFC][Codegen][X86] zero_extend_vector_inreg.ll: add SSE4.2 runline

18 months ago[DAGCombiner] Try to partition ISD::EXTRACT_VECTOR_ELT to accomodate it's ISD::BUILD_...
Roman Lebedev [Thu, 29 Dec 2022 15:02:02 +0000 (18:02 +0300)]
[DAGCombiner] Try to partition ISD::EXTRACT_VECTOR_ELT to accomodate it's ISD::BUILD_VECTOR users

This mainly cleans up a few patterns that are legalized by scalarization
from a wide-element vector, but then are further split apart to build
a more narrow-sized-element vector. In particular this happens in some
cases for illegal ISD::ZERO_EXTEND_VECTOR_INREG.

Given a ISD::EXTRACT_VECTOR_ELT, which is a glorified bit sequence extract,
recursively analyse all of it's users. and try to model themselves as
bit sequence extractions. If all of them agree on the new, narrower element
type, and all of them can be modelled as ISD::EXTRACT_VECTOR_ELT's of that
new element type, do that, but only if unmodelled users are ISD::BUILD_VECTOR.

18 months ago[TargetLowering] Teach BuildUDIV to take advantage of leading zeros in the dividend.
Craig Topper [Thu, 29 Dec 2022 21:58:46 +0000 (13:58 -0800)]
[TargetLowering] Teach BuildUDIV to take advantage of leading zeros in the dividend.

If the dividend has leading zeros, we can use them to reduce the
size of the multiplier and avoid the fixup cases.

This patch is for scalars only, but we might be able to do this
for vectors in a follow up.

Differential Revision: https://reviews.llvm.org/D140750

18 months ago[instrprof] Fix issue in binary-ids-padding.test
Gulfem Savrun Yeniceri [Thu, 29 Dec 2022 20:37:57 +0000 (20:37 +0000)]
[instrprof] Fix issue in binary-ids-padding.test

https://reviews.llvm.org/D135929 caused a failure in
binary-ids-padding.test in big endian configurations:
https://lab.llvm.org/buildbot/#/builders/231/builds/6709

binary-ids-padding.test writes the profile in little-endian format.
This patch changes the raw profile reader to use getDataEndianness()
instead of llvm::support::endian::system_endianness() to fix the issue.

18 months agoApply clang-tidy fixes for performance-for-range-copy in Vectorization.cpp (NFC)
Mehdi Amini [Thu, 22 Dec 2022 19:53:45 +0000 (19:53 +0000)]
Apply clang-tidy fixes for performance-for-range-copy in Vectorization.cpp (NFC)

18 months agoApply clang-tidy fixes for readability-identifier-naming in TestDialect.cpp (NFC)
Mehdi Amini [Sat, 10 Dec 2022 14:16:17 +0000 (14:16 +0000)]
Apply clang-tidy fixes for readability-identifier-naming in TestDialect.cpp (NFC)

18 months ago[clang] Use try_emplace instead of insert when getting new identifier
serge-sans-paille [Thu, 29 Dec 2022 15:24:58 +0000 (16:24 +0100)]
[clang] Use try_emplace instead of insert when getting new identifier

This is both less verbose and slightly faster, according to:

https://llvm-compile-time-tracker.com/compare.php?from=d9ab3e82f30d646deff054230b0c742704a1cf26&to=73405077ad913f634797ffc7a7bbb110ac9cae99&stat=instructions:u

No functional change intended :-)

18 months ago[mlir] Add constBuilderCall to DictionaryAttr
Eugene Zhulenev [Wed, 28 Dec 2022 20:45:17 +0000 (12:45 -0800)]
[mlir] Add constBuilderCall to DictionaryAttr

Reviewed By: ftynse

Differential Revision: https://reviews.llvm.org/D140740

18 months ago[mlir][sparse] layout fixes (NFC)
Aart Bik [Thu, 29 Dec 2022 18:55:01 +0000 (10:55 -0800)]
[mlir][sparse] layout fixes (NFC)

Reviewed By: bixia

Differential Revision: https://reviews.llvm.org/D140761

18 months ago[ProfileData] Fix msan -fsanitize-memory-param-retval after D135929
Fangrui Song [Thu, 29 Dec 2022 20:16:20 +0000 (12:16 -0800)]
[ProfileData] Fix msan -fsanitize-memory-param-retval after D135929

test/tools/llvm-cov/load-multiple-objects.test calls
IndexedInstrProfReader::readBinaryIds with uninitialized BinaryIdsStart.

18 months ago[llvm][AsmPrinter][NFC] Cleanup `GCMetadataPrinters` field
Markus Böck [Thu, 29 Dec 2022 19:47:29 +0000 (20:47 +0100)]
[llvm][AsmPrinter][NFC] Cleanup `GCMetadataPrinters` field

The field is currently `void*`, which was originlly chosen in 2010 to not need to include `DenseMap`. Since then, `DenseMap` has been included in the header file anyways, so there is no more need to for the indirection via `void*` and the cruft around it can be removed.

Differential Revision: https://reviews.llvm.org/D140758

18 months ago[InstCombine] avoid miscompile in sinkNotIntoLogicalOp()
Sanjay Patel [Thu, 29 Dec 2022 19:23:25 +0000 (14:23 -0500)]
[InstCombine] avoid miscompile in sinkNotIntoLogicalOp()

Fixes #59704

18 months ago[InstCombine] add test for miscompile from sinkNotIntoLogicalOp(); NFC
Sanjay Patel [Thu, 29 Dec 2022 19:19:15 +0000 (14:19 -0500)]
[InstCombine] add test for miscompile from sinkNotIntoLogicalOp(); NFC

issue #59704