[LV] Unconditionally branch from middle to scalar preheader if the scalar loop must...
authorPhilip Reames <listmail@philipreames.com>
Fri, 5 Feb 2021 01:25:30 +0000 (17:25 -0800)
committerPhilip Reames <listmail@philipreames.com>
Fri, 5 Feb 2021 01:28:30 +0000 (17:28 -0800)
commit3e5ce49e5371ce4feadbf97dd5c2b652d9db3d1d
treecd80208ec74d74a595b8fb72e6f1e4e733ae4a26
parentb68a6b09e60a24733b923a0fc282746a855852da
[LV] Unconditionally branch from middle to scalar preheader if the scalar loop must execute

If we know that the scalar epilogue is required to run, modify the CFG to end the middle block with an unconditional branch to scalar preheader. This is instead of a conditional branch to either the preheader or the exit block.

The motivation to do this is to support multiple exit blocks. Specifically, the current structure forces us to identify immediate dominators and *which* exit block to branch from in the middle terminator. For the multiple exit case - where we know require scalar will hold - these questions are ill formed.

This is the last change needed to support multiple exit loops, but since the diffs are already large enough, I'm going to land this, and then enable separately. You can think of this as being NFCI-ish prep work, but the changes are a bit too involved for me to feel comfortable tagging the change that way.

Differential Revision: https://reviews.llvm.org/D94892
llvm/lib/Transforms/Utils/LoopVersioning.cpp
llvm/lib/Transforms/Vectorize/LoopVectorize.cpp
llvm/test/Transforms/LoopVectorize/first-order-recurrence-complex.ll
llvm/test/Transforms/LoopVectorize/interleaved-accesses.ll
llvm/test/Transforms/LoopVectorize/loop-form.ll