JIT: redundant branch destructure dominating and/or by AndyAyersMS · Pull Request #69291 · dotnet/runtime

AndyAyersMS · 2022-05-13T01:53:33Z

If a branch predicate p is dominated by another branch with predicate
AND(p, ..) or OR(p, ...) we may be able to infer the value of p.

This is useful on its own, and should help unblock #62689.

ghost · 2022-05-13T01:53:39Z

Tagging subscribers to this area: @JulieLeeMSFT
See info in area-owners.md if you want to be subscribed.

Issue Details

If a branch predicate p is dominated by another branch with predicate
AND(p, ..) or OR(p, ...) we may be able to infer the value of p.

This is useful on its own, and should help unblock #62689.

Author:	AndyAyersMS
Assignees:	AndyAyersMS
Labels:	`area-CodeGen-coreclr`
Milestone:	-

AndyAyersMS · 2022-05-13T01:56:54Z

@jakobbotsch PTAL
@dotnet/jit-contrib FYI

Not sure how correct this is yet, I can't seem to run pri0 tests locally anymore. Small number of SPMI diffs, but many are sizeable.

I am tempted to recast this as a general VN utility where we can ask if knowing the value of a VN implies knowing the value of another VN; there are lots of other inferences we can draw of this kind. But I'm not sure how to structure this without it getting overly complicated.

jakobbotsch · 2022-05-13T07:20:43Z

/azp run Fuzzlyn

azure-pipelines · 2022-05-13T07:20:57Z

Azure Pipelines successfully started running 1 pipeline(s).

jakobbotsch · 2022-05-13T07:45:01Z

I am tempted to recast this as a general VN utility where we can ask if knowing the value of a VN implies knowing the value of another VN; there are lots of other inferences we can draw of this kind. But I'm not sure how to structure this without it getting overly complicated.
I think this would be great, and in any case it would be nice to extract this to a function to avoid some of the nesting.

I am tempted to recast this as a general VN utility where we can ask if knowing the value of a VN implies knowing the value of another VN; there are lots of other inferences we can draw of this kind. But I'm not sure how to structure this without it getting overly complicated.
I think this would be great, and in any case it would be nice to extract this to a function to avoid some of the nesting
Let me get the logic right and then I'll look into refactoring.

jakobbotsch · 2022-05-13T10:02:08Z

The Fuzzlyn examples may be easier to use than the failing tests to iron out the issues.

AndyAyersMS · 2022-05-13T19:03:04Z

/azp run Fuzzlyn

azure-pipelines · 2022-05-13T19:03:19Z

Azure Pipelines successfully started running 1 pipeline(s).

If a branch predicate `p` is dominated by another branch with predicate `AND(p, ..)` or `OR(p, ...)` we may be able to infer the value of `p`. This is useful on its own, and should help unblock dotnet#62689.

AndyAyersMS · 2022-05-20T05:40:23Z

/azp run Fuzzlyn

azure-pipelines · 2022-05-20T05:40:38Z

Azure Pipelines successfully started running 1 pipeline(s).

AndyAyersMS · 2022-05-22T18:46:39Z

@jakobbotsch see if this version reads any better. I could pull functionality into the helper struct but have left it basic for now.

Looking at a few of the larger diffs I realized that the existing version of redundant branch opts has a bug; if the tree VN is a constant than the outcome of the branch it controls is independent of any dominating branch, but we were (previously) using inferencing here. This lead to at least one instance where we made the wrong deduction, 57396 in coreclr_tests. Fixing this keeps a bunch of code around that should never have been deleted. I added a note to the code indicating that checking for the constant case is necessary and not just nice to have.

Seemingly these constant VN relops are somewhat rare and having more than one in the right arrangement even rarer, which is why we haven't seen complaints about this before.

;; bogus deduction with constant VNs (now fixed)
N002 [000032] CNS_INT 1 => $41 {IntCns 1}
...
Dominator BB01 of BB07 has relop with same liberal VN
N003 ( 5, 4) [000008] J------N--- * LE int $41
N001 ( 3, 2) [000006] ----------- +--* LCL_VAR int V03 loc1 u:2 (last use) $40
N002 ( 1, 1) [000007] ----------- \--* CNS_INT int 0 $40
Redundant compare; current relop:
N003 ( 3, 3) [000259] J------N--- * GE int $41
N001 ( 1, 1) [000260] ----------- +--* LCL_VAR int V04 loc2 u:2 $40
N002 ( 1, 1) [000261] ----------- \--* CNS_INT int -1 $42
Fall through successor BB02 of BB01 reaches, relop must be false

The other large regression 247114 from libraries_tests.pmi also has constant cases but there we ended up getting it right as the dominating predicate was the same predicate (here $42 is 0)

N005 [000047] CNS_INT 0 => $42 {IntCns 0}
...
Dominator BB210 of BB215 has relop with same liberal VN
N003 ( 3, 3) [003642] J------N--- * EQ int $42
N001 ( 1, 1) [000486] ----------- +--* LCL_VAR ref V19 tmp15 u:2 $13c5
N002 ( 1, 1) [003641] ----------- \--* CNS_INT ref null $VN.Null
Redundant compare; current relop:
N003 ( 3, 3) [003711] J------N--- * EQ int $42
N001 ( 1, 1) [000491] ----------- +--* LCL_VAR ref V19 tmp15 u:2 $13c5
N002 ( 1, 1) [003710] ----------- \--* CNS_INT ref null $VN.Null

The large regression in this method seems to come from LSRA finding many more single-def cases to spill upfront. Did not try and drill into this further.

jakobbotsch

LGTM. I'll do a last Fuzzlyn run.

jakobbotsch · 2022-05-23T15:41:09Z

/azp run Fuzzlyn

azure-pipelines · 2022-05-23T15:41:25Z

Azure Pipelines successfully started running 1 pipeline(s).

jakobbotsch · 2022-05-23T15:44:00Z

Wow, great diffs. -1% code size and -3% TP on coreclr_tests, looks like that testout test case really hits this pattern.

AndyAyersMS · 2022-05-23T19:15:22Z

Wow, great diffs. -1% code size and -3% TP on coreclr_tests, looks like that testout test case really hits this pattern.

Turns out those methods were all optimized by the "constant" case. I put "constant" in quotes because we're now looking at the liberal VN for a read of a static that we haven't modified since we set its value and haven't done any in-between heap updates.

We would not optimize these before, eg here's some pre-PR IR post-lower.

N001 [000001] CNS_INT 1 => $42 {IntCns 1}
N002 [000820] IND => <l:$42 {IntCns 1}, c:$500 {MemOpaque:NotInLoop}>
...
------------ BB02 [06B..072) -> BB04 (cond), preds={BB01} succs={BB03,BB04}
N001 ( 2, 10) [000939] H---------- t939 = CNS_INT(h) long 0x177d7f3d9f1 static Fseq[hackishFieldName] $c9
/--* t939 long N002 ( 5, 13) [000820] n---G------ t820 = * IND bool <l:$42, c:$500>
N003 ( 1, 1) [000821] ----------- t821 = CNS_INT int 0 $40
/--* t820 bool +--* t821 int N004 ( 7, 15) [000822] J---G--N--- t822 = * NE int <l:$42, c:$4c2>
/--* t822 int N005 ( 9, 17) [000823] ----G------ * JTRUE void $VN.Void

AndyAyersMS · 2022-05-23T19:17:09Z

Also skimmed Fuzzlyn failures; they don't seem to be related?

jakobbotsch · 2022-05-23T19:25:16Z

Also skimmed Fuzzlyn failures; they don't seem to be related?

Agreed, all of them look like #69659.

EgorBo · 2022-06-28T16:25:37Z

Nice improvements on x64: dotnet/perf-autofiling-issues#5617

ghost added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label May 13, 2022

ghost assigned AndyAyersMS May 13, 2022

jakobbotsch reviewed May 13, 2022
View reviewed changes

runfoappBot mentioned this pull request May 13, 2022
Test failure tracing/eventpipe/providervalidation/providervalidation/providervalidation.sh #59296
Closed

AndyAyersMS added 4 commits May 18, 2022 11:08

JIT: redundant branch destructure dominating and/or
34e4c3f
If a branch predicate `p` is dominated by another branch with predicate `AND(p, ..)` or `OR(p, ...)` we may be able to infer the value of `p`. This is useful on its own, and should help unblock dotnet#62689.

must always check reachability
85b982a

handle constant case directly
36f59a0

fix constant case
d0366d6

AndyAyersMS force-pushed the RedunantBranchOptSeeThroughAndOrCombinedPredicates branch from 0071ece to d0366d6Compare May 20, 2022 01:51

AndyAyersMS added 3 commits May 22, 2022 08:52

refactor
fda3c93

flatten
7374ad7

tweak dump format; add note on constant case
450d24b

jakobbotsch approved these changes May 23, 2022
View reviewed changes

AndyAyersMS merged commit 315c31c into dotnet:mainMay 23, 2022

This was referenced May 24, 2022
emit branchless form of (i >= 0 && j >= 0)/(i!=0&& j!= 0) for signed integers #62689
Merged
[Perf] Changes at 5/23/2022 11:22:48 PM dotnet/perf-autofiling-issues#5560
Closed

tannergooding mentioned this pull request May 31, 2022
[Perf] Changes at 5/23/2022 10:48:42 PM #70027
Closed

ghost locked as resolved and limited conversation to collaborators Jun 23, 2022

Uh oh!

Conversation

AndyAyersMS commented May 13, 2022

Uh oh!

ghost commented May 13, 2022

Uh oh!

AndyAyersMS commented May 13, 2022

Uh oh!

jakobbotsch commented May 13, 2022

Uh oh!

azure-pipelinesBot commented May 13, 2022

Uh oh!

jakobbotschMay 13, 2022

Choose a reason for hiding this comment

Uh oh!

AndyAyersMSMay 13, 2022

Choose a reason for hiding this comment

Uh oh!

jakobbotsch commented May 13, 2022

Uh oh!

AndyAyersMS commented May 13, 2022

Uh oh!

azure-pipelinesBot commented May 13, 2022

Uh oh!

AndyAyersMS commented May 20, 2022

Uh oh!

azure-pipelinesBot commented May 20, 2022

Uh oh!

AndyAyersMS commented May 22, 2022

Uh oh!

jakobbotsch left a comment

Choose a reason for hiding this comment

Uh oh!

jakobbotsch commented May 23, 2022

Uh oh!

azure-pipelinesBot commented May 23, 2022

Uh oh!

jakobbotsch commented May 23, 2022

Uh oh!

AndyAyersMS commented May 23, 2022• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

AndyAyersMS commented May 23, 2022

Uh oh!

jakobbotsch commented May 23, 2022

Uh oh!

EgorBo commented Jun 28, 2022• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

AndyAyersMS commented May 23, 2022•
edited
Loading

EgorBo commented Jun 28, 2022•
edited
Loading