JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars - #95854

Merged
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable
Dec 12, 2023
Merged

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars#95854
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable

Conversation

@jakobbotsch

@jakobbotschjakobbotsch commented Dec 11, 2023

Copy link
Copy Markdown
Member

Invalidate the loop table right after unrolling. Invalidate dominators right after MarkLocalVars.

Diffs come from two sources:

  • Some more RBO since RBO no longer has to worry about maintaining the loop table
  • In some cases when removing edges/blocks we would call optUnmarkLoopBlocks that would unscale the loop blocks

As always there are also quirks that I'll remove separately.

Null out the loop table as part of setting optLoopTableValid = false.
This reveals a few cases where we were using it even after invalidation.
A few diffs expected from the fgCanCompactBlocks change because we now
compact some loop headers.
@ghostghost added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label Dec 11, 2023
@ghost

Copy link
Copy Markdown

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

Issue Details

Null out the loop table as part of setting optLoopTableValid = false. This reveals a few cases where we were using it even after invalidation.

A few diffs expected from the fgCanCompactBlocks change because we now compact some loop headers.

Author:jakobbotsch
Assignees:-
Labels:

area-CodeGen-coreclr

Milestone:-

Comment on lines +1342 to +1348
if (m_comp->optLoopTableValid)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b2);
if (optReturnBlock)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some of these checks are always false, like in this case... I'll remove them all as part of the big code deletion in the future.

@jakobbotschjakobbotsch changed the title JIT: Null out loop table when invalidJIT: Invalidate loop table after unrolling and dominators after MarkLocalVarsDec 11, 2023
Comment on lines 4848 to +4853
DoPhase(this, PHASE_MARK_LOCAL_VARS, &Compiler::lvaMarkLocalVars);

// Dominator and reachability sets are no longer valid.
fgDomsComputed = false;
fgCompactRenumberQuirk = true;

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lvaMarkLocalVars uses Compiler::IsDominatedByExceptionalEntry to set LclVarDsc::lvVolatileHint. That is used by VN-based copy prop as part of the heuristic. My next step will be to compute SSA's dominators after unrolling above and then use those dominators to compute this heuristic instead. That will allow us to move fgDomsComputed up to where the loop table is invalidated as well.

Comment on lines +2392 to +2396
else
{
// TODO-Quirk: Remove
JITDUMP("Renumbering " FMT_BB " to be " FMT_BB " for a quirk\n", block->bbNum, bNext->bbNum);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This quirk has surprisingly large diffs.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

@BruceForstall feel free to take a look at this one if you have time once the diffs are done. I need some extra work for JitOptRepeat (those are the failures), but I don't expect anything substantial to change.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

cc @dotnet/jit-contrib PTAL @BruceForstall

Diffs

Surprisingly large TP wins with the win-x64 host compiler, but seems to be some MSVC related oddity since the other targets don't see the same. The detailed diff shows that it is from the fgCanCompactBlocks change:

Base:151246609045, Diff:150947499733, -0.1978%79307193:+6.15%:16.62%:+0.0524%:public: bool __cdecl Compiler::fgUpdateFlowGraph(bool, bool) 6316694:+173.37%:1.32%:+0.0042%:public: void __cdecl Compiler::optFindNewLoops(void) 1122411:+0.49%:0.24%:+0.0007%:public: void __cdecl Compiler::compInit(classArenaAllocator*, struct CORINFO_METHOD_STRUCT_*, classICorJitInfo*, struct CORINFO_METHOD_INFO*, struct InlineInfo*)
635604:+0.39%:0.13%:+0.0004%:public: void __cdecl Compiler::fgCompactBlocks(struct BasicBlock*, struct BasicBlock*) 614159:+0.07%:0.13%:+0.0004%:public: void __cdecl Compiler::fgPerBlockLocalVarLiveness(void) -751605:-100.00%:0.16%:-0.0005%:public: enumPhaseStatus __cdecl Compiler::optClearLoopIterInfo(void) -1193033:-2.48%:0.25%:-0.0008%:public: classBasicBlock::BBSuccList __cdecl BasicBlock::Succs(void) const -2454913:-0.68%:0.51%:-0.0016%: void __cdecl DoPhase(classCompiler*, enumPhases, enumPhaseStatus (__cdecl Compiler::*)(void)) -2580058:-2.82%:0.54%:-0.0017%:public: bool __cdecl Compiler::fgExpandRarelyRunBlocks(void) -4782745:-56.62%:1.00%:-0.0032%:protected: void __cdecl Compiler::optUpdateLoopsBeforeRemoveBlock(struct BasicBlock*, bool) -5065556:-0.33%:1.06%:-0.0033%: memset -10648527:-22.10%:2.23%:-0.0070%:public: bool __cdecl Compiler::optJumpThreadPhi(struct BasicBlock*const, struct GenTree*, unsigned int) -14403526:-9.11%:3.02%:-0.0095%:public: enumCompiler::FoldResult __cdecl Compiler::fgFoldConditional(struct BasicBlock*) -18271428:-100.00%:3.83%:-0.0121%:public: void __cdecl Compiler::fgUpdateLoopsAfterCompacting(struct BasicBlock*, struct BasicBlock*) -326814374:-89.09%:68.47%:-0.2161%:public: bool __cdecl Compiler::fgCanCompactBlocks(struct BasicBlock*, struct BasicBlock*) 

@jakobbotsch
jakobbotsch merged commit 941c95b into dotnet:mainDec 12, 2023
@jakobbotsch
jakobbotsch deleted the null-out-looptable branch December 12, 2023 17:24
@github-actionsgithub-actionsBot locked and limited conversation to collaborators Jan 12, 2024
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jakobbotsch@BruceForstall
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars - #95854

Merged
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable
Dec 12, 2023
Merged

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars#95854
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable

Conversation

@jakobbotsch

@jakobbotschjakobbotsch commented Dec 11, 2023

Copy link
Copy Markdown
Member

Invalidate the loop table right after unrolling. Invalidate dominators right after MarkLocalVars.

Diffs come from two sources:

  • Some more RBO since RBO no longer has to worry about maintaining the loop table
  • In some cases when removing edges/blocks we would call optUnmarkLoopBlocks that would unscale the loop blocks

As always there are also quirks that I'll remove separately.

Null out the loop table as part of setting optLoopTableValid = false.
This reveals a few cases where we were using it even after invalidation.
A few diffs expected from the fgCanCompactBlocks change because we now
compact some loop headers.
@ghostghost added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label Dec 11, 2023
@ghost

Copy link
Copy Markdown

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

Issue Details

Null out the loop table as part of setting optLoopTableValid = false. This reveals a few cases where we were using it even after invalidation.

A few diffs expected from the fgCanCompactBlocks change because we now compact some loop headers.

Author:jakobbotsch
Assignees:-
Labels:

area-CodeGen-coreclr

Milestone:-

Comment on lines +1342 to +1348
if (m_comp->optLoopTableValid)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b2);
if (optReturnBlock)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some of these checks are always false, like in this case... I'll remove them all as part of the big code deletion in the future.

@jakobbotschjakobbotsch changed the title JIT: Null out loop table when invalidJIT: Invalidate loop table after unrolling and dominators after MarkLocalVarsDec 11, 2023
Comment on lines 4848 to +4853
DoPhase(this, PHASE_MARK_LOCAL_VARS, &Compiler::lvaMarkLocalVars);

// Dominator and reachability sets are no longer valid.
fgDomsComputed = false;
fgCompactRenumberQuirk = true;

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lvaMarkLocalVars uses Compiler::IsDominatedByExceptionalEntry to set LclVarDsc::lvVolatileHint. That is used by VN-based copy prop as part of the heuristic. My next step will be to compute SSA's dominators after unrolling above and then use those dominators to compute this heuristic instead. That will allow us to move fgDomsComputed up to where the loop table is invalidated as well.

Comment on lines +2392 to +2396
else
{
// TODO-Quirk: Remove
JITDUMP("Renumbering " FMT_BB " to be " FMT_BB " for a quirk\n", block->bbNum, bNext->bbNum);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This quirk has surprisingly large diffs.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

@BruceForstall feel free to take a look at this one if you have time once the diffs are done. I need some extra work for JitOptRepeat (those are the failures), but I don't expect anything substantial to change.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

cc @dotnet/jit-contrib PTAL @BruceForstall

Diffs

Surprisingly large TP wins with the win-x64 host compiler, but seems to be some MSVC related oddity since the other targets don't see the same. The detailed diff shows that it is from the fgCanCompactBlocks change:

Base:151246609045, Diff:150947499733, -0.1978%79307193:+6.15%:16.62%:+0.0524%:public: bool __cdecl Compiler::fgUpdateFlowGraph(bool, bool) 6316694:+173.37%:1.32%:+0.0042%:public: void __cdecl Compiler::optFindNewLoops(void) 1122411:+0.49%:0.24%:+0.0007%:public: void __cdecl Compiler::compInit(classArenaAllocator*, struct CORINFO_METHOD_STRUCT_*, classICorJitInfo*, struct CORINFO_METHOD_INFO*, struct InlineInfo*)
635604:+0.39%:0.13%:+0.0004%:public: void __cdecl Compiler::fgCompactBlocks(struct BasicBlock*, struct BasicBlock*) 614159:+0.07%:0.13%:+0.0004%:public: void __cdecl Compiler::fgPerBlockLocalVarLiveness(void) -751605:-100.00%:0.16%:-0.0005%:public: enumPhaseStatus __cdecl Compiler::optClearLoopIterInfo(void) -1193033:-2.48%:0.25%:-0.0008%:public: classBasicBlock::BBSuccList __cdecl BasicBlock::Succs(void) const -2454913:-0.68%:0.51%:-0.0016%: void __cdecl DoPhase(classCompiler*, enumPhases, enumPhaseStatus (__cdecl Compiler::*)(void)) -2580058:-2.82%:0.54%:-0.0017%:public: bool __cdecl Compiler::fgExpandRarelyRunBlocks(void) -4782745:-56.62%:1.00%:-0.0032%:protected: void __cdecl Compiler::optUpdateLoopsBeforeRemoveBlock(struct BasicBlock*, bool) -5065556:-0.33%:1.06%:-0.0033%: memset -10648527:-22.10%:2.23%:-0.0070%:public: bool __cdecl Compiler::optJumpThreadPhi(struct BasicBlock*const, struct GenTree*, unsigned int) -14403526:-9.11%:3.02%:-0.0095%:public: enumCompiler::FoldResult __cdecl Compiler::fgFoldConditional(struct BasicBlock*) -18271428:-100.00%:3.83%:-0.0121%:public: void __cdecl Compiler::fgUpdateLoopsAfterCompacting(struct BasicBlock*, struct BasicBlock*) -326814374:-89.09%:68.47%:-0.2161%:public: bool __cdecl Compiler::fgCanCompactBlocks(struct BasicBlock*, struct BasicBlock*) 

@jakobbotsch
jakobbotsch merged commit 941c95b into dotnet:mainDec 12, 2023
@jakobbotsch
jakobbotsch deleted the null-out-looptable branch December 12, 2023 17:24
@github-actionsgithub-actionsBot locked and limited conversation to collaborators Jan 12, 2024
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jakobbotsch@BruceForstall
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars - #95854

Merged
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable
Dec 12, 2023
Merged

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars#95854
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable

Conversation

@jakobbotsch

@jakobbotschjakobbotsch commented Dec 11, 2023

Copy link
Copy Markdown
Member

Invalidate the loop table right after unrolling. Invalidate dominators right after MarkLocalVars.

Diffs come from two sources:

  • Some more RBO since RBO no longer has to worry about maintaining the loop table
  • In some cases when removing edges/blocks we would call optUnmarkLoopBlocks that would unscale the loop blocks

As always there are also quirks that I'll remove separately.

Null out the loop table as part of setting optLoopTableValid = false.
This reveals a few cases where we were using it even after invalidation.
A few diffs expected from the fgCanCompactBlocks change because we now
compact some loop headers.
@ghostghost added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label Dec 11, 2023
@ghost

Copy link
Copy Markdown

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

Issue Details

Null out the loop table as part of setting optLoopTableValid = false. This reveals a few cases where we were using it even after invalidation.

A few diffs expected from the fgCanCompactBlocks change because we now compact some loop headers.

Author:jakobbotsch
Assignees:-
Labels:

area-CodeGen-coreclr

Milestone:-

Comment on lines +1342 to +1348
if (m_comp->optLoopTableValid)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b2);
if (optReturnBlock)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some of these checks are always false, like in this case... I'll remove them all as part of the big code deletion in the future.

@jakobbotschjakobbotsch changed the title JIT: Null out loop table when invalidJIT: Invalidate loop table after unrolling and dominators after MarkLocalVarsDec 11, 2023
Comment on lines 4848 to +4853
DoPhase(this, PHASE_MARK_LOCAL_VARS, &Compiler::lvaMarkLocalVars);

// Dominator and reachability sets are no longer valid.
fgDomsComputed = false;
fgCompactRenumberQuirk = true;

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lvaMarkLocalVars uses Compiler::IsDominatedByExceptionalEntry to set LclVarDsc::lvVolatileHint. That is used by VN-based copy prop as part of the heuristic. My next step will be to compute SSA's dominators after unrolling above and then use those dominators to compute this heuristic instead. That will allow us to move fgDomsComputed up to where the loop table is invalidated as well.

Comment on lines +2392 to +2396
else
{
// TODO-Quirk: Remove
JITDUMP("Renumbering " FMT_BB " to be " FMT_BB " for a quirk\n", block->bbNum, bNext->bbNum);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This quirk has surprisingly large diffs.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

@BruceForstall feel free to take a look at this one if you have time once the diffs are done. I need some extra work for JitOptRepeat (those are the failures), but I don't expect anything substantial to change.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

cc @dotnet/jit-contrib PTAL @BruceForstall

Diffs

Surprisingly large TP wins with the win-x64 host compiler, but seems to be some MSVC related oddity since the other targets don't see the same. The detailed diff shows that it is from the fgCanCompactBlocks change:

Base:151246609045, Diff:150947499733, -0.1978%79307193:+6.15%:16.62%:+0.0524%:public: bool __cdecl Compiler::fgUpdateFlowGraph(bool, bool) 6316694:+173.37%:1.32%:+0.0042%:public: void __cdecl Compiler::optFindNewLoops(void) 1122411:+0.49%:0.24%:+0.0007%:public: void __cdecl Compiler::compInit(classArenaAllocator*, struct CORINFO_METHOD_STRUCT_*, classICorJitInfo*, struct CORINFO_METHOD_INFO*, struct InlineInfo*)
635604:+0.39%:0.13%:+0.0004%:public: void __cdecl Compiler::fgCompactBlocks(struct BasicBlock*, struct BasicBlock*) 614159:+0.07%:0.13%:+0.0004%:public: void __cdecl Compiler::fgPerBlockLocalVarLiveness(void) -751605:-100.00%:0.16%:-0.0005%:public: enumPhaseStatus __cdecl Compiler::optClearLoopIterInfo(void) -1193033:-2.48%:0.25%:-0.0008%:public: classBasicBlock::BBSuccList __cdecl BasicBlock::Succs(void) const -2454913:-0.68%:0.51%:-0.0016%: void __cdecl DoPhase(classCompiler*, enumPhases, enumPhaseStatus (__cdecl Compiler::*)(void)) -2580058:-2.82%:0.54%:-0.0017%:public: bool __cdecl Compiler::fgExpandRarelyRunBlocks(void) -4782745:-56.62%:1.00%:-0.0032%:protected: void __cdecl Compiler::optUpdateLoopsBeforeRemoveBlock(struct BasicBlock*, bool) -5065556:-0.33%:1.06%:-0.0033%: memset -10648527:-22.10%:2.23%:-0.0070%:public: bool __cdecl Compiler::optJumpThreadPhi(struct BasicBlock*const, struct GenTree*, unsigned int) -14403526:-9.11%:3.02%:-0.0095%:public: enumCompiler::FoldResult __cdecl Compiler::fgFoldConditional(struct BasicBlock*) -18271428:-100.00%:3.83%:-0.0121%:public: void __cdecl Compiler::fgUpdateLoopsAfterCompacting(struct BasicBlock*, struct BasicBlock*) -326814374:-89.09%:68.47%:-0.2161%:public: bool __cdecl Compiler::fgCanCompactBlocks(struct BasicBlock*, struct BasicBlock*) 

@jakobbotsch
jakobbotsch merged commit 941c95b into dotnet:mainDec 12, 2023
@jakobbotsch
jakobbotsch deleted the null-out-looptable branch December 12, 2023 17:24
@github-actionsgithub-actionsBot locked and limited conversation to collaborators Jan 12, 2024
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jakobbotsch@BruceForstall
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars - #95854

Merged
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable
Dec 12, 2023
Merged

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars#95854
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable

Conversation

@jakobbotsch

@jakobbotschjakobbotsch commented Dec 11, 2023

Copy link
Copy Markdown
Member

Invalidate the loop table right after unrolling. Invalidate dominators right after MarkLocalVars.

Diffs come from two sources:

  • Some more RBO since RBO no longer has to worry about maintaining the loop table
  • In some cases when removing edges/blocks we would call optUnmarkLoopBlocks that would unscale the loop blocks

As always there are also quirks that I'll remove separately.

Null out the loop table as part of setting optLoopTableValid = false.
This reveals a few cases where we were using it even after invalidation.
A few diffs expected from the fgCanCompactBlocks change because we now
compact some loop headers.
@ghostghost added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label Dec 11, 2023
@ghost

Copy link
Copy Markdown

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

Issue Details

Null out the loop table as part of setting optLoopTableValid = false. This reveals a few cases where we were using it even after invalidation.

A few diffs expected from the fgCanCompactBlocks change because we now compact some loop headers.

Author:jakobbotsch
Assignees:-
Labels:

area-CodeGen-coreclr

Milestone:-

Comment on lines +1342 to +1348
if (m_comp->optLoopTableValid)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b2);
if (optReturnBlock)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some of these checks are always false, like in this case... I'll remove them all as part of the big code deletion in the future.

@jakobbotschjakobbotsch changed the title JIT: Null out loop table when invalidJIT: Invalidate loop table after unrolling and dominators after MarkLocalVarsDec 11, 2023
Comment on lines 4848 to +4853
DoPhase(this, PHASE_MARK_LOCAL_VARS, &Compiler::lvaMarkLocalVars);

// Dominator and reachability sets are no longer valid.
fgDomsComputed = false;
fgCompactRenumberQuirk = true;

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lvaMarkLocalVars uses Compiler::IsDominatedByExceptionalEntry to set LclVarDsc::lvVolatileHint. That is used by VN-based copy prop as part of the heuristic. My next step will be to compute SSA's dominators after unrolling above and then use those dominators to compute this heuristic instead. That will allow us to move fgDomsComputed up to where the loop table is invalidated as well.

Comment on lines +2392 to +2396
else
{
// TODO-Quirk: Remove
JITDUMP("Renumbering " FMT_BB " to be " FMT_BB " for a quirk\n", block->bbNum, bNext->bbNum);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This quirk has surprisingly large diffs.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

@BruceForstall feel free to take a look at this one if you have time once the diffs are done. I need some extra work for JitOptRepeat (those are the failures), but I don't expect anything substantial to change.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

cc @dotnet/jit-contrib PTAL @BruceForstall

Diffs

Surprisingly large TP wins with the win-x64 host compiler, but seems to be some MSVC related oddity since the other targets don't see the same. The detailed diff shows that it is from the fgCanCompactBlocks change:

Base:151246609045, Diff:150947499733, -0.1978%79307193:+6.15%:16.62%:+0.0524%:public: bool __cdecl Compiler::fgUpdateFlowGraph(bool, bool) 6316694:+173.37%:1.32%:+0.0042%:public: void __cdecl Compiler::optFindNewLoops(void) 1122411:+0.49%:0.24%:+0.0007%:public: void __cdecl Compiler::compInit(classArenaAllocator*, struct CORINFO_METHOD_STRUCT_*, classICorJitInfo*, struct CORINFO_METHOD_INFO*, struct InlineInfo*)
635604:+0.39%:0.13%:+0.0004%:public: void __cdecl Compiler::fgCompactBlocks(struct BasicBlock*, struct BasicBlock*) 614159:+0.07%:0.13%:+0.0004%:public: void __cdecl Compiler::fgPerBlockLocalVarLiveness(void) -751605:-100.00%:0.16%:-0.0005%:public: enumPhaseStatus __cdecl Compiler::optClearLoopIterInfo(void) -1193033:-2.48%:0.25%:-0.0008%:public: classBasicBlock::BBSuccList __cdecl BasicBlock::Succs(void) const -2454913:-0.68%:0.51%:-0.0016%: void __cdecl DoPhase(classCompiler*, enumPhases, enumPhaseStatus (__cdecl Compiler::*)(void)) -2580058:-2.82%:0.54%:-0.0017%:public: bool __cdecl Compiler::fgExpandRarelyRunBlocks(void) -4782745:-56.62%:1.00%:-0.0032%:protected: void __cdecl Compiler::optUpdateLoopsBeforeRemoveBlock(struct BasicBlock*, bool) -5065556:-0.33%:1.06%:-0.0033%: memset -10648527:-22.10%:2.23%:-0.0070%:public: bool __cdecl Compiler::optJumpThreadPhi(struct BasicBlock*const, struct GenTree*, unsigned int) -14403526:-9.11%:3.02%:-0.0095%:public: enumCompiler::FoldResult __cdecl Compiler::fgFoldConditional(struct BasicBlock*) -18271428:-100.00%:3.83%:-0.0121%:public: void __cdecl Compiler::fgUpdateLoopsAfterCompacting(struct BasicBlock*, struct BasicBlock*) -326814374:-89.09%:68.47%:-0.2161%:public: bool __cdecl Compiler::fgCanCompactBlocks(struct BasicBlock*, struct BasicBlock*) 

@jakobbotsch
jakobbotsch merged commit 941c95b into dotnet:mainDec 12, 2023
@jakobbotsch
jakobbotsch deleted the null-out-looptable branch December 12, 2023 17:24
@github-actionsgithub-actionsBot locked and limited conversation to collaborators Jan 12, 2024
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jakobbotsch@BruceForstall
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars - #95854

Merged
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable
Dec 12, 2023
Merged

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars#95854
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable

Conversation

@jakobbotsch

@jakobbotschjakobbotsch commented Dec 11, 2023

Copy link
Copy Markdown
Member

Invalidate the loop table right after unrolling. Invalidate dominators right after MarkLocalVars.

Diffs come from two sources:

  • Some more RBO since RBO no longer has to worry about maintaining the loop table
  • In some cases when removing edges/blocks we would call optUnmarkLoopBlocks that would unscale the loop blocks

As always there are also quirks that I'll remove separately.

Null out the loop table as part of setting optLoopTableValid = false.
This reveals a few cases where we were using it even after invalidation.
A few diffs expected from the fgCanCompactBlocks change because we now
compact some loop headers.
@ghostghost added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label Dec 11, 2023
@ghost

Copy link
Copy Markdown

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

Issue Details

Null out the loop table as part of setting optLoopTableValid = false. This reveals a few cases where we were using it even after invalidation.

A few diffs expected from the fgCanCompactBlocks change because we now compact some loop headers.

Author:jakobbotsch
Assignees:-
Labels:

area-CodeGen-coreclr

Milestone:-

Comment on lines +1342 to +1348
if (m_comp->optLoopTableValid)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b2);
if (optReturnBlock)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some of these checks are always false, like in this case... I'll remove them all as part of the big code deletion in the future.

@jakobbotschjakobbotsch changed the title JIT: Null out loop table when invalidJIT: Invalidate loop table after unrolling and dominators after MarkLocalVarsDec 11, 2023
Comment on lines 4848 to +4853
DoPhase(this, PHASE_MARK_LOCAL_VARS, &Compiler::lvaMarkLocalVars);

// Dominator and reachability sets are no longer valid.
fgDomsComputed = false;
fgCompactRenumberQuirk = true;

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lvaMarkLocalVars uses Compiler::IsDominatedByExceptionalEntry to set LclVarDsc::lvVolatileHint. That is used by VN-based copy prop as part of the heuristic. My next step will be to compute SSA's dominators after unrolling above and then use those dominators to compute this heuristic instead. That will allow us to move fgDomsComputed up to where the loop table is invalidated as well.

Comment on lines +2392 to +2396
else
{
// TODO-Quirk: Remove
JITDUMP("Renumbering " FMT_BB " to be " FMT_BB " for a quirk\n", block->bbNum, bNext->bbNum);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This quirk has surprisingly large diffs.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

@BruceForstall feel free to take a look at this one if you have time once the diffs are done. I need some extra work for JitOptRepeat (those are the failures), but I don't expect anything substantial to change.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

cc @dotnet/jit-contrib PTAL @BruceForstall

Diffs

Surprisingly large TP wins with the win-x64 host compiler, but seems to be some MSVC related oddity since the other targets don't see the same. The detailed diff shows that it is from the fgCanCompactBlocks change:

Base:151246609045, Diff:150947499733, -0.1978%79307193:+6.15%:16.62%:+0.0524%:public: bool __cdecl Compiler::fgUpdateFlowGraph(bool, bool) 6316694:+173.37%:1.32%:+0.0042%:public: void __cdecl Compiler::optFindNewLoops(void) 1122411:+0.49%:0.24%:+0.0007%:public: void __cdecl Compiler::compInit(classArenaAllocator*, struct CORINFO_METHOD_STRUCT_*, classICorJitInfo*, struct CORINFO_METHOD_INFO*, struct InlineInfo*)
635604:+0.39%:0.13%:+0.0004%:public: void __cdecl Compiler::fgCompactBlocks(struct BasicBlock*, struct BasicBlock*) 614159:+0.07%:0.13%:+0.0004%:public: void __cdecl Compiler::fgPerBlockLocalVarLiveness(void) -751605:-100.00%:0.16%:-0.0005%:public: enumPhaseStatus __cdecl Compiler::optClearLoopIterInfo(void) -1193033:-2.48%:0.25%:-0.0008%:public: classBasicBlock::BBSuccList __cdecl BasicBlock::Succs(void) const -2454913:-0.68%:0.51%:-0.0016%: void __cdecl DoPhase(classCompiler*, enumPhases, enumPhaseStatus (__cdecl Compiler::*)(void)) -2580058:-2.82%:0.54%:-0.0017%:public: bool __cdecl Compiler::fgExpandRarelyRunBlocks(void) -4782745:-56.62%:1.00%:-0.0032%:protected: void __cdecl Compiler::optUpdateLoopsBeforeRemoveBlock(struct BasicBlock*, bool) -5065556:-0.33%:1.06%:-0.0033%: memset -10648527:-22.10%:2.23%:-0.0070%:public: bool __cdecl Compiler::optJumpThreadPhi(struct BasicBlock*const, struct GenTree*, unsigned int) -14403526:-9.11%:3.02%:-0.0095%:public: enumCompiler::FoldResult __cdecl Compiler::fgFoldConditional(struct BasicBlock*) -18271428:-100.00%:3.83%:-0.0121%:public: void __cdecl Compiler::fgUpdateLoopsAfterCompacting(struct BasicBlock*, struct BasicBlock*) -326814374:-89.09%:68.47%:-0.2161%:public: bool __cdecl Compiler::fgCanCompactBlocks(struct BasicBlock*, struct BasicBlock*) 

@jakobbotsch
jakobbotsch merged commit 941c95b into dotnet:mainDec 12, 2023
@jakobbotsch
jakobbotsch deleted the null-out-looptable branch December 12, 2023 17:24
@github-actionsgithub-actionsBot locked and limited conversation to collaborators Jan 12, 2024
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jakobbotsch@BruceForstall
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars - #95854

Merged
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable
Dec 12, 2023
Merged

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars#95854
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable

Conversation

@jakobbotsch

@jakobbotschjakobbotsch commented Dec 11, 2023

Copy link
Copy Markdown
Member

Invalidate the loop table right after unrolling. Invalidate dominators right after MarkLocalVars.

Diffs come from two sources:

  • Some more RBO since RBO no longer has to worry about maintaining the loop table
  • In some cases when removing edges/blocks we would call optUnmarkLoopBlocks that would unscale the loop blocks

As always there are also quirks that I'll remove separately.

Null out the loop table as part of setting optLoopTableValid = false.
This reveals a few cases where we were using it even after invalidation.
A few diffs expected from the fgCanCompactBlocks change because we now
compact some loop headers.
@ghostghost added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label Dec 11, 2023
@ghost

Copy link
Copy Markdown

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

Issue Details

Null out the loop table as part of setting optLoopTableValid = false. This reveals a few cases where we were using it even after invalidation.

A few diffs expected from the fgCanCompactBlocks change because we now compact some loop headers.

Author:jakobbotsch
Assignees:-
Labels:

area-CodeGen-coreclr

Milestone:-

Comment on lines +1342 to +1348
if (m_comp->optLoopTableValid)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b2);
if (optReturnBlock)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some of these checks are always false, like in this case... I'll remove them all as part of the big code deletion in the future.

@jakobbotschjakobbotsch changed the title JIT: Null out loop table when invalidJIT: Invalidate loop table after unrolling and dominators after MarkLocalVarsDec 11, 2023
Comment on lines 4848 to +4853
DoPhase(this, PHASE_MARK_LOCAL_VARS, &Compiler::lvaMarkLocalVars);

// Dominator and reachability sets are no longer valid.
fgDomsComputed = false;
fgCompactRenumberQuirk = true;

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lvaMarkLocalVars uses Compiler::IsDominatedByExceptionalEntry to set LclVarDsc::lvVolatileHint. That is used by VN-based copy prop as part of the heuristic. My next step will be to compute SSA's dominators after unrolling above and then use those dominators to compute this heuristic instead. That will allow us to move fgDomsComputed up to where the loop table is invalidated as well.

Comment on lines +2392 to +2396
else
{
// TODO-Quirk: Remove
JITDUMP("Renumbering " FMT_BB " to be " FMT_BB " for a quirk\n", block->bbNum, bNext->bbNum);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This quirk has surprisingly large diffs.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

@BruceForstall feel free to take a look at this one if you have time once the diffs are done. I need some extra work for JitOptRepeat (those are the failures), but I don't expect anything substantial to change.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

cc @dotnet/jit-contrib PTAL @BruceForstall

Diffs

Surprisingly large TP wins with the win-x64 host compiler, but seems to be some MSVC related oddity since the other targets don't see the same. The detailed diff shows that it is from the fgCanCompactBlocks change:

Base:151246609045, Diff:150947499733, -0.1978%79307193:+6.15%:16.62%:+0.0524%:public: bool __cdecl Compiler::fgUpdateFlowGraph(bool, bool) 6316694:+173.37%:1.32%:+0.0042%:public: void __cdecl Compiler::optFindNewLoops(void) 1122411:+0.49%:0.24%:+0.0007%:public: void __cdecl Compiler::compInit(classArenaAllocator*, struct CORINFO_METHOD_STRUCT_*, classICorJitInfo*, struct CORINFO_METHOD_INFO*, struct InlineInfo*)
635604:+0.39%:0.13%:+0.0004%:public: void __cdecl Compiler::fgCompactBlocks(struct BasicBlock*, struct BasicBlock*) 614159:+0.07%:0.13%:+0.0004%:public: void __cdecl Compiler::fgPerBlockLocalVarLiveness(void) -751605:-100.00%:0.16%:-0.0005%:public: enumPhaseStatus __cdecl Compiler::optClearLoopIterInfo(void) -1193033:-2.48%:0.25%:-0.0008%:public: classBasicBlock::BBSuccList __cdecl BasicBlock::Succs(void) const -2454913:-0.68%:0.51%:-0.0016%: void __cdecl DoPhase(classCompiler*, enumPhases, enumPhaseStatus (__cdecl Compiler::*)(void)) -2580058:-2.82%:0.54%:-0.0017%:public: bool __cdecl Compiler::fgExpandRarelyRunBlocks(void) -4782745:-56.62%:1.00%:-0.0032%:protected: void __cdecl Compiler::optUpdateLoopsBeforeRemoveBlock(struct BasicBlock*, bool) -5065556:-0.33%:1.06%:-0.0033%: memset -10648527:-22.10%:2.23%:-0.0070%:public: bool __cdecl Compiler::optJumpThreadPhi(struct BasicBlock*const, struct GenTree*, unsigned int) -14403526:-9.11%:3.02%:-0.0095%:public: enumCompiler::FoldResult __cdecl Compiler::fgFoldConditional(struct BasicBlock*) -18271428:-100.00%:3.83%:-0.0121%:public: void __cdecl Compiler::fgUpdateLoopsAfterCompacting(struct BasicBlock*, struct BasicBlock*) -326814374:-89.09%:68.47%:-0.2161%:public: bool __cdecl Compiler::fgCanCompactBlocks(struct BasicBlock*, struct BasicBlock*) 

@jakobbotsch
jakobbotsch merged commit 941c95b into dotnet:mainDec 12, 2023
@jakobbotsch
jakobbotsch deleted the null-out-looptable branch December 12, 2023 17:24
@github-actionsgithub-actionsBot locked and limited conversation to collaborators Jan 12, 2024
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jakobbotsch@BruceForstall
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars - #95854

Merged
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable
Dec 12, 2023
Merged

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars#95854
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable

Conversation

@jakobbotsch

@jakobbotschjakobbotsch commented Dec 11, 2023

Copy link
Copy Markdown
Member

Invalidate the loop table right after unrolling. Invalidate dominators right after MarkLocalVars.

Diffs come from two sources:

  • Some more RBO since RBO no longer has to worry about maintaining the loop table
  • In some cases when removing edges/blocks we would call optUnmarkLoopBlocks that would unscale the loop blocks

As always there are also quirks that I'll remove separately.

Null out the loop table as part of setting optLoopTableValid = false.
This reveals a few cases where we were using it even after invalidation.
A few diffs expected from the fgCanCompactBlocks change because we now
compact some loop headers.
@ghostghost added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label Dec 11, 2023
@ghost

Copy link
Copy Markdown

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

Issue Details

Null out the loop table as part of setting optLoopTableValid = false. This reveals a few cases where we were using it even after invalidation.

A few diffs expected from the fgCanCompactBlocks change because we now compact some loop headers.

Author:jakobbotsch
Assignees:-
Labels:

area-CodeGen-coreclr

Milestone:-

Comment on lines +1342 to +1348
if (m_comp->optLoopTableValid)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b2);
if (optReturnBlock)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some of these checks are always false, like in this case... I'll remove them all as part of the big code deletion in the future.

@jakobbotschjakobbotsch changed the title JIT: Null out loop table when invalidJIT: Invalidate loop table after unrolling and dominators after MarkLocalVarsDec 11, 2023
Comment on lines 4848 to +4853
DoPhase(this, PHASE_MARK_LOCAL_VARS, &Compiler::lvaMarkLocalVars);

// Dominator and reachability sets are no longer valid.
fgDomsComputed = false;
fgCompactRenumberQuirk = true;

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lvaMarkLocalVars uses Compiler::IsDominatedByExceptionalEntry to set LclVarDsc::lvVolatileHint. That is used by VN-based copy prop as part of the heuristic. My next step will be to compute SSA's dominators after unrolling above and then use those dominators to compute this heuristic instead. That will allow us to move fgDomsComputed up to where the loop table is invalidated as well.

Comment on lines +2392 to +2396
else
{
// TODO-Quirk: Remove
JITDUMP("Renumbering " FMT_BB " to be " FMT_BB " for a quirk\n", block->bbNum, bNext->bbNum);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This quirk has surprisingly large diffs.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

@BruceForstall feel free to take a look at this one if you have time once the diffs are done. I need some extra work for JitOptRepeat (those are the failures), but I don't expect anything substantial to change.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

cc @dotnet/jit-contrib PTAL @BruceForstall

Diffs

Surprisingly large TP wins with the win-x64 host compiler, but seems to be some MSVC related oddity since the other targets don't see the same. The detailed diff shows that it is from the fgCanCompactBlocks change:

Base:151246609045, Diff:150947499733, -0.1978%79307193:+6.15%:16.62%:+0.0524%:public: bool __cdecl Compiler::fgUpdateFlowGraph(bool, bool) 6316694:+173.37%:1.32%:+0.0042%:public: void __cdecl Compiler::optFindNewLoops(void) 1122411:+0.49%:0.24%:+0.0007%:public: void __cdecl Compiler::compInit(classArenaAllocator*, struct CORINFO_METHOD_STRUCT_*, classICorJitInfo*, struct CORINFO_METHOD_INFO*, struct InlineInfo*)
635604:+0.39%:0.13%:+0.0004%:public: void __cdecl Compiler::fgCompactBlocks(struct BasicBlock*, struct BasicBlock*) 614159:+0.07%:0.13%:+0.0004%:public: void __cdecl Compiler::fgPerBlockLocalVarLiveness(void) -751605:-100.00%:0.16%:-0.0005%:public: enumPhaseStatus __cdecl Compiler::optClearLoopIterInfo(void) -1193033:-2.48%:0.25%:-0.0008%:public: classBasicBlock::BBSuccList __cdecl BasicBlock::Succs(void) const -2454913:-0.68%:0.51%:-0.0016%: void __cdecl DoPhase(classCompiler*, enumPhases, enumPhaseStatus (__cdecl Compiler::*)(void)) -2580058:-2.82%:0.54%:-0.0017%:public: bool __cdecl Compiler::fgExpandRarelyRunBlocks(void) -4782745:-56.62%:1.00%:-0.0032%:protected: void __cdecl Compiler::optUpdateLoopsBeforeRemoveBlock(struct BasicBlock*, bool) -5065556:-0.33%:1.06%:-0.0033%: memset -10648527:-22.10%:2.23%:-0.0070%:public: bool __cdecl Compiler::optJumpThreadPhi(struct BasicBlock*const, struct GenTree*, unsigned int) -14403526:-9.11%:3.02%:-0.0095%:public: enumCompiler::FoldResult __cdecl Compiler::fgFoldConditional(struct BasicBlock*) -18271428:-100.00%:3.83%:-0.0121%:public: void __cdecl Compiler::fgUpdateLoopsAfterCompacting(struct BasicBlock*, struct BasicBlock*) -326814374:-89.09%:68.47%:-0.2161%:public: bool __cdecl Compiler::fgCanCompactBlocks(struct BasicBlock*, struct BasicBlock*) 

@jakobbotsch
jakobbotsch merged commit 941c95b into dotnet:mainDec 12, 2023
@jakobbotsch
jakobbotsch deleted the null-out-looptable branch December 12, 2023 17:24
@github-actionsgithub-actionsBot locked and limited conversation to collaborators Jan 12, 2024
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jakobbotsch@BruceForstall
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars - #95854

Merged
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable
Dec 12, 2023
Merged

JIT: Invalidate loop table after unrolling and dominators after MarkLocalVars#95854
jakobbotsch merged 9 commits into
dotnet:mainfrom
jakobbotsch:null-out-looptable

Conversation

@jakobbotsch

@jakobbotschjakobbotsch commented Dec 11, 2023

Copy link
Copy Markdown
Member

Invalidate the loop table right after unrolling. Invalidate dominators right after MarkLocalVars.

Diffs come from two sources:

  • Some more RBO since RBO no longer has to worry about maintaining the loop table
  • In some cases when removing edges/blocks we would call optUnmarkLoopBlocks that would unscale the loop blocks

As always there are also quirks that I'll remove separately.

Null out the loop table as part of setting optLoopTableValid = false.
This reveals a few cases where we were using it even after invalidation.
A few diffs expected from the fgCanCompactBlocks change because we now
compact some loop headers.
@ghostghost added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label Dec 11, 2023
@ghost

Copy link
Copy Markdown

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

Issue Details

Null out the loop table as part of setting optLoopTableValid = false. This reveals a few cases where we were using it even after invalidation.

A few diffs expected from the fgCanCompactBlocks change because we now compact some loop headers.

Author:jakobbotsch
Assignees:-
Labels:

area-CodeGen-coreclr

Milestone:-

Comment on lines +1342 to +1348
if (m_comp->optLoopTableValid)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b2);
if (optReturnBlock)
{
m_comp->fgUpdateLoopsAfterCompacting(m_b1, m_b3);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some of these checks are always false, like in this case... I'll remove them all as part of the big code deletion in the future.

@jakobbotschjakobbotsch changed the title JIT: Null out loop table when invalidJIT: Invalidate loop table after unrolling and dominators after MarkLocalVarsDec 11, 2023
Comment on lines 4848 to +4853
DoPhase(this, PHASE_MARK_LOCAL_VARS, &Compiler::lvaMarkLocalVars);

// Dominator and reachability sets are no longer valid.
fgDomsComputed = false;
fgCompactRenumberQuirk = true;

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lvaMarkLocalVars uses Compiler::IsDominatedByExceptionalEntry to set LclVarDsc::lvVolatileHint. That is used by VN-based copy prop as part of the heuristic. My next step will be to compute SSA's dominators after unrolling above and then use those dominators to compute this heuristic instead. That will allow us to move fgDomsComputed up to where the loop table is invalidated as well.

Comment on lines +2392 to +2396
else
{
// TODO-Quirk: Remove
JITDUMP("Renumbering " FMT_BB " to be " FMT_BB " for a quirk\n", block->bbNum, bNext->bbNum);
}

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This quirk has surprisingly large diffs.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

@BruceForstall feel free to take a look at this one if you have time once the diffs are done. I need some extra work for JitOptRepeat (those are the failures), but I don't expect anything substantial to change.

@jakobbotsch

Copy link
Copy Markdown
MemberAuthor

cc @dotnet/jit-contrib PTAL @BruceForstall

Diffs

Surprisingly large TP wins with the win-x64 host compiler, but seems to be some MSVC related oddity since the other targets don't see the same. The detailed diff shows that it is from the fgCanCompactBlocks change:

Base:151246609045, Diff:150947499733, -0.1978%79307193:+6.15%:16.62%:+0.0524%:public: bool __cdecl Compiler::fgUpdateFlowGraph(bool, bool) 6316694:+173.37%:1.32%:+0.0042%:public: void __cdecl Compiler::optFindNewLoops(void) 1122411:+0.49%:0.24%:+0.0007%:public: void __cdecl Compiler::compInit(classArenaAllocator*, struct CORINFO_METHOD_STRUCT_*, classICorJitInfo*, struct CORINFO_METHOD_INFO*, struct InlineInfo*)
635604:+0.39%:0.13%:+0.0004%:public: void __cdecl Compiler::fgCompactBlocks(struct BasicBlock*, struct BasicBlock*) 614159:+0.07%:0.13%:+0.0004%:public: void __cdecl Compiler::fgPerBlockLocalVarLiveness(void) -751605:-100.00%:0.16%:-0.0005%:public: enumPhaseStatus __cdecl Compiler::optClearLoopIterInfo(void) -1193033:-2.48%:0.25%:-0.0008%:public: classBasicBlock::BBSuccList __cdecl BasicBlock::Succs(void) const -2454913:-0.68%:0.51%:-0.0016%: void __cdecl DoPhase(classCompiler*, enumPhases, enumPhaseStatus (__cdecl Compiler::*)(void)) -2580058:-2.82%:0.54%:-0.0017%:public: bool __cdecl Compiler::fgExpandRarelyRunBlocks(void) -4782745:-56.62%:1.00%:-0.0032%:protected: void __cdecl Compiler::optUpdateLoopsBeforeRemoveBlock(struct BasicBlock*, bool) -5065556:-0.33%:1.06%:-0.0033%: memset -10648527:-22.10%:2.23%:-0.0070%:public: bool __cdecl Compiler::optJumpThreadPhi(struct BasicBlock*const, struct GenTree*, unsigned int) -14403526:-9.11%:3.02%:-0.0095%:public: enumCompiler::FoldResult __cdecl Compiler::fgFoldConditional(struct BasicBlock*) -18271428:-100.00%:3.83%:-0.0121%:public: void __cdecl Compiler::fgUpdateLoopsAfterCompacting(struct BasicBlock*, struct BasicBlock*) -326814374:-89.09%:68.47%:-0.2161%:public: bool __cdecl Compiler::fgCanCompactBlocks(struct BasicBlock*, struct BasicBlock*) 

@jakobbotsch
jakobbotsch merged commit 941c95b into dotnet:mainDec 12, 2023
@jakobbotsch
jakobbotsch deleted the null-out-looptable branch December 12, 2023 17:24
@github-actionsgithub-actionsBot locked and limited conversation to collaborators Jan 12, 2024
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jakobbotsch@BruceForstall