[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method. - #125900

Merged
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov
Apr 8, 2026
Merged

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method.#125900
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov

Conversation

@VSadov

@VSadovVSadov commented Mar 22, 2026

Copy link
Copy Markdown
Member

Contributes to: #124238

(Note: this does not deal with the Task<T> -> SomeCustomType return override. That will need a completely different fix, - no special thunks needed in that case).

== The problem:

When we have Task-returning method overriden with Task<T>-returning method, in the paralell "async space" we see a void-returning base logically overridden with a T-returning derived. That cannot work as-is in a virtual call as the caller/calee would be in disagreement whether there is a need for the return buffer and for a return slot in the continuation.
We need a thunk that could override the void-returning base and bridge into derived methods that are now in the T-returning virtual slot.

There are some additional inconveniences from the part that method descs/slots are added very early in the type system construction when we may not know exact types returned by the base/derived.
However, since Task<T> has uncomplicated base hierarchy, we can figure with good certainty that we may have Task<T> -> Task case.

== Implementation strategy.

  • Introduce a special kind of an async variant that has the same signature as the regular T-returning async variant, except that it is void-returning. The body of this new variant simply calls the T-returning async variant and then ignores the return.

  • In a case when we may have Task -> Task<T> return override, we introduce 2 async variants for the overriding method.
    I.E. we may end up with 3 method descs/bodies that represent the same method definition in IL:
    -- Task<T>-returning variant,
    -- regular T-returning Async variant. Either this or the one above has user code. and
    -- special void-returnig Async variant. Always a thunk.

  • Since we can have 3 variants, the existing Matching/Other variant lookups must be replaced with explicit lookups that specifically tell what kind of variant is desired.
    Matching/Other was already somewhat confusing when getting deeper into helper calls as we need extra context of what we are Other from or Matching. With 3 variants the Other becomes even more confusing.

  • One observation - we never need to lookup for the return-dropping thunk, thus we do not need a lookup value for it. Noone should call this thunk directly. The only purpose of the thunk is to override void-returning base. The model allows for adding a lookup value that matches return-dropping thunk, just it seems there is no need.

  • When matching overrides for async variants we require that derived/base signatures are completely equivalent - including return types.
    This way the void-returning thunk will match with the void-returning base and the T-returning variant will be the base of the new chain of overrides. - Exactly what we need.

@dotnet-policy-service

Copy link
Copy Markdown
Contributor

Tagging subscribers to this area: @agocke
See info in area-owners.md if you want to be subscribed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates CoreCLR’s Runtime Async “variant/thunk” machinery to correctly support covariant overrides where a base virtual returns Task and an override returns Task<T> by introducing an additional void-returning async thunk that drops the T result, and adds a regression test covering the scenario.

Changes:

  • Add a new “return dropping” async thunk variant used to bridge Task<T> overrides back to Task-based async variants in base slots.
  • Refactor async-variant lookup from “matching/other” semantics to explicit Ordinary vs Async lookup and thread that through associated-method/parallel-method resolution.
  • Add an async test case for TaskTask<T> covariant override behavior.

Reviewed changes

Copilot reviewed 16 out of 16 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
src/tests/async/covariant-return/covariant-returns.csprojAdds a new Runtime Async test project for covariant-return scenarios.
src/tests/async/covariant-return/covariant-returns.csAdds a regression test for Task base overridden by Task<T> and derived async override cases.
src/coreclr/vm/zapsig.cppUpdates associated-MethodDesc resolution to use explicit Ordinary/Async variant lookup.
src/coreclr/vm/stubmgr.cppAdjusts debugger thunk step-through logic to use the renamed variant accessor.
src/coreclr/vm/runtimehandles.cppEnsures reflection normalizes away async variants via GetOrdinaryVariant.
src/coreclr/vm/methodtablebuilder.hRemoves builder-time “other variant” linkage and switches to lookup-based selection.
src/coreclr/vm/methodtablebuilder.cppAdds a third declared-method pass for return-dropping async thunks in covariant override cases; updates async-variant resolution logic.
src/coreclr/vm/methodtable.hSplits GetParallelMethodDesc into overloads (no-lookup + lookup).
src/coreclr/vm/methodtable.cppImplements new overload structure and updates async-variant mapping logic.
src/coreclr/vm/method.hppIntroduces ReturnDroppingThunk flag, MatchesAsyncVariantLookup, new variant accessors, and updated associated-method APIs.
src/coreclr/vm/method.cppExtends return-kind classification to capture generic element type length for signature rewriting.
src/coreclr/vm/memberload.cppUpdates associated-MethodDesc creation call sites for new signature/lookup behavior.
src/coreclr/vm/jitinterface.cppUpdates JIT query for “other async variant” to use GetAsyncVariant/GetOrdinaryVariant.
src/coreclr/vm/genmeth.cppUpdates associated-MethodDesc logic to use explicit MatchesAsyncVariantLookup checks and new parameter ordering.
src/coreclr/vm/class.cppRemoves special-case skipping of async variants during covariant return validation.
src/coreclr/vm/asyncthunks.cppAdds return-dropping thunk IL emission and refactors token selection into a helper.
Comments suppressed due to low confidence (1)

src/coreclr/vm/method.hpp:1748

  • GetAsyncOtherVariantNoCreate still references HasAsyncOtherVariant() and AsyncVariantLookup::AsyncOtherVariant, but HasAsyncOtherVariant/AsyncOtherVariant are no longer defined after the enum/API rename. This will break the build and also leaves existing callers (e.g. DAC) without a valid no-create path. Update/remove this helper to use the new Ordinary/Async lookup model (potentially adding an GetOrdinaryVariantNoCreate or a new GetOtherVariantNoCreate that handles ReturnDroppingThunk).
 MethodDesc* GetAsyncOtherVariantNoCreate(BOOL allowInstParam = TRUE)
{
_ASSERTE(HasAsyncOtherVariant());
return FindOrCreateAssociatedMethodDesc(this, GetMethodTable(), FALSE, GetMethodInstantiation(), allowInstParam, FALSE, FALSE, AsyncVariantLookup::AsyncOtherVariant);
}

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/tests/async/covariant-return/covariant-returns.cs

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 3 comments.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo attempts to map async thunk MethodDescs to the non-thunk variant (so the debugger can report code info for the actual implementation). Replacing GetAsyncOtherVariantNoCreate() with GetOrdinaryVariantNoCreate() breaks this for cases where the ordinary method is itself the thunk (e.g., MethodImpl.Async), and for ReturnDroppingThunk it will also point at the wrong target. Consider switching back to “other variant” semantics (choose Async vs Ordinary based on pMethodDesc->IsAsyncMethod() and whether it is a ReturnDroppingThunk) while keeping the no-create behavior.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/method.hpp
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp
@VSadov

Copy link
Copy Markdown
MemberAuthor

I think this is ready to be reviewed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (1)

src/coreclr/vm/method.cpp:2402

  • ClassifyMethodReturnKind only writes *elementTypeLength on the GenericTaskReturningMethod path. Since this is an out-parameter, initialize it (e.g., set to 0 near the start of the function) so callers don’t accidentally read an uninitialized value in non-generic/non-task cases.
MethodReturnKind ClassifyMethodReturnKind(SigPointer sig, Module* pModule, ULONG* offsetOfAsyncDetails, ULONG* elementTypeLength, bool *isValueTask)
{
// Without runtime async, every declared method is classified as a NormalMethod.
// Thus code that handles runtime async scenarios becomes unreachable.
if (!g_pConfig->RuntimeAsync())
{
return MethodReturnKind::NormalMethod;
}
PCCOR_SIGNATURE initialSig = sig.GetPtr();

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
CopilotAI review requested due to automatic review settings March 24, 2026 23:10

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo resolves a MethodDesc from a metadata token, so when it finds an async thunk MethodDesc it needs to map to the other (non-thunk) variant that contains the actual body for correct breakpoint/code-region reporting. Switching to GetOrdinaryVariantNoCreate() does not do that for ordinary Task/ValueTask-returning thunks (it returns the same thunk). Consider selecting the non-thunk counterpart explicitly (e.g., for an ordinary thunk, use the async variant; for an async-variant thunk, use the ordinary variant), and keep this in the no-create path.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/stubmgr.cpp
Comment threadsrc/coreclr/vm/asyncthunks.cpp
CopilotAI review requested due to automatic review settings March 27, 2026 01:56

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
@VSadov
VSadov enabled auto-merge (squash) April 8, 2026 03:15
@VSadov
VSadov merged commit a6149c0 into dotnet:mainApr 8, 2026
115 of 117 checks passed
@@ -0,0 +1,9 @@
<Project Sdk="Microsoft.NET.Sdk">
<PropertyGroup>
<!-- Async covariant return NYI in NativeAOT -->

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Disabling tests without filing a bug is not cool. I only found out there may be work to do because you forgot to disable on ReadyToRun and I saw the bugs #126682 and #126683 that got filed for it.

tommcdon added a commit that referenced this pull request Apr 10, 2026
…scs (#126728)
Regressed by #125900 from #124354
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
eduardo-vp added a commit that referenced this pull request Apr 21, 2026
…<T> (#126768)
Mirrors work in #125900 for Native AOT.
Fixes#126685.
---------
Co-authored-by: Eduardo Velarde <evelardepola@microsoft.com>
Co-authored-by: Michal Strehovský <MichalStrehovsky@users.noreply.github.com>
@github-actionsgithub-actionsBot locked and limited conversation to collaborators May 9, 2026
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@VSadov@jkotas@jakobbotsch@davidwrighton@MichalStrehovsky
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method. - #125900

Merged
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov
Apr 8, 2026
Merged

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method.#125900
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov

Conversation

@VSadov

@VSadovVSadov commented Mar 22, 2026

Copy link
Copy Markdown
Member

Contributes to: #124238

(Note: this does not deal with the Task<T> -> SomeCustomType return override. That will need a completely different fix, - no special thunks needed in that case).

== The problem:

When we have Task-returning method overriden with Task<T>-returning method, in the paralell "async space" we see a void-returning base logically overridden with a T-returning derived. That cannot work as-is in a virtual call as the caller/calee would be in disagreement whether there is a need for the return buffer and for a return slot in the continuation.
We need a thunk that could override the void-returning base and bridge into derived methods that are now in the T-returning virtual slot.

There are some additional inconveniences from the part that method descs/slots are added very early in the type system construction when we may not know exact types returned by the base/derived.
However, since Task<T> has uncomplicated base hierarchy, we can figure with good certainty that we may have Task<T> -> Task case.

== Implementation strategy.

  • Introduce a special kind of an async variant that has the same signature as the regular T-returning async variant, except that it is void-returning. The body of this new variant simply calls the T-returning async variant and then ignores the return.

  • In a case when we may have Task -> Task<T> return override, we introduce 2 async variants for the overriding method.
    I.E. we may end up with 3 method descs/bodies that represent the same method definition in IL:
    -- Task<T>-returning variant,
    -- regular T-returning Async variant. Either this or the one above has user code. and
    -- special void-returnig Async variant. Always a thunk.

  • Since we can have 3 variants, the existing Matching/Other variant lookups must be replaced with explicit lookups that specifically tell what kind of variant is desired.
    Matching/Other was already somewhat confusing when getting deeper into helper calls as we need extra context of what we are Other from or Matching. With 3 variants the Other becomes even more confusing.

  • One observation - we never need to lookup for the return-dropping thunk, thus we do not need a lookup value for it. Noone should call this thunk directly. The only purpose of the thunk is to override void-returning base. The model allows for adding a lookup value that matches return-dropping thunk, just it seems there is no need.

  • When matching overrides for async variants we require that derived/base signatures are completely equivalent - including return types.
    This way the void-returning thunk will match with the void-returning base and the T-returning variant will be the base of the new chain of overrides. - Exactly what we need.

@dotnet-policy-service

Copy link
Copy Markdown
Contributor

Tagging subscribers to this area: @agocke
See info in area-owners.md if you want to be subscribed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates CoreCLR’s Runtime Async “variant/thunk” machinery to correctly support covariant overrides where a base virtual returns Task and an override returns Task<T> by introducing an additional void-returning async thunk that drops the T result, and adds a regression test covering the scenario.

Changes:

  • Add a new “return dropping” async thunk variant used to bridge Task<T> overrides back to Task-based async variants in base slots.
  • Refactor async-variant lookup from “matching/other” semantics to explicit Ordinary vs Async lookup and thread that through associated-method/parallel-method resolution.
  • Add an async test case for TaskTask<T> covariant override behavior.

Reviewed changes

Copilot reviewed 16 out of 16 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
src/tests/async/covariant-return/covariant-returns.csprojAdds a new Runtime Async test project for covariant-return scenarios.
src/tests/async/covariant-return/covariant-returns.csAdds a regression test for Task base overridden by Task<T> and derived async override cases.
src/coreclr/vm/zapsig.cppUpdates associated-MethodDesc resolution to use explicit Ordinary/Async variant lookup.
src/coreclr/vm/stubmgr.cppAdjusts debugger thunk step-through logic to use the renamed variant accessor.
src/coreclr/vm/runtimehandles.cppEnsures reflection normalizes away async variants via GetOrdinaryVariant.
src/coreclr/vm/methodtablebuilder.hRemoves builder-time “other variant” linkage and switches to lookup-based selection.
src/coreclr/vm/methodtablebuilder.cppAdds a third declared-method pass for return-dropping async thunks in covariant override cases; updates async-variant resolution logic.
src/coreclr/vm/methodtable.hSplits GetParallelMethodDesc into overloads (no-lookup + lookup).
src/coreclr/vm/methodtable.cppImplements new overload structure and updates async-variant mapping logic.
src/coreclr/vm/method.hppIntroduces ReturnDroppingThunk flag, MatchesAsyncVariantLookup, new variant accessors, and updated associated-method APIs.
src/coreclr/vm/method.cppExtends return-kind classification to capture generic element type length for signature rewriting.
src/coreclr/vm/memberload.cppUpdates associated-MethodDesc creation call sites for new signature/lookup behavior.
src/coreclr/vm/jitinterface.cppUpdates JIT query for “other async variant” to use GetAsyncVariant/GetOrdinaryVariant.
src/coreclr/vm/genmeth.cppUpdates associated-MethodDesc logic to use explicit MatchesAsyncVariantLookup checks and new parameter ordering.
src/coreclr/vm/class.cppRemoves special-case skipping of async variants during covariant return validation.
src/coreclr/vm/asyncthunks.cppAdds return-dropping thunk IL emission and refactors token selection into a helper.
Comments suppressed due to low confidence (1)

src/coreclr/vm/method.hpp:1748

  • GetAsyncOtherVariantNoCreate still references HasAsyncOtherVariant() and AsyncVariantLookup::AsyncOtherVariant, but HasAsyncOtherVariant/AsyncOtherVariant are no longer defined after the enum/API rename. This will break the build and also leaves existing callers (e.g. DAC) without a valid no-create path. Update/remove this helper to use the new Ordinary/Async lookup model (potentially adding an GetOrdinaryVariantNoCreate or a new GetOtherVariantNoCreate that handles ReturnDroppingThunk).
 MethodDesc* GetAsyncOtherVariantNoCreate(BOOL allowInstParam = TRUE)
{
_ASSERTE(HasAsyncOtherVariant());
return FindOrCreateAssociatedMethodDesc(this, GetMethodTable(), FALSE, GetMethodInstantiation(), allowInstParam, FALSE, FALSE, AsyncVariantLookup::AsyncOtherVariant);
}

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/tests/async/covariant-return/covariant-returns.cs

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 3 comments.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo attempts to map async thunk MethodDescs to the non-thunk variant (so the debugger can report code info for the actual implementation). Replacing GetAsyncOtherVariantNoCreate() with GetOrdinaryVariantNoCreate() breaks this for cases where the ordinary method is itself the thunk (e.g., MethodImpl.Async), and for ReturnDroppingThunk it will also point at the wrong target. Consider switching back to “other variant” semantics (choose Async vs Ordinary based on pMethodDesc->IsAsyncMethod() and whether it is a ReturnDroppingThunk) while keeping the no-create behavior.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/method.hpp
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp
@VSadov

Copy link
Copy Markdown
MemberAuthor

I think this is ready to be reviewed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (1)

src/coreclr/vm/method.cpp:2402

  • ClassifyMethodReturnKind only writes *elementTypeLength on the GenericTaskReturningMethod path. Since this is an out-parameter, initialize it (e.g., set to 0 near the start of the function) so callers don’t accidentally read an uninitialized value in non-generic/non-task cases.
MethodReturnKind ClassifyMethodReturnKind(SigPointer sig, Module* pModule, ULONG* offsetOfAsyncDetails, ULONG* elementTypeLength, bool *isValueTask)
{
// Without runtime async, every declared method is classified as a NormalMethod.
// Thus code that handles runtime async scenarios becomes unreachable.
if (!g_pConfig->RuntimeAsync())
{
return MethodReturnKind::NormalMethod;
}
PCCOR_SIGNATURE initialSig = sig.GetPtr();

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
CopilotAI review requested due to automatic review settings March 24, 2026 23:10

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo resolves a MethodDesc from a metadata token, so when it finds an async thunk MethodDesc it needs to map to the other (non-thunk) variant that contains the actual body for correct breakpoint/code-region reporting. Switching to GetOrdinaryVariantNoCreate() does not do that for ordinary Task/ValueTask-returning thunks (it returns the same thunk). Consider selecting the non-thunk counterpart explicitly (e.g., for an ordinary thunk, use the async variant; for an async-variant thunk, use the ordinary variant), and keep this in the no-create path.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/stubmgr.cpp
Comment threadsrc/coreclr/vm/asyncthunks.cpp
CopilotAI review requested due to automatic review settings March 27, 2026 01:56

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
@VSadov
VSadov enabled auto-merge (squash) April 8, 2026 03:15
@VSadov
VSadov merged commit a6149c0 into dotnet:mainApr 8, 2026
115 of 117 checks passed
@@ -0,0 +1,9 @@
<Project Sdk="Microsoft.NET.Sdk">
<PropertyGroup>
<!-- Async covariant return NYI in NativeAOT -->

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Disabling tests without filing a bug is not cool. I only found out there may be work to do because you forgot to disable on ReadyToRun and I saw the bugs #126682 and #126683 that got filed for it.

tommcdon added a commit that referenced this pull request Apr 10, 2026
…scs (#126728)
Regressed by #125900 from #124354
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
eduardo-vp added a commit that referenced this pull request Apr 21, 2026
…<T> (#126768)
Mirrors work in #125900 for Native AOT.
Fixes#126685.
---------
Co-authored-by: Eduardo Velarde <evelardepola@microsoft.com>
Co-authored-by: Michal Strehovský <MichalStrehovsky@users.noreply.github.com>
@github-actionsgithub-actionsBot locked and limited conversation to collaborators May 9, 2026
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@VSadov@jkotas@jakobbotsch@davidwrighton@MichalStrehovsky
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method. - #125900

Merged
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov
Apr 8, 2026
Merged

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method.#125900
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov

Conversation

@VSadov

@VSadovVSadov commented Mar 22, 2026

Copy link
Copy Markdown
Member

Contributes to: #124238

(Note: this does not deal with the Task<T> -> SomeCustomType return override. That will need a completely different fix, - no special thunks needed in that case).

== The problem:

When we have Task-returning method overriden with Task<T>-returning method, in the paralell "async space" we see a void-returning base logically overridden with a T-returning derived. That cannot work as-is in a virtual call as the caller/calee would be in disagreement whether there is a need for the return buffer and for a return slot in the continuation.
We need a thunk that could override the void-returning base and bridge into derived methods that are now in the T-returning virtual slot.

There are some additional inconveniences from the part that method descs/slots are added very early in the type system construction when we may not know exact types returned by the base/derived.
However, since Task<T> has uncomplicated base hierarchy, we can figure with good certainty that we may have Task<T> -> Task case.

== Implementation strategy.

  • Introduce a special kind of an async variant that has the same signature as the regular T-returning async variant, except that it is void-returning. The body of this new variant simply calls the T-returning async variant and then ignores the return.

  • In a case when we may have Task -> Task<T> return override, we introduce 2 async variants for the overriding method.
    I.E. we may end up with 3 method descs/bodies that represent the same method definition in IL:
    -- Task<T>-returning variant,
    -- regular T-returning Async variant. Either this or the one above has user code. and
    -- special void-returnig Async variant. Always a thunk.

  • Since we can have 3 variants, the existing Matching/Other variant lookups must be replaced with explicit lookups that specifically tell what kind of variant is desired.
    Matching/Other was already somewhat confusing when getting deeper into helper calls as we need extra context of what we are Other from or Matching. With 3 variants the Other becomes even more confusing.

  • One observation - we never need to lookup for the return-dropping thunk, thus we do not need a lookup value for it. Noone should call this thunk directly. The only purpose of the thunk is to override void-returning base. The model allows for adding a lookup value that matches return-dropping thunk, just it seems there is no need.

  • When matching overrides for async variants we require that derived/base signatures are completely equivalent - including return types.
    This way the void-returning thunk will match with the void-returning base and the T-returning variant will be the base of the new chain of overrides. - Exactly what we need.

@dotnet-policy-service

Copy link
Copy Markdown
Contributor

Tagging subscribers to this area: @agocke
See info in area-owners.md if you want to be subscribed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates CoreCLR’s Runtime Async “variant/thunk” machinery to correctly support covariant overrides where a base virtual returns Task and an override returns Task<T> by introducing an additional void-returning async thunk that drops the T result, and adds a regression test covering the scenario.

Changes:

  • Add a new “return dropping” async thunk variant used to bridge Task<T> overrides back to Task-based async variants in base slots.
  • Refactor async-variant lookup from “matching/other” semantics to explicit Ordinary vs Async lookup and thread that through associated-method/parallel-method resolution.
  • Add an async test case for TaskTask<T> covariant override behavior.

Reviewed changes

Copilot reviewed 16 out of 16 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
src/tests/async/covariant-return/covariant-returns.csprojAdds a new Runtime Async test project for covariant-return scenarios.
src/tests/async/covariant-return/covariant-returns.csAdds a regression test for Task base overridden by Task<T> and derived async override cases.
src/coreclr/vm/zapsig.cppUpdates associated-MethodDesc resolution to use explicit Ordinary/Async variant lookup.
src/coreclr/vm/stubmgr.cppAdjusts debugger thunk step-through logic to use the renamed variant accessor.
src/coreclr/vm/runtimehandles.cppEnsures reflection normalizes away async variants via GetOrdinaryVariant.
src/coreclr/vm/methodtablebuilder.hRemoves builder-time “other variant” linkage and switches to lookup-based selection.
src/coreclr/vm/methodtablebuilder.cppAdds a third declared-method pass for return-dropping async thunks in covariant override cases; updates async-variant resolution logic.
src/coreclr/vm/methodtable.hSplits GetParallelMethodDesc into overloads (no-lookup + lookup).
src/coreclr/vm/methodtable.cppImplements new overload structure and updates async-variant mapping logic.
src/coreclr/vm/method.hppIntroduces ReturnDroppingThunk flag, MatchesAsyncVariantLookup, new variant accessors, and updated associated-method APIs.
src/coreclr/vm/method.cppExtends return-kind classification to capture generic element type length for signature rewriting.
src/coreclr/vm/memberload.cppUpdates associated-MethodDesc creation call sites for new signature/lookup behavior.
src/coreclr/vm/jitinterface.cppUpdates JIT query for “other async variant” to use GetAsyncVariant/GetOrdinaryVariant.
src/coreclr/vm/genmeth.cppUpdates associated-MethodDesc logic to use explicit MatchesAsyncVariantLookup checks and new parameter ordering.
src/coreclr/vm/class.cppRemoves special-case skipping of async variants during covariant return validation.
src/coreclr/vm/asyncthunks.cppAdds return-dropping thunk IL emission and refactors token selection into a helper.
Comments suppressed due to low confidence (1)

src/coreclr/vm/method.hpp:1748

  • GetAsyncOtherVariantNoCreate still references HasAsyncOtherVariant() and AsyncVariantLookup::AsyncOtherVariant, but HasAsyncOtherVariant/AsyncOtherVariant are no longer defined after the enum/API rename. This will break the build and also leaves existing callers (e.g. DAC) without a valid no-create path. Update/remove this helper to use the new Ordinary/Async lookup model (potentially adding an GetOrdinaryVariantNoCreate or a new GetOtherVariantNoCreate that handles ReturnDroppingThunk).
 MethodDesc* GetAsyncOtherVariantNoCreate(BOOL allowInstParam = TRUE)
{
_ASSERTE(HasAsyncOtherVariant());
return FindOrCreateAssociatedMethodDesc(this, GetMethodTable(), FALSE, GetMethodInstantiation(), allowInstParam, FALSE, FALSE, AsyncVariantLookup::AsyncOtherVariant);
}

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/tests/async/covariant-return/covariant-returns.cs

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 3 comments.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo attempts to map async thunk MethodDescs to the non-thunk variant (so the debugger can report code info for the actual implementation). Replacing GetAsyncOtherVariantNoCreate() with GetOrdinaryVariantNoCreate() breaks this for cases where the ordinary method is itself the thunk (e.g., MethodImpl.Async), and for ReturnDroppingThunk it will also point at the wrong target. Consider switching back to “other variant” semantics (choose Async vs Ordinary based on pMethodDesc->IsAsyncMethod() and whether it is a ReturnDroppingThunk) while keeping the no-create behavior.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/method.hpp
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp
@VSadov

Copy link
Copy Markdown
MemberAuthor

I think this is ready to be reviewed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (1)

src/coreclr/vm/method.cpp:2402

  • ClassifyMethodReturnKind only writes *elementTypeLength on the GenericTaskReturningMethod path. Since this is an out-parameter, initialize it (e.g., set to 0 near the start of the function) so callers don’t accidentally read an uninitialized value in non-generic/non-task cases.
MethodReturnKind ClassifyMethodReturnKind(SigPointer sig, Module* pModule, ULONG* offsetOfAsyncDetails, ULONG* elementTypeLength, bool *isValueTask)
{
// Without runtime async, every declared method is classified as a NormalMethod.
// Thus code that handles runtime async scenarios becomes unreachable.
if (!g_pConfig->RuntimeAsync())
{
return MethodReturnKind::NormalMethod;
}
PCCOR_SIGNATURE initialSig = sig.GetPtr();

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
CopilotAI review requested due to automatic review settings March 24, 2026 23:10

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo resolves a MethodDesc from a metadata token, so when it finds an async thunk MethodDesc it needs to map to the other (non-thunk) variant that contains the actual body for correct breakpoint/code-region reporting. Switching to GetOrdinaryVariantNoCreate() does not do that for ordinary Task/ValueTask-returning thunks (it returns the same thunk). Consider selecting the non-thunk counterpart explicitly (e.g., for an ordinary thunk, use the async variant; for an async-variant thunk, use the ordinary variant), and keep this in the no-create path.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/stubmgr.cpp
Comment threadsrc/coreclr/vm/asyncthunks.cpp
CopilotAI review requested due to automatic review settings March 27, 2026 01:56

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
@VSadov
VSadov enabled auto-merge (squash) April 8, 2026 03:15
@VSadov
VSadov merged commit a6149c0 into dotnet:mainApr 8, 2026
115 of 117 checks passed
@@ -0,0 +1,9 @@
<Project Sdk="Microsoft.NET.Sdk">
<PropertyGroup>
<!-- Async covariant return NYI in NativeAOT -->

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Disabling tests without filing a bug is not cool. I only found out there may be work to do because you forgot to disable on ReadyToRun and I saw the bugs #126682 and #126683 that got filed for it.

tommcdon added a commit that referenced this pull request Apr 10, 2026
…scs (#126728)
Regressed by #125900 from #124354
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
eduardo-vp added a commit that referenced this pull request Apr 21, 2026
…<T> (#126768)
Mirrors work in #125900 for Native AOT.
Fixes#126685.
---------
Co-authored-by: Eduardo Velarde <evelardepola@microsoft.com>
Co-authored-by: Michal Strehovský <MichalStrehovsky@users.noreply.github.com>
@github-actionsgithub-actionsBot locked and limited conversation to collaborators May 9, 2026
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@VSadov@jkotas@jakobbotsch@davidwrighton@MichalStrehovsky
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method. - #125900

Merged
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov
Apr 8, 2026
Merged

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method.#125900
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov

Conversation

@VSadov

@VSadovVSadov commented Mar 22, 2026

Copy link
Copy Markdown
Member

Contributes to: #124238

(Note: this does not deal with the Task<T> -> SomeCustomType return override. That will need a completely different fix, - no special thunks needed in that case).

== The problem:

When we have Task-returning method overriden with Task<T>-returning method, in the paralell "async space" we see a void-returning base logically overridden with a T-returning derived. That cannot work as-is in a virtual call as the caller/calee would be in disagreement whether there is a need for the return buffer and for a return slot in the continuation.
We need a thunk that could override the void-returning base and bridge into derived methods that are now in the T-returning virtual slot.

There are some additional inconveniences from the part that method descs/slots are added very early in the type system construction when we may not know exact types returned by the base/derived.
However, since Task<T> has uncomplicated base hierarchy, we can figure with good certainty that we may have Task<T> -> Task case.

== Implementation strategy.

  • Introduce a special kind of an async variant that has the same signature as the regular T-returning async variant, except that it is void-returning. The body of this new variant simply calls the T-returning async variant and then ignores the return.

  • In a case when we may have Task -> Task<T> return override, we introduce 2 async variants for the overriding method.
    I.E. we may end up with 3 method descs/bodies that represent the same method definition in IL:
    -- Task<T>-returning variant,
    -- regular T-returning Async variant. Either this or the one above has user code. and
    -- special void-returnig Async variant. Always a thunk.

  • Since we can have 3 variants, the existing Matching/Other variant lookups must be replaced with explicit lookups that specifically tell what kind of variant is desired.
    Matching/Other was already somewhat confusing when getting deeper into helper calls as we need extra context of what we are Other from or Matching. With 3 variants the Other becomes even more confusing.

  • One observation - we never need to lookup for the return-dropping thunk, thus we do not need a lookup value for it. Noone should call this thunk directly. The only purpose of the thunk is to override void-returning base. The model allows for adding a lookup value that matches return-dropping thunk, just it seems there is no need.

  • When matching overrides for async variants we require that derived/base signatures are completely equivalent - including return types.
    This way the void-returning thunk will match with the void-returning base and the T-returning variant will be the base of the new chain of overrides. - Exactly what we need.

@dotnet-policy-service

Copy link
Copy Markdown
Contributor

Tagging subscribers to this area: @agocke
See info in area-owners.md if you want to be subscribed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates CoreCLR’s Runtime Async “variant/thunk” machinery to correctly support covariant overrides where a base virtual returns Task and an override returns Task<T> by introducing an additional void-returning async thunk that drops the T result, and adds a regression test covering the scenario.

Changes:

  • Add a new “return dropping” async thunk variant used to bridge Task<T> overrides back to Task-based async variants in base slots.
  • Refactor async-variant lookup from “matching/other” semantics to explicit Ordinary vs Async lookup and thread that through associated-method/parallel-method resolution.
  • Add an async test case for TaskTask<T> covariant override behavior.

Reviewed changes

Copilot reviewed 16 out of 16 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
src/tests/async/covariant-return/covariant-returns.csprojAdds a new Runtime Async test project for covariant-return scenarios.
src/tests/async/covariant-return/covariant-returns.csAdds a regression test for Task base overridden by Task<T> and derived async override cases.
src/coreclr/vm/zapsig.cppUpdates associated-MethodDesc resolution to use explicit Ordinary/Async variant lookup.
src/coreclr/vm/stubmgr.cppAdjusts debugger thunk step-through logic to use the renamed variant accessor.
src/coreclr/vm/runtimehandles.cppEnsures reflection normalizes away async variants via GetOrdinaryVariant.
src/coreclr/vm/methodtablebuilder.hRemoves builder-time “other variant” linkage and switches to lookup-based selection.
src/coreclr/vm/methodtablebuilder.cppAdds a third declared-method pass for return-dropping async thunks in covariant override cases; updates async-variant resolution logic.
src/coreclr/vm/methodtable.hSplits GetParallelMethodDesc into overloads (no-lookup + lookup).
src/coreclr/vm/methodtable.cppImplements new overload structure and updates async-variant mapping logic.
src/coreclr/vm/method.hppIntroduces ReturnDroppingThunk flag, MatchesAsyncVariantLookup, new variant accessors, and updated associated-method APIs.
src/coreclr/vm/method.cppExtends return-kind classification to capture generic element type length for signature rewriting.
src/coreclr/vm/memberload.cppUpdates associated-MethodDesc creation call sites for new signature/lookup behavior.
src/coreclr/vm/jitinterface.cppUpdates JIT query for “other async variant” to use GetAsyncVariant/GetOrdinaryVariant.
src/coreclr/vm/genmeth.cppUpdates associated-MethodDesc logic to use explicit MatchesAsyncVariantLookup checks and new parameter ordering.
src/coreclr/vm/class.cppRemoves special-case skipping of async variants during covariant return validation.
src/coreclr/vm/asyncthunks.cppAdds return-dropping thunk IL emission and refactors token selection into a helper.
Comments suppressed due to low confidence (1)

src/coreclr/vm/method.hpp:1748

  • GetAsyncOtherVariantNoCreate still references HasAsyncOtherVariant() and AsyncVariantLookup::AsyncOtherVariant, but HasAsyncOtherVariant/AsyncOtherVariant are no longer defined after the enum/API rename. This will break the build and also leaves existing callers (e.g. DAC) without a valid no-create path. Update/remove this helper to use the new Ordinary/Async lookup model (potentially adding an GetOrdinaryVariantNoCreate or a new GetOtherVariantNoCreate that handles ReturnDroppingThunk).
 MethodDesc* GetAsyncOtherVariantNoCreate(BOOL allowInstParam = TRUE)
{
_ASSERTE(HasAsyncOtherVariant());
return FindOrCreateAssociatedMethodDesc(this, GetMethodTable(), FALSE, GetMethodInstantiation(), allowInstParam, FALSE, FALSE, AsyncVariantLookup::AsyncOtherVariant);
}

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/tests/async/covariant-return/covariant-returns.cs

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 3 comments.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo attempts to map async thunk MethodDescs to the non-thunk variant (so the debugger can report code info for the actual implementation). Replacing GetAsyncOtherVariantNoCreate() with GetOrdinaryVariantNoCreate() breaks this for cases where the ordinary method is itself the thunk (e.g., MethodImpl.Async), and for ReturnDroppingThunk it will also point at the wrong target. Consider switching back to “other variant” semantics (choose Async vs Ordinary based on pMethodDesc->IsAsyncMethod() and whether it is a ReturnDroppingThunk) while keeping the no-create behavior.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/method.hpp
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp
@VSadov

Copy link
Copy Markdown
MemberAuthor

I think this is ready to be reviewed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (1)

src/coreclr/vm/method.cpp:2402

  • ClassifyMethodReturnKind only writes *elementTypeLength on the GenericTaskReturningMethod path. Since this is an out-parameter, initialize it (e.g., set to 0 near the start of the function) so callers don’t accidentally read an uninitialized value in non-generic/non-task cases.
MethodReturnKind ClassifyMethodReturnKind(SigPointer sig, Module* pModule, ULONG* offsetOfAsyncDetails, ULONG* elementTypeLength, bool *isValueTask)
{
// Without runtime async, every declared method is classified as a NormalMethod.
// Thus code that handles runtime async scenarios becomes unreachable.
if (!g_pConfig->RuntimeAsync())
{
return MethodReturnKind::NormalMethod;
}
PCCOR_SIGNATURE initialSig = sig.GetPtr();

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
CopilotAI review requested due to automatic review settings March 24, 2026 23:10

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo resolves a MethodDesc from a metadata token, so when it finds an async thunk MethodDesc it needs to map to the other (non-thunk) variant that contains the actual body for correct breakpoint/code-region reporting. Switching to GetOrdinaryVariantNoCreate() does not do that for ordinary Task/ValueTask-returning thunks (it returns the same thunk). Consider selecting the non-thunk counterpart explicitly (e.g., for an ordinary thunk, use the async variant; for an async-variant thunk, use the ordinary variant), and keep this in the no-create path.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/stubmgr.cpp
Comment threadsrc/coreclr/vm/asyncthunks.cpp
CopilotAI review requested due to automatic review settings March 27, 2026 01:56

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
@VSadov
VSadov enabled auto-merge (squash) April 8, 2026 03:15
@VSadov
VSadov merged commit a6149c0 into dotnet:mainApr 8, 2026
115 of 117 checks passed
@@ -0,0 +1,9 @@
<Project Sdk="Microsoft.NET.Sdk">
<PropertyGroup>
<!-- Async covariant return NYI in NativeAOT -->

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Disabling tests without filing a bug is not cool. I only found out there may be work to do because you forgot to disable on ReadyToRun and I saw the bugs #126682 and #126683 that got filed for it.

tommcdon added a commit that referenced this pull request Apr 10, 2026
…scs (#126728)
Regressed by #125900 from #124354
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
eduardo-vp added a commit that referenced this pull request Apr 21, 2026
…<T> (#126768)
Mirrors work in #125900 for Native AOT.
Fixes#126685.
---------
Co-authored-by: Eduardo Velarde <evelardepola@microsoft.com>
Co-authored-by: Michal Strehovský <MichalStrehovsky@users.noreply.github.com>
@github-actionsgithub-actionsBot locked and limited conversation to collaborators May 9, 2026
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@VSadov@jkotas@jakobbotsch@davidwrighton@MichalStrehovsky
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method. - #125900

Merged
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov
Apr 8, 2026
Merged

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method.#125900
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov

Conversation

@VSadov

@VSadovVSadov commented Mar 22, 2026

Copy link
Copy Markdown
Member

Contributes to: #124238

(Note: this does not deal with the Task<T> -> SomeCustomType return override. That will need a completely different fix, - no special thunks needed in that case).

== The problem:

When we have Task-returning method overriden with Task<T>-returning method, in the paralell "async space" we see a void-returning base logically overridden with a T-returning derived. That cannot work as-is in a virtual call as the caller/calee would be in disagreement whether there is a need for the return buffer and for a return slot in the continuation.
We need a thunk that could override the void-returning base and bridge into derived methods that are now in the T-returning virtual slot.

There are some additional inconveniences from the part that method descs/slots are added very early in the type system construction when we may not know exact types returned by the base/derived.
However, since Task<T> has uncomplicated base hierarchy, we can figure with good certainty that we may have Task<T> -> Task case.

== Implementation strategy.

  • Introduce a special kind of an async variant that has the same signature as the regular T-returning async variant, except that it is void-returning. The body of this new variant simply calls the T-returning async variant and then ignores the return.

  • In a case when we may have Task -> Task<T> return override, we introduce 2 async variants for the overriding method.
    I.E. we may end up with 3 method descs/bodies that represent the same method definition in IL:
    -- Task<T>-returning variant,
    -- regular T-returning Async variant. Either this or the one above has user code. and
    -- special void-returnig Async variant. Always a thunk.

  • Since we can have 3 variants, the existing Matching/Other variant lookups must be replaced with explicit lookups that specifically tell what kind of variant is desired.
    Matching/Other was already somewhat confusing when getting deeper into helper calls as we need extra context of what we are Other from or Matching. With 3 variants the Other becomes even more confusing.

  • One observation - we never need to lookup for the return-dropping thunk, thus we do not need a lookup value for it. Noone should call this thunk directly. The only purpose of the thunk is to override void-returning base. The model allows for adding a lookup value that matches return-dropping thunk, just it seems there is no need.

  • When matching overrides for async variants we require that derived/base signatures are completely equivalent - including return types.
    This way the void-returning thunk will match with the void-returning base and the T-returning variant will be the base of the new chain of overrides. - Exactly what we need.

@dotnet-policy-service

Copy link
Copy Markdown
Contributor

Tagging subscribers to this area: @agocke
See info in area-owners.md if you want to be subscribed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates CoreCLR’s Runtime Async “variant/thunk” machinery to correctly support covariant overrides where a base virtual returns Task and an override returns Task<T> by introducing an additional void-returning async thunk that drops the T result, and adds a regression test covering the scenario.

Changes:

  • Add a new “return dropping” async thunk variant used to bridge Task<T> overrides back to Task-based async variants in base slots.
  • Refactor async-variant lookup from “matching/other” semantics to explicit Ordinary vs Async lookup and thread that through associated-method/parallel-method resolution.
  • Add an async test case for TaskTask<T> covariant override behavior.

Reviewed changes

Copilot reviewed 16 out of 16 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
src/tests/async/covariant-return/covariant-returns.csprojAdds a new Runtime Async test project for covariant-return scenarios.
src/tests/async/covariant-return/covariant-returns.csAdds a regression test for Task base overridden by Task<T> and derived async override cases.
src/coreclr/vm/zapsig.cppUpdates associated-MethodDesc resolution to use explicit Ordinary/Async variant lookup.
src/coreclr/vm/stubmgr.cppAdjusts debugger thunk step-through logic to use the renamed variant accessor.
src/coreclr/vm/runtimehandles.cppEnsures reflection normalizes away async variants via GetOrdinaryVariant.
src/coreclr/vm/methodtablebuilder.hRemoves builder-time “other variant” linkage and switches to lookup-based selection.
src/coreclr/vm/methodtablebuilder.cppAdds a third declared-method pass for return-dropping async thunks in covariant override cases; updates async-variant resolution logic.
src/coreclr/vm/methodtable.hSplits GetParallelMethodDesc into overloads (no-lookup + lookup).
src/coreclr/vm/methodtable.cppImplements new overload structure and updates async-variant mapping logic.
src/coreclr/vm/method.hppIntroduces ReturnDroppingThunk flag, MatchesAsyncVariantLookup, new variant accessors, and updated associated-method APIs.
src/coreclr/vm/method.cppExtends return-kind classification to capture generic element type length for signature rewriting.
src/coreclr/vm/memberload.cppUpdates associated-MethodDesc creation call sites for new signature/lookup behavior.
src/coreclr/vm/jitinterface.cppUpdates JIT query for “other async variant” to use GetAsyncVariant/GetOrdinaryVariant.
src/coreclr/vm/genmeth.cppUpdates associated-MethodDesc logic to use explicit MatchesAsyncVariantLookup checks and new parameter ordering.
src/coreclr/vm/class.cppRemoves special-case skipping of async variants during covariant return validation.
src/coreclr/vm/asyncthunks.cppAdds return-dropping thunk IL emission and refactors token selection into a helper.
Comments suppressed due to low confidence (1)

src/coreclr/vm/method.hpp:1748

  • GetAsyncOtherVariantNoCreate still references HasAsyncOtherVariant() and AsyncVariantLookup::AsyncOtherVariant, but HasAsyncOtherVariant/AsyncOtherVariant are no longer defined after the enum/API rename. This will break the build and also leaves existing callers (e.g. DAC) without a valid no-create path. Update/remove this helper to use the new Ordinary/Async lookup model (potentially adding an GetOrdinaryVariantNoCreate or a new GetOtherVariantNoCreate that handles ReturnDroppingThunk).
 MethodDesc* GetAsyncOtherVariantNoCreate(BOOL allowInstParam = TRUE)
{
_ASSERTE(HasAsyncOtherVariant());
return FindOrCreateAssociatedMethodDesc(this, GetMethodTable(), FALSE, GetMethodInstantiation(), allowInstParam, FALSE, FALSE, AsyncVariantLookup::AsyncOtherVariant);
}

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/tests/async/covariant-return/covariant-returns.cs

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 3 comments.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo attempts to map async thunk MethodDescs to the non-thunk variant (so the debugger can report code info for the actual implementation). Replacing GetAsyncOtherVariantNoCreate() with GetOrdinaryVariantNoCreate() breaks this for cases where the ordinary method is itself the thunk (e.g., MethodImpl.Async), and for ReturnDroppingThunk it will also point at the wrong target. Consider switching back to “other variant” semantics (choose Async vs Ordinary based on pMethodDesc->IsAsyncMethod() and whether it is a ReturnDroppingThunk) while keeping the no-create behavior.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/method.hpp
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp
@VSadov

Copy link
Copy Markdown
MemberAuthor

I think this is ready to be reviewed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (1)

src/coreclr/vm/method.cpp:2402

  • ClassifyMethodReturnKind only writes *elementTypeLength on the GenericTaskReturningMethod path. Since this is an out-parameter, initialize it (e.g., set to 0 near the start of the function) so callers don’t accidentally read an uninitialized value in non-generic/non-task cases.
MethodReturnKind ClassifyMethodReturnKind(SigPointer sig, Module* pModule, ULONG* offsetOfAsyncDetails, ULONG* elementTypeLength, bool *isValueTask)
{
// Without runtime async, every declared method is classified as a NormalMethod.
// Thus code that handles runtime async scenarios becomes unreachable.
if (!g_pConfig->RuntimeAsync())
{
return MethodReturnKind::NormalMethod;
}
PCCOR_SIGNATURE initialSig = sig.GetPtr();

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
CopilotAI review requested due to automatic review settings March 24, 2026 23:10

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo resolves a MethodDesc from a metadata token, so when it finds an async thunk MethodDesc it needs to map to the other (non-thunk) variant that contains the actual body for correct breakpoint/code-region reporting. Switching to GetOrdinaryVariantNoCreate() does not do that for ordinary Task/ValueTask-returning thunks (it returns the same thunk). Consider selecting the non-thunk counterpart explicitly (e.g., for an ordinary thunk, use the async variant; for an async-variant thunk, use the ordinary variant), and keep this in the no-create path.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/stubmgr.cpp
Comment threadsrc/coreclr/vm/asyncthunks.cpp
CopilotAI review requested due to automatic review settings March 27, 2026 01:56

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
@VSadov
VSadov enabled auto-merge (squash) April 8, 2026 03:15
@VSadov
VSadov merged commit a6149c0 into dotnet:mainApr 8, 2026
115 of 117 checks passed
@@ -0,0 +1,9 @@
<Project Sdk="Microsoft.NET.Sdk">
<PropertyGroup>
<!-- Async covariant return NYI in NativeAOT -->

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Disabling tests without filing a bug is not cool. I only found out there may be work to do because you forgot to disable on ReadyToRun and I saw the bugs #126682 and #126683 that got filed for it.

tommcdon added a commit that referenced this pull request Apr 10, 2026
…scs (#126728)
Regressed by #125900 from #124354
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
eduardo-vp added a commit that referenced this pull request Apr 21, 2026
…<T> (#126768)
Mirrors work in #125900 for Native AOT.
Fixes#126685.
---------
Co-authored-by: Eduardo Velarde <evelardepola@microsoft.com>
Co-authored-by: Michal Strehovský <MichalStrehovsky@users.noreply.github.com>
@github-actionsgithub-actionsBot locked and limited conversation to collaborators May 9, 2026
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@VSadov@jkotas@jakobbotsch@davidwrighton@MichalStrehovsky
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method. - #125900

Merged
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov
Apr 8, 2026
Merged

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method.#125900
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov

Conversation

@VSadov

@VSadovVSadov commented Mar 22, 2026

Copy link
Copy Markdown
Member

Contributes to: #124238

(Note: this does not deal with the Task<T> -> SomeCustomType return override. That will need a completely different fix, - no special thunks needed in that case).

== The problem:

When we have Task-returning method overriden with Task<T>-returning method, in the paralell "async space" we see a void-returning base logically overridden with a T-returning derived. That cannot work as-is in a virtual call as the caller/calee would be in disagreement whether there is a need for the return buffer and for a return slot in the continuation.
We need a thunk that could override the void-returning base and bridge into derived methods that are now in the T-returning virtual slot.

There are some additional inconveniences from the part that method descs/slots are added very early in the type system construction when we may not know exact types returned by the base/derived.
However, since Task<T> has uncomplicated base hierarchy, we can figure with good certainty that we may have Task<T> -> Task case.

== Implementation strategy.

  • Introduce a special kind of an async variant that has the same signature as the regular T-returning async variant, except that it is void-returning. The body of this new variant simply calls the T-returning async variant and then ignores the return.

  • In a case when we may have Task -> Task<T> return override, we introduce 2 async variants for the overriding method.
    I.E. we may end up with 3 method descs/bodies that represent the same method definition in IL:
    -- Task<T>-returning variant,
    -- regular T-returning Async variant. Either this or the one above has user code. and
    -- special void-returnig Async variant. Always a thunk.

  • Since we can have 3 variants, the existing Matching/Other variant lookups must be replaced with explicit lookups that specifically tell what kind of variant is desired.
    Matching/Other was already somewhat confusing when getting deeper into helper calls as we need extra context of what we are Other from or Matching. With 3 variants the Other becomes even more confusing.

  • One observation - we never need to lookup for the return-dropping thunk, thus we do not need a lookup value for it. Noone should call this thunk directly. The only purpose of the thunk is to override void-returning base. The model allows for adding a lookup value that matches return-dropping thunk, just it seems there is no need.

  • When matching overrides for async variants we require that derived/base signatures are completely equivalent - including return types.
    This way the void-returning thunk will match with the void-returning base and the T-returning variant will be the base of the new chain of overrides. - Exactly what we need.

@dotnet-policy-service

Copy link
Copy Markdown
Contributor

Tagging subscribers to this area: @agocke
See info in area-owners.md if you want to be subscribed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates CoreCLR’s Runtime Async “variant/thunk” machinery to correctly support covariant overrides where a base virtual returns Task and an override returns Task<T> by introducing an additional void-returning async thunk that drops the T result, and adds a regression test covering the scenario.

Changes:

  • Add a new “return dropping” async thunk variant used to bridge Task<T> overrides back to Task-based async variants in base slots.
  • Refactor async-variant lookup from “matching/other” semantics to explicit Ordinary vs Async lookup and thread that through associated-method/parallel-method resolution.
  • Add an async test case for TaskTask<T> covariant override behavior.

Reviewed changes

Copilot reviewed 16 out of 16 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
src/tests/async/covariant-return/covariant-returns.csprojAdds a new Runtime Async test project for covariant-return scenarios.
src/tests/async/covariant-return/covariant-returns.csAdds a regression test for Task base overridden by Task<T> and derived async override cases.
src/coreclr/vm/zapsig.cppUpdates associated-MethodDesc resolution to use explicit Ordinary/Async variant lookup.
src/coreclr/vm/stubmgr.cppAdjusts debugger thunk step-through logic to use the renamed variant accessor.
src/coreclr/vm/runtimehandles.cppEnsures reflection normalizes away async variants via GetOrdinaryVariant.
src/coreclr/vm/methodtablebuilder.hRemoves builder-time “other variant” linkage and switches to lookup-based selection.
src/coreclr/vm/methodtablebuilder.cppAdds a third declared-method pass for return-dropping async thunks in covariant override cases; updates async-variant resolution logic.
src/coreclr/vm/methodtable.hSplits GetParallelMethodDesc into overloads (no-lookup + lookup).
src/coreclr/vm/methodtable.cppImplements new overload structure and updates async-variant mapping logic.
src/coreclr/vm/method.hppIntroduces ReturnDroppingThunk flag, MatchesAsyncVariantLookup, new variant accessors, and updated associated-method APIs.
src/coreclr/vm/method.cppExtends return-kind classification to capture generic element type length for signature rewriting.
src/coreclr/vm/memberload.cppUpdates associated-MethodDesc creation call sites for new signature/lookup behavior.
src/coreclr/vm/jitinterface.cppUpdates JIT query for “other async variant” to use GetAsyncVariant/GetOrdinaryVariant.
src/coreclr/vm/genmeth.cppUpdates associated-MethodDesc logic to use explicit MatchesAsyncVariantLookup checks and new parameter ordering.
src/coreclr/vm/class.cppRemoves special-case skipping of async variants during covariant return validation.
src/coreclr/vm/asyncthunks.cppAdds return-dropping thunk IL emission and refactors token selection into a helper.
Comments suppressed due to low confidence (1)

src/coreclr/vm/method.hpp:1748

  • GetAsyncOtherVariantNoCreate still references HasAsyncOtherVariant() and AsyncVariantLookup::AsyncOtherVariant, but HasAsyncOtherVariant/AsyncOtherVariant are no longer defined after the enum/API rename. This will break the build and also leaves existing callers (e.g. DAC) without a valid no-create path. Update/remove this helper to use the new Ordinary/Async lookup model (potentially adding an GetOrdinaryVariantNoCreate or a new GetOtherVariantNoCreate that handles ReturnDroppingThunk).
 MethodDesc* GetAsyncOtherVariantNoCreate(BOOL allowInstParam = TRUE)
{
_ASSERTE(HasAsyncOtherVariant());
return FindOrCreateAssociatedMethodDesc(this, GetMethodTable(), FALSE, GetMethodInstantiation(), allowInstParam, FALSE, FALSE, AsyncVariantLookup::AsyncOtherVariant);
}

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/tests/async/covariant-return/covariant-returns.cs

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 3 comments.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo attempts to map async thunk MethodDescs to the non-thunk variant (so the debugger can report code info for the actual implementation). Replacing GetAsyncOtherVariantNoCreate() with GetOrdinaryVariantNoCreate() breaks this for cases where the ordinary method is itself the thunk (e.g., MethodImpl.Async), and for ReturnDroppingThunk it will also point at the wrong target. Consider switching back to “other variant” semantics (choose Async vs Ordinary based on pMethodDesc->IsAsyncMethod() and whether it is a ReturnDroppingThunk) while keeping the no-create behavior.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/method.hpp
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp
@VSadov

Copy link
Copy Markdown
MemberAuthor

I think this is ready to be reviewed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (1)

src/coreclr/vm/method.cpp:2402

  • ClassifyMethodReturnKind only writes *elementTypeLength on the GenericTaskReturningMethod path. Since this is an out-parameter, initialize it (e.g., set to 0 near the start of the function) so callers don’t accidentally read an uninitialized value in non-generic/non-task cases.
MethodReturnKind ClassifyMethodReturnKind(SigPointer sig, Module* pModule, ULONG* offsetOfAsyncDetails, ULONG* elementTypeLength, bool *isValueTask)
{
// Without runtime async, every declared method is classified as a NormalMethod.
// Thus code that handles runtime async scenarios becomes unreachable.
if (!g_pConfig->RuntimeAsync())
{
return MethodReturnKind::NormalMethod;
}
PCCOR_SIGNATURE initialSig = sig.GetPtr();

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
CopilotAI review requested due to automatic review settings March 24, 2026 23:10

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo resolves a MethodDesc from a metadata token, so when it finds an async thunk MethodDesc it needs to map to the other (non-thunk) variant that contains the actual body for correct breakpoint/code-region reporting. Switching to GetOrdinaryVariantNoCreate() does not do that for ordinary Task/ValueTask-returning thunks (it returns the same thunk). Consider selecting the non-thunk counterpart explicitly (e.g., for an ordinary thunk, use the async variant; for an async-variant thunk, use the ordinary variant), and keep this in the no-create path.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/stubmgr.cpp
Comment threadsrc/coreclr/vm/asyncthunks.cpp
CopilotAI review requested due to automatic review settings March 27, 2026 01:56

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
@VSadov
VSadov enabled auto-merge (squash) April 8, 2026 03:15
@VSadov
VSadov merged commit a6149c0 into dotnet:mainApr 8, 2026
115 of 117 checks passed
@@ -0,0 +1,9 @@
<Project Sdk="Microsoft.NET.Sdk">
<PropertyGroup>
<!-- Async covariant return NYI in NativeAOT -->

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Disabling tests without filing a bug is not cool. I only found out there may be work to do because you forgot to disable on ReadyToRun and I saw the bugs #126682 and #126683 that got filed for it.

tommcdon added a commit that referenced this pull request Apr 10, 2026
…scs (#126728)
Regressed by #125900 from #124354
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
eduardo-vp added a commit that referenced this pull request Apr 21, 2026
…<T> (#126768)
Mirrors work in #125900 for Native AOT.
Fixes#126685.
---------
Co-authored-by: Eduardo Velarde <evelardepola@microsoft.com>
Co-authored-by: Michal Strehovský <MichalStrehovsky@users.noreply.github.com>
@github-actionsgithub-actionsBot locked and limited conversation to collaborators May 9, 2026
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@VSadov@jkotas@jakobbotsch@davidwrighton@MichalStrehovsky
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method. - #125900

Merged
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov
Apr 8, 2026
Merged

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method.#125900
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov

Conversation

@VSadov

@VSadovVSadov commented Mar 22, 2026

Copy link
Copy Markdown
Member

Contributes to: #124238

(Note: this does not deal with the Task<T> -> SomeCustomType return override. That will need a completely different fix, - no special thunks needed in that case).

== The problem:

When we have Task-returning method overriden with Task<T>-returning method, in the paralell "async space" we see a void-returning base logically overridden with a T-returning derived. That cannot work as-is in a virtual call as the caller/calee would be in disagreement whether there is a need for the return buffer and for a return slot in the continuation.
We need a thunk that could override the void-returning base and bridge into derived methods that are now in the T-returning virtual slot.

There are some additional inconveniences from the part that method descs/slots are added very early in the type system construction when we may not know exact types returned by the base/derived.
However, since Task<T> has uncomplicated base hierarchy, we can figure with good certainty that we may have Task<T> -> Task case.

== Implementation strategy.

  • Introduce a special kind of an async variant that has the same signature as the regular T-returning async variant, except that it is void-returning. The body of this new variant simply calls the T-returning async variant and then ignores the return.

  • In a case when we may have Task -> Task<T> return override, we introduce 2 async variants for the overriding method.
    I.E. we may end up with 3 method descs/bodies that represent the same method definition in IL:
    -- Task<T>-returning variant,
    -- regular T-returning Async variant. Either this or the one above has user code. and
    -- special void-returnig Async variant. Always a thunk.

  • Since we can have 3 variants, the existing Matching/Other variant lookups must be replaced with explicit lookups that specifically tell what kind of variant is desired.
    Matching/Other was already somewhat confusing when getting deeper into helper calls as we need extra context of what we are Other from or Matching. With 3 variants the Other becomes even more confusing.

  • One observation - we never need to lookup for the return-dropping thunk, thus we do not need a lookup value for it. Noone should call this thunk directly. The only purpose of the thunk is to override void-returning base. The model allows for adding a lookup value that matches return-dropping thunk, just it seems there is no need.

  • When matching overrides for async variants we require that derived/base signatures are completely equivalent - including return types.
    This way the void-returning thunk will match with the void-returning base and the T-returning variant will be the base of the new chain of overrides. - Exactly what we need.

@dotnet-policy-service

Copy link
Copy Markdown
Contributor

Tagging subscribers to this area: @agocke
See info in area-owners.md if you want to be subscribed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates CoreCLR’s Runtime Async “variant/thunk” machinery to correctly support covariant overrides where a base virtual returns Task and an override returns Task<T> by introducing an additional void-returning async thunk that drops the T result, and adds a regression test covering the scenario.

Changes:

  • Add a new “return dropping” async thunk variant used to bridge Task<T> overrides back to Task-based async variants in base slots.
  • Refactor async-variant lookup from “matching/other” semantics to explicit Ordinary vs Async lookup and thread that through associated-method/parallel-method resolution.
  • Add an async test case for TaskTask<T> covariant override behavior.

Reviewed changes

Copilot reviewed 16 out of 16 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
src/tests/async/covariant-return/covariant-returns.csprojAdds a new Runtime Async test project for covariant-return scenarios.
src/tests/async/covariant-return/covariant-returns.csAdds a regression test for Task base overridden by Task<T> and derived async override cases.
src/coreclr/vm/zapsig.cppUpdates associated-MethodDesc resolution to use explicit Ordinary/Async variant lookup.
src/coreclr/vm/stubmgr.cppAdjusts debugger thunk step-through logic to use the renamed variant accessor.
src/coreclr/vm/runtimehandles.cppEnsures reflection normalizes away async variants via GetOrdinaryVariant.
src/coreclr/vm/methodtablebuilder.hRemoves builder-time “other variant” linkage and switches to lookup-based selection.
src/coreclr/vm/methodtablebuilder.cppAdds a third declared-method pass for return-dropping async thunks in covariant override cases; updates async-variant resolution logic.
src/coreclr/vm/methodtable.hSplits GetParallelMethodDesc into overloads (no-lookup + lookup).
src/coreclr/vm/methodtable.cppImplements new overload structure and updates async-variant mapping logic.
src/coreclr/vm/method.hppIntroduces ReturnDroppingThunk flag, MatchesAsyncVariantLookup, new variant accessors, and updated associated-method APIs.
src/coreclr/vm/method.cppExtends return-kind classification to capture generic element type length for signature rewriting.
src/coreclr/vm/memberload.cppUpdates associated-MethodDesc creation call sites for new signature/lookup behavior.
src/coreclr/vm/jitinterface.cppUpdates JIT query for “other async variant” to use GetAsyncVariant/GetOrdinaryVariant.
src/coreclr/vm/genmeth.cppUpdates associated-MethodDesc logic to use explicit MatchesAsyncVariantLookup checks and new parameter ordering.
src/coreclr/vm/class.cppRemoves special-case skipping of async variants during covariant return validation.
src/coreclr/vm/asyncthunks.cppAdds return-dropping thunk IL emission and refactors token selection into a helper.
Comments suppressed due to low confidence (1)

src/coreclr/vm/method.hpp:1748

  • GetAsyncOtherVariantNoCreate still references HasAsyncOtherVariant() and AsyncVariantLookup::AsyncOtherVariant, but HasAsyncOtherVariant/AsyncOtherVariant are no longer defined after the enum/API rename. This will break the build and also leaves existing callers (e.g. DAC) without a valid no-create path. Update/remove this helper to use the new Ordinary/Async lookup model (potentially adding an GetOrdinaryVariantNoCreate or a new GetOtherVariantNoCreate that handles ReturnDroppingThunk).
 MethodDesc* GetAsyncOtherVariantNoCreate(BOOL allowInstParam = TRUE)
{
_ASSERTE(HasAsyncOtherVariant());
return FindOrCreateAssociatedMethodDesc(this, GetMethodTable(), FALSE, GetMethodInstantiation(), allowInstParam, FALSE, FALSE, AsyncVariantLookup::AsyncOtherVariant);
}

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/tests/async/covariant-return/covariant-returns.cs

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 3 comments.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo attempts to map async thunk MethodDescs to the non-thunk variant (so the debugger can report code info for the actual implementation). Replacing GetAsyncOtherVariantNoCreate() with GetOrdinaryVariantNoCreate() breaks this for cases where the ordinary method is itself the thunk (e.g., MethodImpl.Async), and for ReturnDroppingThunk it will also point at the wrong target. Consider switching back to “other variant” semantics (choose Async vs Ordinary based on pMethodDesc->IsAsyncMethod() and whether it is a ReturnDroppingThunk) while keeping the no-create behavior.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/method.hpp
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp
@VSadov

Copy link
Copy Markdown
MemberAuthor

I think this is ready to be reviewed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (1)

src/coreclr/vm/method.cpp:2402

  • ClassifyMethodReturnKind only writes *elementTypeLength on the GenericTaskReturningMethod path. Since this is an out-parameter, initialize it (e.g., set to 0 near the start of the function) so callers don’t accidentally read an uninitialized value in non-generic/non-task cases.
MethodReturnKind ClassifyMethodReturnKind(SigPointer sig, Module* pModule, ULONG* offsetOfAsyncDetails, ULONG* elementTypeLength, bool *isValueTask)
{
// Without runtime async, every declared method is classified as a NormalMethod.
// Thus code that handles runtime async scenarios becomes unreachable.
if (!g_pConfig->RuntimeAsync())
{
return MethodReturnKind::NormalMethod;
}
PCCOR_SIGNATURE initialSig = sig.GetPtr();

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
CopilotAI review requested due to automatic review settings March 24, 2026 23:10

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo resolves a MethodDesc from a metadata token, so when it finds an async thunk MethodDesc it needs to map to the other (non-thunk) variant that contains the actual body for correct breakpoint/code-region reporting. Switching to GetOrdinaryVariantNoCreate() does not do that for ordinary Task/ValueTask-returning thunks (it returns the same thunk). Consider selecting the non-thunk counterpart explicitly (e.g., for an ordinary thunk, use the async variant; for an async-variant thunk, use the ordinary variant), and keep this in the no-create path.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/stubmgr.cpp
Comment threadsrc/coreclr/vm/asyncthunks.cpp
CopilotAI review requested due to automatic review settings March 27, 2026 01:56

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
@VSadov
VSadov enabled auto-merge (squash) April 8, 2026 03:15
@VSadov
VSadov merged commit a6149c0 into dotnet:mainApr 8, 2026
115 of 117 checks passed
@@ -0,0 +1,9 @@
<Project Sdk="Microsoft.NET.Sdk">
<PropertyGroup>
<!-- Async covariant return NYI in NativeAOT -->

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Disabling tests without filing a bug is not cool. I only found out there may be work to do because you forgot to disable on ReadyToRun and I saw the bugs #126682 and #126683 that got filed for it.

tommcdon added a commit that referenced this pull request Apr 10, 2026
…scs (#126728)
Regressed by #125900 from #124354
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
eduardo-vp added a commit that referenced this pull request Apr 21, 2026
…<T> (#126768)
Mirrors work in #125900 for Native AOT.
Fixes#126685.
---------
Co-authored-by: Eduardo Velarde <evelardepola@microsoft.com>
Co-authored-by: Michal Strehovský <MichalStrehovsky@users.noreply.github.com>
@github-actionsgithub-actionsBot locked and limited conversation to collaborators May 9, 2026
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@VSadov@jkotas@jakobbotsch@davidwrighton@MichalStrehovsky
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method. - #125900

Merged
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov
Apr 8, 2026
Merged

[Runtime Async] Support for covariant override of Task- returning base with a Task<T>- returning derived method.#125900
VSadov merged 21 commits into
dotnet:mainfrom
VSadov:asyncCov

Conversation

@VSadov

@VSadovVSadov commented Mar 22, 2026

Copy link
Copy Markdown
Member

Contributes to: #124238

(Note: this does not deal with the Task<T> -> SomeCustomType return override. That will need a completely different fix, - no special thunks needed in that case).

== The problem:

When we have Task-returning method overriden with Task<T>-returning method, in the paralell "async space" we see a void-returning base logically overridden with a T-returning derived. That cannot work as-is in a virtual call as the caller/calee would be in disagreement whether there is a need for the return buffer and for a return slot in the continuation.
We need a thunk that could override the void-returning base and bridge into derived methods that are now in the T-returning virtual slot.

There are some additional inconveniences from the part that method descs/slots are added very early in the type system construction when we may not know exact types returned by the base/derived.
However, since Task<T> has uncomplicated base hierarchy, we can figure with good certainty that we may have Task<T> -> Task case.

== Implementation strategy.

  • Introduce a special kind of an async variant that has the same signature as the regular T-returning async variant, except that it is void-returning. The body of this new variant simply calls the T-returning async variant and then ignores the return.

  • In a case when we may have Task -> Task<T> return override, we introduce 2 async variants for the overriding method.
    I.E. we may end up with 3 method descs/bodies that represent the same method definition in IL:
    -- Task<T>-returning variant,
    -- regular T-returning Async variant. Either this or the one above has user code. and
    -- special void-returnig Async variant. Always a thunk.

  • Since we can have 3 variants, the existing Matching/Other variant lookups must be replaced with explicit lookups that specifically tell what kind of variant is desired.
    Matching/Other was already somewhat confusing when getting deeper into helper calls as we need extra context of what we are Other from or Matching. With 3 variants the Other becomes even more confusing.

  • One observation - we never need to lookup for the return-dropping thunk, thus we do not need a lookup value for it. Noone should call this thunk directly. The only purpose of the thunk is to override void-returning base. The model allows for adding a lookup value that matches return-dropping thunk, just it seems there is no need.

  • When matching overrides for async variants we require that derived/base signatures are completely equivalent - including return types.
    This way the void-returning thunk will match with the void-returning base and the T-returning variant will be the base of the new chain of overrides. - Exactly what we need.

@dotnet-policy-service

Copy link
Copy Markdown
Contributor

Tagging subscribers to this area: @agocke
See info in area-owners.md if you want to be subscribed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates CoreCLR’s Runtime Async “variant/thunk” machinery to correctly support covariant overrides where a base virtual returns Task and an override returns Task<T> by introducing an additional void-returning async thunk that drops the T result, and adds a regression test covering the scenario.

Changes:

  • Add a new “return dropping” async thunk variant used to bridge Task<T> overrides back to Task-based async variants in base slots.
  • Refactor async-variant lookup from “matching/other” semantics to explicit Ordinary vs Async lookup and thread that through associated-method/parallel-method resolution.
  • Add an async test case for TaskTask<T> covariant override behavior.

Reviewed changes

Copilot reviewed 16 out of 16 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
src/tests/async/covariant-return/covariant-returns.csprojAdds a new Runtime Async test project for covariant-return scenarios.
src/tests/async/covariant-return/covariant-returns.csAdds a regression test for Task base overridden by Task<T> and derived async override cases.
src/coreclr/vm/zapsig.cppUpdates associated-MethodDesc resolution to use explicit Ordinary/Async variant lookup.
src/coreclr/vm/stubmgr.cppAdjusts debugger thunk step-through logic to use the renamed variant accessor.
src/coreclr/vm/runtimehandles.cppEnsures reflection normalizes away async variants via GetOrdinaryVariant.
src/coreclr/vm/methodtablebuilder.hRemoves builder-time “other variant” linkage and switches to lookup-based selection.
src/coreclr/vm/methodtablebuilder.cppAdds a third declared-method pass for return-dropping async thunks in covariant override cases; updates async-variant resolution logic.
src/coreclr/vm/methodtable.hSplits GetParallelMethodDesc into overloads (no-lookup + lookup).
src/coreclr/vm/methodtable.cppImplements new overload structure and updates async-variant mapping logic.
src/coreclr/vm/method.hppIntroduces ReturnDroppingThunk flag, MatchesAsyncVariantLookup, new variant accessors, and updated associated-method APIs.
src/coreclr/vm/method.cppExtends return-kind classification to capture generic element type length for signature rewriting.
src/coreclr/vm/memberload.cppUpdates associated-MethodDesc creation call sites for new signature/lookup behavior.
src/coreclr/vm/jitinterface.cppUpdates JIT query for “other async variant” to use GetAsyncVariant/GetOrdinaryVariant.
src/coreclr/vm/genmeth.cppUpdates associated-MethodDesc logic to use explicit MatchesAsyncVariantLookup checks and new parameter ordering.
src/coreclr/vm/class.cppRemoves special-case skipping of async variants during covariant return validation.
src/coreclr/vm/asyncthunks.cppAdds return-dropping thunk IL emission and refactors token selection into a helper.
Comments suppressed due to low confidence (1)

src/coreclr/vm/method.hpp:1748

  • GetAsyncOtherVariantNoCreate still references HasAsyncOtherVariant() and AsyncVariantLookup::AsyncOtherVariant, but HasAsyncOtherVariant/AsyncOtherVariant are no longer defined after the enum/API rename. This will break the build and also leaves existing callers (e.g. DAC) without a valid no-create path. Update/remove this helper to use the new Ordinary/Async lookup model (potentially adding an GetOrdinaryVariantNoCreate or a new GetOtherVariantNoCreate that handles ReturnDroppingThunk).
 MethodDesc* GetAsyncOtherVariantNoCreate(BOOL allowInstParam = TRUE)
{
_ASSERTE(HasAsyncOtherVariant());
return FindOrCreateAssociatedMethodDesc(this, GetMethodTable(), FALSE, GetMethodInstantiation(), allowInstParam, FALSE, FALSE, AsyncVariantLookup::AsyncOtherVariant);
}

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/tests/async/covariant-return/covariant-returns.cs

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 3 comments.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo attempts to map async thunk MethodDescs to the non-thunk variant (so the debugger can report code info for the actual implementation). Replacing GetAsyncOtherVariantNoCreate() with GetOrdinaryVariantNoCreate() breaks this for cases where the ordinary method is itself the thunk (e.g., MethodImpl.Async), and for ReturnDroppingThunk it will also point at the wrong target. Consider switching back to “other variant” semantics (choose Async vs Ordinary based on pMethodDesc->IsAsyncMethod() and whether it is a ReturnDroppingThunk) while keeping the no-create behavior.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/method.hpp
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp
@VSadov

Copy link
Copy Markdown
MemberAuthor

I think this is ready to be reviewed.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (1)

src/coreclr/vm/method.cpp:2402

  • ClassifyMethodReturnKind only writes *elementTypeLength on the GenericTaskReturningMethod path. Since this is an out-parameter, initialize it (e.g., set to 0 near the start of the function) so callers don’t accidentally read an uninitialized value in non-generic/non-task cases.
MethodReturnKind ClassifyMethodReturnKind(SigPointer sig, Module* pModule, ULONG* offsetOfAsyncDetails, ULONG* elementTypeLength, bool *isValueTask)
{
// Without runtime async, every declared method is classified as a NormalMethod.
// Thus code that handles runtime async scenarios becomes unreachable.
if (!g_pConfig->RuntimeAsync())
{
return MethodReturnKind::NormalMethod;
}
PCCOR_SIGNATURE initialSig = sig.GetPtr();

Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
Comment threadsrc/coreclr/vm/stubmgr.cpp Outdated
CopilotAI review requested due to automatic review settings March 24, 2026 23:10

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (1)

src/coreclr/debug/daccess/dacdbiimpl.cpp:1289

  • GetNativeCodeInfo resolves a MethodDesc from a metadata token, so when it finds an async thunk MethodDesc it needs to map to the other (non-thunk) variant that contains the actual body for correct breakpoint/code-region reporting. Switching to GetOrdinaryVariantNoCreate() does not do that for ordinary Task/ValueTask-returning thunks (it returns the same thunk). Consider selecting the non-thunk counterpart explicitly (e.g., for an ordinary thunk, use the async variant; for an async-variant thunk, use the ordinary variant), and keep this in the no-create path.
 if (pMethodDesc != NULL && pMethodDesc->IsAsyncThunkMethod())
{
MethodDesc* pAsyncVariant = pMethodDesc->GetOrdinaryVariantNoCreate();
if (pAsyncVariant != NULL)
{
pMethodDesc = pAsyncVariant;
}

Comment threadsrc/coreclr/vm/stubmgr.cpp
Comment threadsrc/coreclr/vm/asyncthunks.cpp
CopilotAI review requested due to automatic review settings March 27, 2026 01:56

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.

Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
Comment threadsrc/coreclr/vm/methodtablebuilder.cpp Outdated
@VSadov
VSadov enabled auto-merge (squash) April 8, 2026 03:15
@VSadov
VSadov merged commit a6149c0 into dotnet:mainApr 8, 2026
115 of 117 checks passed
@@ -0,0 +1,9 @@
<Project Sdk="Microsoft.NET.Sdk">
<PropertyGroup>
<!-- Async covariant return NYI in NativeAOT -->

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Disabling tests without filing a bug is not cool. I only found out there may be work to do because you forgot to disable on ReadyToRun and I saw the bugs #126682 and #126683 that got filed for it.

tommcdon added a commit that referenced this pull request Apr 10, 2026
…scs (#126728)
Regressed by #125900 from #124354
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
eduardo-vp added a commit that referenced this pull request Apr 21, 2026
…<T> (#126768)
Mirrors work in #125900 for Native AOT.
Fixes#126685.
---------
Co-authored-by: Eduardo Velarde <evelardepola@microsoft.com>
Co-authored-by: Michal Strehovský <MichalStrehovsky@users.noreply.github.com>
@github-actionsgithub-actionsBot locked and limited conversation to collaborators May 9, 2026
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@VSadov@jkotas@jakobbotsch@davidwrighton@MichalStrehovsky