fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully - #63207

Closed
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089
Closed

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully#63207
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089

Conversation

@YoannAbriel

Copy link
Copy Markdown
Contributor

Problem

TriggerDagRunOperator crashes with UnboundLocalError: cannot access local variable 'state' when targeting a non-existent DAG. The API server returns 404, which SUPERVISOR_COMMS.send() re-raises as ServerResponseError — but this propagates past all exception handlers in run() into the finally block where state was declared but never assigned.

Root Cause

Two issues:

  1. state: TaskInstanceState in run() is declared without a default value. Any unhandled exception reaching the finally block causes UnboundLocalError when accessing state.value for stats.

  2. The DagRunOperations.trigger() client method only handles 409 (conflict) — a 404 from the API server is re-raised as ServerResponseError, which isn't caught by _handle_trigger_dag_run.

Fix

  • Initialize state = TaskInstanceState.FAILED as a safe default so the finally block always works, regardless of what exception propagates.
  • Add DAG_NOT_FOUND to ErrorType enum.
  • Handle 404 in DagRunOperations.trigger(), returning ErrorResponse(error=ErrorType.DAG_NOT_FOUND).
  • Handle DAG_NOT_FOUND in _handle_trigger_dag_run, failing the task gracefully instead of crashing.

Tests added for both the client-side 404 handling and the task runner DAG-not-found path.

Closes: #63089


Was generative AI tooling used to co-author this PR?
  • Yes — Claude Code

Generated-by: Claude Code following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 7 times, most recently from 7dac8a9 to 8b6e936CompareMarch 16, 2026 16:09
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 82c16cd to 898514dCompareMarch 23, 2026 19:07
@potiukpotiuk added the ready for maintainer review Set after triaging when all criteria pass. label Apr 2, 2026
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 10 times, most recently from 175a64a to 9cd3765CompareApril 10, 2026 09:04
@kaxil
kaxil requested a review from CopilotApril 10, 2026 19:55

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Comment on lines +4462 to +4465

log = mock.MagicMock()
mock_supervisor_comms.send.return_value = ErrorResponse(error=ErrorType.DAG_NOT_FOUND)
state, msg, _ = run(ti, ti.get_template_context(), log)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New test introduces an unspecced mock.MagicMock() for log. Airflow’s testing guidelines prefer mocks with spec/autospec to avoid silently accepting unexpected attributes; consider using a real structlog.get_logger(...) or mock.Mock(spec=...) for the logger instead.

Copilot generated this review using guidance from repository custom instructions.
Comment on lines +728 to +729
log.error("Dag not found.", dag_id=dag_id)
return ErrorResponse(error=ErrorType.DAG_NOT_FOUND)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new 404 handling logs only a generic "Dag not found" message and doesn’t include available response context (e.detail, status_code). Consider logging those fields (and/or returning them in ErrorResponse.detail) for easier debugging, consistent with other client methods’ 404 handling.

Suggested change
log.error("Dag not found.", dag_id=dag_id)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND)
log.error(
"Dag not found.",
dag_id=dag_id,
status_code=e.response.status_code,
detail=e.detail,
)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND, detail=e.detail)

Copilot uses AI. Check for mistakes.
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 69533e8 to e8284feCompareApril 13, 2026 06:06
When TriggerDagRunOperator targets a non-existent DAG, the API server
returns 404 which was re-raised as ServerResponseError. This propagated
out of _handle_trigger_dag_run into the finally block of run() where
'state' was never assigned, causing UnboundLocalError.
Two fixes:
- Initialize state to FAILED before the try block so the finally block
always has a valid value
- Handle 404 in the dag_runs client (returning DAG_NOT_FOUND error) and
in _handle_trigger_dag_run (failing the task gracefully)
Closes: apache#63089
@potiukpotiuk removed the ready for maintainer review Set after triaging when all criteria pass. label May 18, 2026
@potiuk
potiuk marked this pull request as draft May 18, 2026 10:46
@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel — Removing the ready for maintainer review label and converting back to draft. The branch now has merge conflicts with main that surfaced after the label was added.

The label's contract is that the PR is ready for maintainer review — a regression like this means the PR temporarily isn't. Rebase your branch onto the latest main, resolve conflicts, then mark "Ready for review" again to re-enter the queue.

git fetch upstream main && git rebase upstream/main, resolve, git push --force-with-lease. See the working-with-git docs.

No rush.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel This draft PR has had no activity for 2 weeks. Closing to keep the queue clean.

You are welcome to reopen and continue when you're ready. If you'd like to pick it back up, please rebase onto the current main branch first.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

UnboundLocalError on TriggerDagRunOperator triggering a dag that doesn't exist

3 participants

@YoannAbriel@potiuk
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully - #63207

Closed
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089
Closed

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully#63207
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089

Conversation

@YoannAbriel

Copy link
Copy Markdown
Contributor

Problem

TriggerDagRunOperator crashes with UnboundLocalError: cannot access local variable 'state' when targeting a non-existent DAG. The API server returns 404, which SUPERVISOR_COMMS.send() re-raises as ServerResponseError — but this propagates past all exception handlers in run() into the finally block where state was declared but never assigned.

Root Cause

Two issues:

  1. state: TaskInstanceState in run() is declared without a default value. Any unhandled exception reaching the finally block causes UnboundLocalError when accessing state.value for stats.

  2. The DagRunOperations.trigger() client method only handles 409 (conflict) — a 404 from the API server is re-raised as ServerResponseError, which isn't caught by _handle_trigger_dag_run.

Fix

  • Initialize state = TaskInstanceState.FAILED as a safe default so the finally block always works, regardless of what exception propagates.
  • Add DAG_NOT_FOUND to ErrorType enum.
  • Handle 404 in DagRunOperations.trigger(), returning ErrorResponse(error=ErrorType.DAG_NOT_FOUND).
  • Handle DAG_NOT_FOUND in _handle_trigger_dag_run, failing the task gracefully instead of crashing.

Tests added for both the client-side 404 handling and the task runner DAG-not-found path.

Closes: #63089


Was generative AI tooling used to co-author this PR?
  • Yes — Claude Code

Generated-by: Claude Code following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 7 times, most recently from 7dac8a9 to 8b6e936CompareMarch 16, 2026 16:09
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 82c16cd to 898514dCompareMarch 23, 2026 19:07
@potiukpotiuk added the ready for maintainer review Set after triaging when all criteria pass. label Apr 2, 2026
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 10 times, most recently from 175a64a to 9cd3765CompareApril 10, 2026 09:04
@kaxil
kaxil requested a review from CopilotApril 10, 2026 19:55

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Comment on lines +4462 to +4465

log = mock.MagicMock()
mock_supervisor_comms.send.return_value = ErrorResponse(error=ErrorType.DAG_NOT_FOUND)
state, msg, _ = run(ti, ti.get_template_context(), log)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New test introduces an unspecced mock.MagicMock() for log. Airflow’s testing guidelines prefer mocks with spec/autospec to avoid silently accepting unexpected attributes; consider using a real structlog.get_logger(...) or mock.Mock(spec=...) for the logger instead.

Copilot generated this review using guidance from repository custom instructions.
Comment on lines +728 to +729
log.error("Dag not found.", dag_id=dag_id)
return ErrorResponse(error=ErrorType.DAG_NOT_FOUND)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new 404 handling logs only a generic "Dag not found" message and doesn’t include available response context (e.detail, status_code). Consider logging those fields (and/or returning them in ErrorResponse.detail) for easier debugging, consistent with other client methods’ 404 handling.

Suggested change
log.error("Dag not found.", dag_id=dag_id)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND)
log.error(
"Dag not found.",
dag_id=dag_id,
status_code=e.response.status_code,
detail=e.detail,
)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND, detail=e.detail)

Copilot uses AI. Check for mistakes.
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 69533e8 to e8284feCompareApril 13, 2026 06:06
When TriggerDagRunOperator targets a non-existent DAG, the API server
returns 404 which was re-raised as ServerResponseError. This propagated
out of _handle_trigger_dag_run into the finally block of run() where
'state' was never assigned, causing UnboundLocalError.
Two fixes:
- Initialize state to FAILED before the try block so the finally block
always has a valid value
- Handle 404 in the dag_runs client (returning DAG_NOT_FOUND error) and
in _handle_trigger_dag_run (failing the task gracefully)
Closes: apache#63089
@potiukpotiuk removed the ready for maintainer review Set after triaging when all criteria pass. label May 18, 2026
@potiuk
potiuk marked this pull request as draft May 18, 2026 10:46
@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel — Removing the ready for maintainer review label and converting back to draft. The branch now has merge conflicts with main that surfaced after the label was added.

The label's contract is that the PR is ready for maintainer review — a regression like this means the PR temporarily isn't. Rebase your branch onto the latest main, resolve conflicts, then mark "Ready for review" again to re-enter the queue.

git fetch upstream main && git rebase upstream/main, resolve, git push --force-with-lease. See the working-with-git docs.

No rush.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel This draft PR has had no activity for 2 weeks. Closing to keep the queue clean.

You are welcome to reopen and continue when you're ready. If you'd like to pick it back up, please rebase onto the current main branch first.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

UnboundLocalError on TriggerDagRunOperator triggering a dag that doesn't exist

3 participants

@YoannAbriel@potiuk
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully - #63207

Closed
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089
Closed

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully#63207
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089

Conversation

@YoannAbriel

Copy link
Copy Markdown
Contributor

Problem

TriggerDagRunOperator crashes with UnboundLocalError: cannot access local variable 'state' when targeting a non-existent DAG. The API server returns 404, which SUPERVISOR_COMMS.send() re-raises as ServerResponseError — but this propagates past all exception handlers in run() into the finally block where state was declared but never assigned.

Root Cause

Two issues:

  1. state: TaskInstanceState in run() is declared without a default value. Any unhandled exception reaching the finally block causes UnboundLocalError when accessing state.value for stats.

  2. The DagRunOperations.trigger() client method only handles 409 (conflict) — a 404 from the API server is re-raised as ServerResponseError, which isn't caught by _handle_trigger_dag_run.

Fix

  • Initialize state = TaskInstanceState.FAILED as a safe default so the finally block always works, regardless of what exception propagates.
  • Add DAG_NOT_FOUND to ErrorType enum.
  • Handle 404 in DagRunOperations.trigger(), returning ErrorResponse(error=ErrorType.DAG_NOT_FOUND).
  • Handle DAG_NOT_FOUND in _handle_trigger_dag_run, failing the task gracefully instead of crashing.

Tests added for both the client-side 404 handling and the task runner DAG-not-found path.

Closes: #63089


Was generative AI tooling used to co-author this PR?
  • Yes — Claude Code

Generated-by: Claude Code following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 7 times, most recently from 7dac8a9 to 8b6e936CompareMarch 16, 2026 16:09
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 82c16cd to 898514dCompareMarch 23, 2026 19:07
@potiukpotiuk added the ready for maintainer review Set after triaging when all criteria pass. label Apr 2, 2026
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 10 times, most recently from 175a64a to 9cd3765CompareApril 10, 2026 09:04
@kaxil
kaxil requested a review from CopilotApril 10, 2026 19:55

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Comment on lines +4462 to +4465

log = mock.MagicMock()
mock_supervisor_comms.send.return_value = ErrorResponse(error=ErrorType.DAG_NOT_FOUND)
state, msg, _ = run(ti, ti.get_template_context(), log)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New test introduces an unspecced mock.MagicMock() for log. Airflow’s testing guidelines prefer mocks with spec/autospec to avoid silently accepting unexpected attributes; consider using a real structlog.get_logger(...) or mock.Mock(spec=...) for the logger instead.

Copilot generated this review using guidance from repository custom instructions.
Comment on lines +728 to +729
log.error("Dag not found.", dag_id=dag_id)
return ErrorResponse(error=ErrorType.DAG_NOT_FOUND)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new 404 handling logs only a generic "Dag not found" message and doesn’t include available response context (e.detail, status_code). Consider logging those fields (and/or returning them in ErrorResponse.detail) for easier debugging, consistent with other client methods’ 404 handling.

Suggested change
log.error("Dag not found.", dag_id=dag_id)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND)
log.error(
"Dag not found.",
dag_id=dag_id,
status_code=e.response.status_code,
detail=e.detail,
)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND, detail=e.detail)

Copilot uses AI. Check for mistakes.
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 69533e8 to e8284feCompareApril 13, 2026 06:06
When TriggerDagRunOperator targets a non-existent DAG, the API server
returns 404 which was re-raised as ServerResponseError. This propagated
out of _handle_trigger_dag_run into the finally block of run() where
'state' was never assigned, causing UnboundLocalError.
Two fixes:
- Initialize state to FAILED before the try block so the finally block
always has a valid value
- Handle 404 in the dag_runs client (returning DAG_NOT_FOUND error) and
in _handle_trigger_dag_run (failing the task gracefully)
Closes: apache#63089
@potiukpotiuk removed the ready for maintainer review Set after triaging when all criteria pass. label May 18, 2026
@potiuk
potiuk marked this pull request as draft May 18, 2026 10:46
@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel — Removing the ready for maintainer review label and converting back to draft. The branch now has merge conflicts with main that surfaced after the label was added.

The label's contract is that the PR is ready for maintainer review — a regression like this means the PR temporarily isn't. Rebase your branch onto the latest main, resolve conflicts, then mark "Ready for review" again to re-enter the queue.

git fetch upstream main && git rebase upstream/main, resolve, git push --force-with-lease. See the working-with-git docs.

No rush.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel This draft PR has had no activity for 2 weeks. Closing to keep the queue clean.

You are welcome to reopen and continue when you're ready. If you'd like to pick it back up, please rebase onto the current main branch first.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

UnboundLocalError on TriggerDagRunOperator triggering a dag that doesn't exist

3 participants

@YoannAbriel@potiuk
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully - #63207

Closed
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089
Closed

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully#63207
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089

Conversation

@YoannAbriel

Copy link
Copy Markdown
Contributor

Problem

TriggerDagRunOperator crashes with UnboundLocalError: cannot access local variable 'state' when targeting a non-existent DAG. The API server returns 404, which SUPERVISOR_COMMS.send() re-raises as ServerResponseError — but this propagates past all exception handlers in run() into the finally block where state was declared but never assigned.

Root Cause

Two issues:

  1. state: TaskInstanceState in run() is declared without a default value. Any unhandled exception reaching the finally block causes UnboundLocalError when accessing state.value for stats.

  2. The DagRunOperations.trigger() client method only handles 409 (conflict) — a 404 from the API server is re-raised as ServerResponseError, which isn't caught by _handle_trigger_dag_run.

Fix

  • Initialize state = TaskInstanceState.FAILED as a safe default so the finally block always works, regardless of what exception propagates.
  • Add DAG_NOT_FOUND to ErrorType enum.
  • Handle 404 in DagRunOperations.trigger(), returning ErrorResponse(error=ErrorType.DAG_NOT_FOUND).
  • Handle DAG_NOT_FOUND in _handle_trigger_dag_run, failing the task gracefully instead of crashing.

Tests added for both the client-side 404 handling and the task runner DAG-not-found path.

Closes: #63089


Was generative AI tooling used to co-author this PR?
  • Yes — Claude Code

Generated-by: Claude Code following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 7 times, most recently from 7dac8a9 to 8b6e936CompareMarch 16, 2026 16:09
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 82c16cd to 898514dCompareMarch 23, 2026 19:07
@potiukpotiuk added the ready for maintainer review Set after triaging when all criteria pass. label Apr 2, 2026
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 10 times, most recently from 175a64a to 9cd3765CompareApril 10, 2026 09:04
@kaxil
kaxil requested a review from CopilotApril 10, 2026 19:55

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Comment on lines +4462 to +4465

log = mock.MagicMock()
mock_supervisor_comms.send.return_value = ErrorResponse(error=ErrorType.DAG_NOT_FOUND)
state, msg, _ = run(ti, ti.get_template_context(), log)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New test introduces an unspecced mock.MagicMock() for log. Airflow’s testing guidelines prefer mocks with spec/autospec to avoid silently accepting unexpected attributes; consider using a real structlog.get_logger(...) or mock.Mock(spec=...) for the logger instead.

Copilot generated this review using guidance from repository custom instructions.
Comment on lines +728 to +729
log.error("Dag not found.", dag_id=dag_id)
return ErrorResponse(error=ErrorType.DAG_NOT_FOUND)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new 404 handling logs only a generic "Dag not found" message and doesn’t include available response context (e.detail, status_code). Consider logging those fields (and/or returning them in ErrorResponse.detail) for easier debugging, consistent with other client methods’ 404 handling.

Suggested change
log.error("Dag not found.", dag_id=dag_id)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND)
log.error(
"Dag not found.",
dag_id=dag_id,
status_code=e.response.status_code,
detail=e.detail,
)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND, detail=e.detail)

Copilot uses AI. Check for mistakes.
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 69533e8 to e8284feCompareApril 13, 2026 06:06
When TriggerDagRunOperator targets a non-existent DAG, the API server
returns 404 which was re-raised as ServerResponseError. This propagated
out of _handle_trigger_dag_run into the finally block of run() where
'state' was never assigned, causing UnboundLocalError.
Two fixes:
- Initialize state to FAILED before the try block so the finally block
always has a valid value
- Handle 404 in the dag_runs client (returning DAG_NOT_FOUND error) and
in _handle_trigger_dag_run (failing the task gracefully)
Closes: apache#63089
@potiukpotiuk removed the ready for maintainer review Set after triaging when all criteria pass. label May 18, 2026
@potiuk
potiuk marked this pull request as draft May 18, 2026 10:46
@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel — Removing the ready for maintainer review label and converting back to draft. The branch now has merge conflicts with main that surfaced after the label was added.

The label's contract is that the PR is ready for maintainer review — a regression like this means the PR temporarily isn't. Rebase your branch onto the latest main, resolve conflicts, then mark "Ready for review" again to re-enter the queue.

git fetch upstream main && git rebase upstream/main, resolve, git push --force-with-lease. See the working-with-git docs.

No rush.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel This draft PR has had no activity for 2 weeks. Closing to keep the queue clean.

You are welcome to reopen and continue when you're ready. If you'd like to pick it back up, please rebase onto the current main branch first.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

UnboundLocalError on TriggerDagRunOperator triggering a dag that doesn't exist

3 participants

@YoannAbriel@potiuk
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully - #63207

Closed
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089
Closed

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully#63207
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089

Conversation

@YoannAbriel

Copy link
Copy Markdown
Contributor

Problem

TriggerDagRunOperator crashes with UnboundLocalError: cannot access local variable 'state' when targeting a non-existent DAG. The API server returns 404, which SUPERVISOR_COMMS.send() re-raises as ServerResponseError — but this propagates past all exception handlers in run() into the finally block where state was declared but never assigned.

Root Cause

Two issues:

  1. state: TaskInstanceState in run() is declared without a default value. Any unhandled exception reaching the finally block causes UnboundLocalError when accessing state.value for stats.

  2. The DagRunOperations.trigger() client method only handles 409 (conflict) — a 404 from the API server is re-raised as ServerResponseError, which isn't caught by _handle_trigger_dag_run.

Fix

  • Initialize state = TaskInstanceState.FAILED as a safe default so the finally block always works, regardless of what exception propagates.
  • Add DAG_NOT_FOUND to ErrorType enum.
  • Handle 404 in DagRunOperations.trigger(), returning ErrorResponse(error=ErrorType.DAG_NOT_FOUND).
  • Handle DAG_NOT_FOUND in _handle_trigger_dag_run, failing the task gracefully instead of crashing.

Tests added for both the client-side 404 handling and the task runner DAG-not-found path.

Closes: #63089


Was generative AI tooling used to co-author this PR?
  • Yes — Claude Code

Generated-by: Claude Code following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 7 times, most recently from 7dac8a9 to 8b6e936CompareMarch 16, 2026 16:09
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 82c16cd to 898514dCompareMarch 23, 2026 19:07
@potiukpotiuk added the ready for maintainer review Set after triaging when all criteria pass. label Apr 2, 2026
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 10 times, most recently from 175a64a to 9cd3765CompareApril 10, 2026 09:04
@kaxil
kaxil requested a review from CopilotApril 10, 2026 19:55

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Comment on lines +4462 to +4465

log = mock.MagicMock()
mock_supervisor_comms.send.return_value = ErrorResponse(error=ErrorType.DAG_NOT_FOUND)
state, msg, _ = run(ti, ti.get_template_context(), log)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New test introduces an unspecced mock.MagicMock() for log. Airflow’s testing guidelines prefer mocks with spec/autospec to avoid silently accepting unexpected attributes; consider using a real structlog.get_logger(...) or mock.Mock(spec=...) for the logger instead.

Copilot generated this review using guidance from repository custom instructions.
Comment on lines +728 to +729
log.error("Dag not found.", dag_id=dag_id)
return ErrorResponse(error=ErrorType.DAG_NOT_FOUND)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new 404 handling logs only a generic "Dag not found" message and doesn’t include available response context (e.detail, status_code). Consider logging those fields (and/or returning them in ErrorResponse.detail) for easier debugging, consistent with other client methods’ 404 handling.

Suggested change
log.error("Dag not found.", dag_id=dag_id)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND)
log.error(
"Dag not found.",
dag_id=dag_id,
status_code=e.response.status_code,
detail=e.detail,
)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND, detail=e.detail)

Copilot uses AI. Check for mistakes.
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 69533e8 to e8284feCompareApril 13, 2026 06:06
When TriggerDagRunOperator targets a non-existent DAG, the API server
returns 404 which was re-raised as ServerResponseError. This propagated
out of _handle_trigger_dag_run into the finally block of run() where
'state' was never assigned, causing UnboundLocalError.
Two fixes:
- Initialize state to FAILED before the try block so the finally block
always has a valid value
- Handle 404 in the dag_runs client (returning DAG_NOT_FOUND error) and
in _handle_trigger_dag_run (failing the task gracefully)
Closes: apache#63089
@potiukpotiuk removed the ready for maintainer review Set after triaging when all criteria pass. label May 18, 2026
@potiuk
potiuk marked this pull request as draft May 18, 2026 10:46
@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel — Removing the ready for maintainer review label and converting back to draft. The branch now has merge conflicts with main that surfaced after the label was added.

The label's contract is that the PR is ready for maintainer review — a regression like this means the PR temporarily isn't. Rebase your branch onto the latest main, resolve conflicts, then mark "Ready for review" again to re-enter the queue.

git fetch upstream main && git rebase upstream/main, resolve, git push --force-with-lease. See the working-with-git docs.

No rush.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel This draft PR has had no activity for 2 weeks. Closing to keep the queue clean.

You are welcome to reopen and continue when you're ready. If you'd like to pick it back up, please rebase onto the current main branch first.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

UnboundLocalError on TriggerDagRunOperator triggering a dag that doesn't exist

3 participants

@YoannAbriel@potiuk
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully - #63207

Closed
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089
Closed

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully#63207
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089

Conversation

@YoannAbriel

Copy link
Copy Markdown
Contributor

Problem

TriggerDagRunOperator crashes with UnboundLocalError: cannot access local variable 'state' when targeting a non-existent DAG. The API server returns 404, which SUPERVISOR_COMMS.send() re-raises as ServerResponseError — but this propagates past all exception handlers in run() into the finally block where state was declared but never assigned.

Root Cause

Two issues:

  1. state: TaskInstanceState in run() is declared without a default value. Any unhandled exception reaching the finally block causes UnboundLocalError when accessing state.value for stats.

  2. The DagRunOperations.trigger() client method only handles 409 (conflict) — a 404 from the API server is re-raised as ServerResponseError, which isn't caught by _handle_trigger_dag_run.

Fix

  • Initialize state = TaskInstanceState.FAILED as a safe default so the finally block always works, regardless of what exception propagates.
  • Add DAG_NOT_FOUND to ErrorType enum.
  • Handle 404 in DagRunOperations.trigger(), returning ErrorResponse(error=ErrorType.DAG_NOT_FOUND).
  • Handle DAG_NOT_FOUND in _handle_trigger_dag_run, failing the task gracefully instead of crashing.

Tests added for both the client-side 404 handling and the task runner DAG-not-found path.

Closes: #63089


Was generative AI tooling used to co-author this PR?
  • Yes — Claude Code

Generated-by: Claude Code following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 7 times, most recently from 7dac8a9 to 8b6e936CompareMarch 16, 2026 16:09
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 82c16cd to 898514dCompareMarch 23, 2026 19:07
@potiukpotiuk added the ready for maintainer review Set after triaging when all criteria pass. label Apr 2, 2026
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 10 times, most recently from 175a64a to 9cd3765CompareApril 10, 2026 09:04
@kaxil
kaxil requested a review from CopilotApril 10, 2026 19:55

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Comment on lines +4462 to +4465

log = mock.MagicMock()
mock_supervisor_comms.send.return_value = ErrorResponse(error=ErrorType.DAG_NOT_FOUND)
state, msg, _ = run(ti, ti.get_template_context(), log)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New test introduces an unspecced mock.MagicMock() for log. Airflow’s testing guidelines prefer mocks with spec/autospec to avoid silently accepting unexpected attributes; consider using a real structlog.get_logger(...) or mock.Mock(spec=...) for the logger instead.

Copilot generated this review using guidance from repository custom instructions.
Comment on lines +728 to +729
log.error("Dag not found.", dag_id=dag_id)
return ErrorResponse(error=ErrorType.DAG_NOT_FOUND)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new 404 handling logs only a generic "Dag not found" message and doesn’t include available response context (e.detail, status_code). Consider logging those fields (and/or returning them in ErrorResponse.detail) for easier debugging, consistent with other client methods’ 404 handling.

Suggested change
log.error("Dag not found.", dag_id=dag_id)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND)
log.error(
"Dag not found.",
dag_id=dag_id,
status_code=e.response.status_code,
detail=e.detail,
)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND, detail=e.detail)

Copilot uses AI. Check for mistakes.
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 69533e8 to e8284feCompareApril 13, 2026 06:06
When TriggerDagRunOperator targets a non-existent DAG, the API server
returns 404 which was re-raised as ServerResponseError. This propagated
out of _handle_trigger_dag_run into the finally block of run() where
'state' was never assigned, causing UnboundLocalError.
Two fixes:
- Initialize state to FAILED before the try block so the finally block
always has a valid value
- Handle 404 in the dag_runs client (returning DAG_NOT_FOUND error) and
in _handle_trigger_dag_run (failing the task gracefully)
Closes: apache#63089
@potiukpotiuk removed the ready for maintainer review Set after triaging when all criteria pass. label May 18, 2026
@potiuk
potiuk marked this pull request as draft May 18, 2026 10:46
@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel — Removing the ready for maintainer review label and converting back to draft. The branch now has merge conflicts with main that surfaced after the label was added.

The label's contract is that the PR is ready for maintainer review — a regression like this means the PR temporarily isn't. Rebase your branch onto the latest main, resolve conflicts, then mark "Ready for review" again to re-enter the queue.

git fetch upstream main && git rebase upstream/main, resolve, git push --force-with-lease. See the working-with-git docs.

No rush.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel This draft PR has had no activity for 2 weeks. Closing to keep the queue clean.

You are welcome to reopen and continue when you're ready. If you'd like to pick it back up, please rebase onto the current main branch first.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

UnboundLocalError on TriggerDagRunOperator triggering a dag that doesn't exist

3 participants

@YoannAbriel@potiuk
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully - #63207

Closed
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089
Closed

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully#63207
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089

Conversation

@YoannAbriel

Copy link
Copy Markdown
Contributor

Problem

TriggerDagRunOperator crashes with UnboundLocalError: cannot access local variable 'state' when targeting a non-existent DAG. The API server returns 404, which SUPERVISOR_COMMS.send() re-raises as ServerResponseError — but this propagates past all exception handlers in run() into the finally block where state was declared but never assigned.

Root Cause

Two issues:

  1. state: TaskInstanceState in run() is declared without a default value. Any unhandled exception reaching the finally block causes UnboundLocalError when accessing state.value for stats.

  2. The DagRunOperations.trigger() client method only handles 409 (conflict) — a 404 from the API server is re-raised as ServerResponseError, which isn't caught by _handle_trigger_dag_run.

Fix

  • Initialize state = TaskInstanceState.FAILED as a safe default so the finally block always works, regardless of what exception propagates.
  • Add DAG_NOT_FOUND to ErrorType enum.
  • Handle 404 in DagRunOperations.trigger(), returning ErrorResponse(error=ErrorType.DAG_NOT_FOUND).
  • Handle DAG_NOT_FOUND in _handle_trigger_dag_run, failing the task gracefully instead of crashing.

Tests added for both the client-side 404 handling and the task runner DAG-not-found path.

Closes: #63089


Was generative AI tooling used to co-author this PR?
  • Yes — Claude Code

Generated-by: Claude Code following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 7 times, most recently from 7dac8a9 to 8b6e936CompareMarch 16, 2026 16:09
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 82c16cd to 898514dCompareMarch 23, 2026 19:07
@potiukpotiuk added the ready for maintainer review Set after triaging when all criteria pass. label Apr 2, 2026
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 10 times, most recently from 175a64a to 9cd3765CompareApril 10, 2026 09:04
@kaxil
kaxil requested a review from CopilotApril 10, 2026 19:55

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Comment on lines +4462 to +4465

log = mock.MagicMock()
mock_supervisor_comms.send.return_value = ErrorResponse(error=ErrorType.DAG_NOT_FOUND)
state, msg, _ = run(ti, ti.get_template_context(), log)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New test introduces an unspecced mock.MagicMock() for log. Airflow’s testing guidelines prefer mocks with spec/autospec to avoid silently accepting unexpected attributes; consider using a real structlog.get_logger(...) or mock.Mock(spec=...) for the logger instead.

Copilot generated this review using guidance from repository custom instructions.
Comment on lines +728 to +729
log.error("Dag not found.", dag_id=dag_id)
return ErrorResponse(error=ErrorType.DAG_NOT_FOUND)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new 404 handling logs only a generic "Dag not found" message and doesn’t include available response context (e.detail, status_code). Consider logging those fields (and/or returning them in ErrorResponse.detail) for easier debugging, consistent with other client methods’ 404 handling.

Suggested change
log.error("Dag not found.", dag_id=dag_id)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND)
log.error(
"Dag not found.",
dag_id=dag_id,
status_code=e.response.status_code,
detail=e.detail,
)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND, detail=e.detail)

Copilot uses AI. Check for mistakes.
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 69533e8 to e8284feCompareApril 13, 2026 06:06
When TriggerDagRunOperator targets a non-existent DAG, the API server
returns 404 which was re-raised as ServerResponseError. This propagated
out of _handle_trigger_dag_run into the finally block of run() where
'state' was never assigned, causing UnboundLocalError.
Two fixes:
- Initialize state to FAILED before the try block so the finally block
always has a valid value
- Handle 404 in the dag_runs client (returning DAG_NOT_FOUND error) and
in _handle_trigger_dag_run (failing the task gracefully)
Closes: apache#63089
@potiukpotiuk removed the ready for maintainer review Set after triaging when all criteria pass. label May 18, 2026
@potiuk
potiuk marked this pull request as draft May 18, 2026 10:46
@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel — Removing the ready for maintainer review label and converting back to draft. The branch now has merge conflicts with main that surfaced after the label was added.

The label's contract is that the PR is ready for maintainer review — a regression like this means the PR temporarily isn't. Rebase your branch onto the latest main, resolve conflicts, then mark "Ready for review" again to re-enter the queue.

git fetch upstream main && git rebase upstream/main, resolve, git push --force-with-lease. See the working-with-git docs.

No rush.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel This draft PR has had no activity for 2 weeks. Closing to keep the queue clean.

You are welcome to reopen and continue when you're ready. If you'd like to pick it back up, please rebase onto the current main branch first.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

UnboundLocalError on TriggerDagRunOperator triggering a dag that doesn't exist

3 participants

@YoannAbriel@potiuk
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully - #63207

Closed
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089
Closed

fix(task-sdk): handle missing DAG in TriggerDagRunOperator gracefully#63207
YoannAbriel wants to merge 2 commits into
apache:mainfrom
YoannAbriel:fix/issue-63089

Conversation

@YoannAbriel

Copy link
Copy Markdown
Contributor

Problem

TriggerDagRunOperator crashes with UnboundLocalError: cannot access local variable 'state' when targeting a non-existent DAG. The API server returns 404, which SUPERVISOR_COMMS.send() re-raises as ServerResponseError — but this propagates past all exception handlers in run() into the finally block where state was declared but never assigned.

Root Cause

Two issues:

  1. state: TaskInstanceState in run() is declared without a default value. Any unhandled exception reaching the finally block causes UnboundLocalError when accessing state.value for stats.

  2. The DagRunOperations.trigger() client method only handles 409 (conflict) — a 404 from the API server is re-raised as ServerResponseError, which isn't caught by _handle_trigger_dag_run.

Fix

  • Initialize state = TaskInstanceState.FAILED as a safe default so the finally block always works, regardless of what exception propagates.
  • Add DAG_NOT_FOUND to ErrorType enum.
  • Handle 404 in DagRunOperations.trigger(), returning ErrorResponse(error=ErrorType.DAG_NOT_FOUND).
  • Handle DAG_NOT_FOUND in _handle_trigger_dag_run, failing the task gracefully instead of crashing.

Tests added for both the client-side 404 handling and the task runner DAG-not-found path.

Closes: #63089


Was generative AI tooling used to co-author this PR?
  • Yes — Claude Code

Generated-by: Claude Code following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 7 times, most recently from 7dac8a9 to 8b6e936CompareMarch 16, 2026 16:09
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 82c16cd to 898514dCompareMarch 23, 2026 19:07
@potiukpotiuk added the ready for maintainer review Set after triaging when all criteria pass. label Apr 2, 2026
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 10 times, most recently from 175a64a to 9cd3765CompareApril 10, 2026 09:04
@kaxil
kaxil requested a review from CopilotApril 10, 2026 19:55

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Comment on lines +4462 to +4465

log = mock.MagicMock()
mock_supervisor_comms.send.return_value = ErrorResponse(error=ErrorType.DAG_NOT_FOUND)
state, msg, _ = run(ti, ti.get_template_context(), log)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New test introduces an unspecced mock.MagicMock() for log. Airflow’s testing guidelines prefer mocks with spec/autospec to avoid silently accepting unexpected attributes; consider using a real structlog.get_logger(...) or mock.Mock(spec=...) for the logger instead.

Copilot generated this review using guidance from repository custom instructions.
Comment on lines +728 to +729
log.error("Dag not found.", dag_id=dag_id)
return ErrorResponse(error=ErrorType.DAG_NOT_FOUND)

CopilotAIApr 10, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new 404 handling logs only a generic "Dag not found" message and doesn’t include available response context (e.detail, status_code). Consider logging those fields (and/or returning them in ErrorResponse.detail) for easier debugging, consistent with other client methods’ 404 handling.

Suggested change
log.error("Dag not found.", dag_id=dag_id)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND)
log.error(
"Dag not found.",
dag_id=dag_id,
status_code=e.response.status_code,
detail=e.detail,
)
returnErrorResponse(error=ErrorType.DAG_NOT_FOUND, detail=e.detail)

Copilot uses AI. Check for mistakes.
@YoannAbriel
YoannAbrielforce-pushed the fix/issue-63089 branch 2 times, most recently from 69533e8 to e8284feCompareApril 13, 2026 06:06
When TriggerDagRunOperator targets a non-existent DAG, the API server
returns 404 which was re-raised as ServerResponseError. This propagated
out of _handle_trigger_dag_run into the finally block of run() where
'state' was never assigned, causing UnboundLocalError.
Two fixes:
- Initialize state to FAILED before the try block so the finally block
always has a valid value
- Handle 404 in the dag_runs client (returning DAG_NOT_FOUND error) and
in _handle_trigger_dag_run (failing the task gracefully)
Closes: apache#63089
@potiukpotiuk removed the ready for maintainer review Set after triaging when all criteria pass. label May 18, 2026
@potiuk
potiuk marked this pull request as draft May 18, 2026 10:46
@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel — Removing the ready for maintainer review label and converting back to draft. The branch now has merge conflicts with main that surfaced after the label was added.

The label's contract is that the PR is ready for maintainer review — a regression like this means the PR temporarily isn't. Rebase your branch onto the latest main, resolve conflicts, then mark "Ready for review" again to re-enter the queue.

git fetch upstream main && git rebase upstream/main, resolve, git push --force-with-lease. See the working-with-git docs.

No rush.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

@potiuk

Copy link
Copy Markdown
Member

@YoannAbriel This draft PR has had no activity for 2 weeks. Closing to keep the queue clean.

You are welcome to reopen and continue when you're ready. If you'd like to pick it back up, please rebase onto the current main branch first.


Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

UnboundLocalError on TriggerDagRunOperator triggering a dag that doesn't exist

3 participants

@YoannAbriel@potiuk