Skip to content

Validate partition mapper source keys before scheduling - #67119

Draft
desusaiteja wants to merge 2 commits into
apache:mainfrom
desusaiteja:issue-58943-partition-mapper-roundtrip
Draft

Validate partition mapper source keys before scheduling#67119
desusaiteja wants to merge 2 commits into
apache:mainfrom
desusaiteja:issue-58943-partition-mapper-roundtrip

Conversation

@desusaiteja

@desusaitejadesusaiteja commented May 18, 2026

Copy link
Copy Markdown

Reject non-canonical source partition keys before a partition mapper records downstream mapping for partitioned asset-triggered Dags. This keeps malformed-but-parseable keys from being normalized into incorrect target partitions, and adds regression coverage for temporal, allowed-key, product, chain, and scheduler paths.

closes: #58943


Was generative AI tooling used to co-author this PR?
  • Yes — Codex (GPT-5)

Generated-by: Codex (GPT-5) following the guidelines


Important

🛠️ Maintainer triage note for @desusaiteja · by @potiuk · 2026-07-28 16:22 UTC

Helpful heads-up from the maintainers — please address before this PR can be reviewed:

  • Pre-commit / static checks. See docs.

The ball is in your court — you've been assigned to this PR. Fix the above, then mark it Ready for review.

See the Pull Request quality criteria for how to fix each item. There is no rush.

Automated triage — may be imperfect; a maintainer takes the next look. We use this two-stage triage process so maintainers' limited time goes to the conversation with you.

@boring-cyborgboring-cyborgBot added area:Scheduler including HA (high availability) scheduler area:task-sdk labels May 18, 2026
@potiukpotiuk added the ready for maintainer review Set after triaging when all criteria pass. label May 18, 2026
@desusaiteja
desusaitejaforce-pushed the issue-58943-partition-mapper-roundtrip branch from e0afc2c to 32c8978CompareMay 30, 2026 23:09
@potiuk

Copy link
Copy Markdown
Member

@desusaiteja — I've removed the ready for maintainer review label because the next step here is yours: this branch now has merge conflicts with main. It'll go back into the maintainer queue automatically once you rebase onto the latest main and push — no need to re-add the label by hand. There's no rush.

Automated triage note drafted by an AI-assisted tool — may get things wrong; a real Apache Airflow maintainer takes the next look once it's green. (why automated)


Drafted-by: Claude Code (Opus 4.8); reviewed by @potiuk before posting

@potiukpotiuk removed the ready for maintainer review Set after triaging when all criteria pass. label Jun 25, 2026
@potiukpotiuk added the ready for maintainer review Set after triaging when all criteria pass. label Jul 2, 2026
@desusaiteja
desusaitejaforce-pushed the issue-58943-partition-mapper-roundtrip branch from 32c8978 to e6d4911CompareJuly 12, 2026 22:05
@potiuk
potiuk marked this pull request as draft July 18, 2026 15:47
@potiukpotiuk removed the ready for maintainer review Set after triaging when all criteria pass. label Jul 28, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:Schedulerincluding HA (high availability) schedulerarea:task-sdk

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Validation on partition mappers for source partition formatting

2 participants

@desusaiteja@potiuk