Skip to content

Remove airflow-metadata.yaml sidecar support from NodeCoordinator - #70273

Merged
jason810496 merged 1 commit into
apache:mainfrom
jason810496:refactor/ts-sdk/drop-metadata-sidecar
Jul 23, 2026
Merged

Remove airflow-metadata.yaml sidecar support from NodeCoordinator#70273
jason810496 merged 1 commit into
apache:mainfrom
jason810496:refactor/ts-sdk/drop-metadata-sidecar

Conversation

@jason810496

Copy link
Copy Markdown
Member

Why

airflow-ts-packalways embeds the bundle metadata into bundle.mjs itself as a leading //# airflowMetadata=<base64> comment but the NodeCoordinator fallback that accepts a hand-written airflow-metadata.yaml. However, no tool produces the airflow-metadata.yaml file.

What

  • NodeCoordinator now treats the embedded metadata as the only accepted source: a bundle.mjs without the //# airflowMetadata= marker is rejected with `"bundle.mjs has no embedded airflow metadata.

Was generative AI tooling used to co-author this PR?

airflow-ts-pack always embeds the bundle metadata in bundle.mjs itself,
so the sidecar fallback re-introduces the metadata drift the embedding
was built to prevent, and no tool produces the file. NodeCoordinator has
not shipped in any task-sdk release yet, so the fallback can be dropped
without a compatibility path.
@jason810496jason810496 self-assigned this Jul 23, 2026
@boring-cyborgboring-cyborgBot added area:coordinator Coordinator: The interface to spawn Lang-SDK subprocesses area:task-sdk area:ts-sdk labels Jul 23, 2026

@guan404mingguan404ming left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, verified locally and worked as expected.

@jason810496
jason810496 merged commit 4207644 into apache:mainJul 23, 2026
107 checks passed
dabla pushed a commit to dabla/airflow that referenced this pull request Aug 14, 2026
…ache#70273)
airflow-ts-pack always embeds the bundle metadata in bundle.mjs itself,
so the sidecar fallback re-introduces the metadata drift the embedding
was built to prevent, and no tool produces the file. NodeCoordinator has
not shipped in any task-sdk release yet, so the fallback can be dropped
without a compatibility path.
jason810496 pushed a commit that referenced this pull request Aug 27, 2026
…72115)
The NodeCoordinator config table still described bundles_root as
accepting a bundle.mjs with an airflow-metadata.yaml sidecar, but that
fallback was removed in #70273 and the coordinator now only reads
metadata embedded in the bundle by airflow-ts-pack. The packing section
also jumped straight to running airflow-ts-pack without showing that
apache-airflow-ts-sdk and its optional esbuild peer dependency need to
be installed first, so following the doc as written fails.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:coordinatorCoordinator: The interface to spawn Lang-SDK subprocessesarea:task-sdkarea:ts-sdk

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jason810496@guan404ming