AIP-72: Pass context keys from API Server to Workers by kaxil · Pull Request #44899 · apache/airflow

kaxil · 2024-12-12T22:48:19Z

This commit augments the TI context available in the Task Execution Interface with the one from the Execution API Server.

In future PRs the following will be added:

More methods on TI like ti.xcom_pull, ti.xcom_push etc
Lazy fetching of connections, variables
Verifying the "get_current_context" is working
f3ea195

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

ashb

Yeah looks like a good approach

ashb

A few nits/questions in comments to address, but LGTM

amoghrajesh

Looks generally good, few comments/qns

Part of apache#44481 This commit augments the TI context available in the Task Execution Interface with the one from the Execution API Server. In future PRs the following will be added: - More methods on TI like ti.xcom_pull, ti.xcom_push etc - Lazy fetching of connections, variables - Verifying the "get_current_context" is working

boring-cyborgBot added the area:task-sdk label Dec 12, 2024

kaxil force-pushed the task-context-api-server branch 2 times, most recently from c751760 to ef7be4cCompare December 13, 2024 12:00

ashb reviewed Dec 13, 2024
View reviewed changes

kaxil force-pushed the task-context-api-server branch 5 times, most recently from 2170af7 to f3ea195Compare December 16, 2024 11:25

kaxil marked this pull request as ready for review December 16, 2024 11:26

kaxil requested review from ephraimbuddy and pierrejeambrun as code owners December 16, 2024 11:26