Skip to content

Add TI bulk actions endpoint - #50443

Merged
bbovenzi merged 1 commit into
apache:mainfrom
guan404ming:bulk_ti
May 29, 2025
Merged

Add TI bulk actions endpoint#50443
bbovenzi merged 1 commit into
apache:mainfrom
guan404ming:bulk_ti

Conversation

@guan404ming

@guan404mingguan404ming commented May 10, 2025•
edited
Loading

Copy link
Copy Markdown
Member

Related Issue

#50396

Why

We need bulk endpoint to support mulit-selection in ui thus this PR focus on implementation of TI bulk actions api

How

  • implement it based on connection, pool and variable bulk endpoint
  • override the BulkService to pass dag_id and dag_run_id

Not sure if we should let users create TI by themselves thus I didn't implement it now. If needed, I could add it.

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@boring-cyborgboring-cyborgBot added area:airflow-ctl area:API Airflow's REST/HTTP API area:UI Related to UI/UX. For Frontend Developers. labels May 10, 2025
@guan404ming
guan404mingforce-pushed the bulk_ti branch 4 times, most recently from b89a043 to 4cbd650CompareMay 11, 2025 11:02
@guan404mingguan404ming mentioned this pull request May 11, 2025
Merged
@guan404ming
guan404ming marked this pull request as ready for review May 11, 2025 11:41
bugraoz93
bugraoz93 reviewed May 11, 2025
View reviewed changes

@bugraoz93bugraoz93 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR! Direction looks good small suggestions :)

Comment threadairflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py Outdated
Comment threadairflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py Outdated
Comment threadairflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py Outdated
@guan404ming
guan404mingforce-pushed the bulk_ti branch 2 times, most recently from f108c5e to 2a514f3CompareMay 11, 2025 16:12
@raphaelauvraphaelauv mentioned this pull request May 11, 2025
Closed
2 tasks
bugraoz93
bugraoz93 reviewed May 13, 2025
View reviewed changes
Comment threadairflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py Outdated
@guan404ming
guan404mingforce-pushed the bulk_ti branch 3 times, most recently from 3302d39 to f7e49d1CompareMay 14, 2025 12:05
@guan404ming
guan404mingforce-pushed the bulk_ti branch 2 times, most recently from d98dc8d to f53d5f5CompareMay 25, 2025 13:58
@guan404ming

guan404ming commented May 25, 2025

Copy link
Copy Markdown
MemberAuthor

Hi, @pierrejeambrun@bugraoz93
I think the ci error do related to my change since it works normally on main and only fails here. But I couldn't find the root cause for it in several days of trying. Do you know any possible direction or something could cause k8s test crush? I could keep doing more research and testing. Thanks in advance!

@pierrejeambrun

pierrejeambrun commented May 26, 2025

Copy link
Copy Markdown
Member

I'm not sure, did you try rebasing a couple of times, maybe that's no directly related because the server is not starting.

@guan404ming

guan404ming commented May 27, 2025•
edited
Loading

Copy link
Copy Markdown
MemberAuthor

I've tried rebase it multiple times and I've also add longer timeout and retry for the k8s check but it seems not works. Let me rebase it again. Thanks!

jason810496
jason810496 reviewed May 28, 2025
View reviewed changes

@jason810496jason810496 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @guan404ming, I found a small difference, not sure does this difference related to the CI error.

It's weird that k8s test fail at ensure_resource_health("airflow-api-server") 😟

Comment threadairflow-core/src/airflow/api_fastapi/core_api/routes/public/task_instances.py
Comment threadairflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py
@guan404ming
guan404mingforce-pushed the bulk_ti branch 3 times, most recently from 99fd2b1 to 6431549CompareMay 29, 2025 05:27
jason810496
jason810496 requested changes May 29, 2025
View reviewed changes
Comment threadairflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py Outdated
Comment threadkubernetes-tests/tests/kubernetes_tests/test_base.py Outdated
@guan404ming
guan404ming marked this pull request as ready for review May 29, 2025 13:46
@guan404ming

guan404ming commented May 29, 2025

Copy link
Copy Markdown
MemberAuthor

It works, thanks @jason810496 !

@bbovenzibbovenzi added this to the Airflow 3.1.0 milestone May 29, 2025
@bbovenzi
bbovenzi merged commit f8e2916 into apache:mainMay 29, 2025
@guan404ming

guan404ming commented May 29, 2025

Copy link
Copy Markdown
MemberAuthor

Thanks for all reviews and suggestions.

@guan404ming
guan404ming deleted the bulk_ti branch May 29, 2025 16:40
sanederchik pushed a commit to sanederchik/airflow that referenced this pull request Jun 7, 2025
@guan404ming@sanederchik
Add TI bulk actions endpoint (apache#50443)
62dcda1
This was referenced Jun 9, 2025
Merged
Closed
jose-lehmkuhl pushed a commit to jose-lehmkuhl/airflow that referenced this pull request Jul 11, 2025
@guan404ming@jose-lehmkuhl
Add TI bulk actions endpoint (apache#50443)
ce16128
kaxil added a commit to apache/airflow-client-python that referenced this pull request Oct 22, 2025
@kaxil
Update Python Client to 3.1.0rc1
e62c042
(from https://github.com/apache/airflow/tree/python-client/3.1.0rc1)
## New Features:
- Add `map_index` filter to TaskInstance API queries ([#55614](apache/airflow#55614))
- Add `has_import_errors` filter to Core API GET /dags endpoint ([#54563](apache/airflow#54563))
- Add `dag_version` filter to get_dag_runs endpoint ([#54882](apache/airflow#54882))
- Implement pattern search for event log endpoint ([#55114](apache/airflow#55114))
- Add asset-based filtering support to DAG API endpoint ([#54263](apache/airflow#54263))
- Add Greater Than and Less Than range filters to DagRuns and Task Instance list ([#54302](apache/airflow#54302))
- Add `try_number` as filter to task instances ([#54695](apache/airflow#54695))
- Add filters to Browse XComs endpoint ([#54049](apache/airflow#54049))
- Add Filtering by DAG Bundle Name and Version to API routes ([#54004](apache/airflow#54004))
- Add search filter for DAG runs by triggering user name ([#53652](apache/airflow#53652))
- Enable multi sorting (AIP-84) ([#53408](apache/airflow#53408))
- Add `run_on_latest_version` support for backfill and clear operations ([#52177](apache/airflow#52177))
- Add `run_id_pattern` search for Dag Run API ([#52437](apache/airflow#52437))
- Add tracking of triggering user to Dag runs ([#51738](apache/airflow#51738))
- Expose DAG parsing duration in the API ([#54752](apache/airflow#54752))
## New API Endpoints:
- Add Human-in-the-Loop (HITL) endpoints for approval workflows ([#52868](apache/airflow#52868), [#53373](apache/airflow#53373), [#53376](apache/airflow#53376), [#53885](apache/airflow#53885), [#53923](apache/airflow#53923), [#54308](apache/airflow#54308), [#54310](apache/airflow#54310), [#54723](apache/airflow#54723), [#54773](apache/airflow#54773), [#55019](apache/airflow#55019), [#55463](apache/airflow#55463), [#55525](apache/airflow#55525), [#55535](apache/airflow#55535), [#55603](apache/airflow#55603), [#55776](apache/airflow#55776))
- Add endpoint to watch dag run until finish ([#51920](apache/airflow#51920))
- Add TI bulk actions endpoint ([#50443](apache/airflow#50443))
- Add Keycloak Refresh Token Endpoint ([#51657](apache/airflow#51657))
## Deprecations:
- Mark `DagDetailsResponse.concurrency` as deprecated ([#55150](apache/airflow#55150))
## Bug Fixes:
- Fix dag import error modal pagination ([#55719](apache/airflow#55719))
@kaxilkaxil mentioned this pull request Oct 22, 2025
Merged
kaxil added a commit to apache/airflow-client-python that referenced this pull request Oct 23, 2025
@kaxil
Update Python Client to 3.1.0rc1 (#138)
241405e
(from https://github.com/apache/airflow/tree/python-client/3.1.0rc1)
## New Features:
- Add `map_index` filter to TaskInstance API queries ([#55614](apache/airflow#55614))
- Add `has_import_errors` filter to Core API GET /dags endpoint ([#54563](apache/airflow#54563))
- Add `dag_version` filter to get_dag_runs endpoint ([#54882](apache/airflow#54882))
- Implement pattern search for event log endpoint ([#55114](apache/airflow#55114))
- Add asset-based filtering support to DAG API endpoint ([#54263](apache/airflow#54263))
- Add Greater Than and Less Than range filters to DagRuns and Task Instance list ([#54302](apache/airflow#54302))
- Add `try_number` as filter to task instances ([#54695](apache/airflow#54695))
- Add filters to Browse XComs endpoint ([#54049](apache/airflow#54049))
- Add Filtering by DAG Bundle Name and Version to API routes ([#54004](apache/airflow#54004))
- Add search filter for DAG runs by triggering user name ([#53652](apache/airflow#53652))
- Enable multi sorting (AIP-84) ([#53408](apache/airflow#53408))
- Add `run_on_latest_version` support for backfill and clear operations ([#52177](apache/airflow#52177))
- Add `run_id_pattern` search for Dag Run API ([#52437](apache/airflow#52437))
- Add tracking of triggering user to Dag runs ([#51738](apache/airflow#51738))
- Expose DAG parsing duration in the API ([#54752](apache/airflow#54752))
## New API Endpoints:
- Add Human-in-the-Loop (HITL) endpoints for approval workflows ([#52868](apache/airflow#52868), [#53373](apache/airflow#53373), [#53376](apache/airflow#53376), [#53885](apache/airflow#53885), [#53923](apache/airflow#53923), [#54308](apache/airflow#54308), [#54310](apache/airflow#54310), [#54723](apache/airflow#54723), [#54773](apache/airflow#54773), [#55019](apache/airflow#55019), [#55463](apache/airflow#55463), [#55525](apache/airflow#55525), [#55535](apache/airflow#55535), [#55603](apache/airflow#55603), [#55776](apache/airflow#55776))
- Add endpoint to watch dag run until finish ([#51920](apache/airflow#51920))
- Add TI bulk actions endpoint ([#50443](apache/airflow#50443))
- Add Keycloak Refresh Token Endpoint ([#51657](apache/airflow#51657))
## Deprecations:
- Mark `DagDetailsResponse.concurrency` as deprecated ([#55150](apache/airflow#55150))
## Bug Fixes:
- Fix dag import error modal pagination ([#55719](apache/airflow#55719))
@itaywebitayweb mentioned this pull request Nov 9, 2025
Closed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bugraoz93bugraoz93bugraoz93 approved these changes
@pierrejeambrunpierrejeambrunpierrejeambrun left review comments
@bbovenzibbovenzibbovenzi approved these changes
@jason810496jason810496jason810496 approved these changes
@ryanahamiltonryanahamiltonAwaiting requested review from ryanahamiltonryanahamilton is a code owner
@jscheffljschefflAwaiting requested review from jscheffl
@shubhamraj-gitshubhamraj-gitAwaiting requested review from shubhamraj-gitshubhamraj-git is a code owner
@kaxilkaxilAwaiting requested review from kaxil
@potiukpotiukAwaiting requested review from potiukpotiuk is a code owner
@ephraimbuddyephraimbuddyAwaiting requested review from ephraimbuddyephraimbuddy is a code owner
@rawwarrawwarAwaiting requested review from rawwarrawwar is a code owner

Assignees

No one assigned

Labels

area:airflow-ctlarea:APIAirflow's REST/HTTP APIarea:UIRelated to UI/UX. For Frontend Developers.

Projects

None yet

Milestone

Airflow 3.1.0

Development

Successfully merging this pull request may close these issues.

5 participants

@guan404ming@bugraoz93@pierrejeambrun@bbovenzi@jason810496