Skip to content

Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 - #43306

Merged
utkarsharma2 merged 67 commits into
v2-10-stablefrom
sync_v2_10_test
Oct 28, 2024
Merged

Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3#43306
utkarsharma2 merged 67 commits into
v2-10-stablefrom
sync_v2_10_test

Conversation

@utkarsharma2

@utkarsharma2utkarsharma2 commented Oct 23, 2024

Copy link
Copy Markdown
Contributor

Time for 2.10.3rc1!

@boring-cyborgboring-cyborgBot added area:API Airflow's REST/HTTP API area:CLI area:dev-tools area:production-image Production image improvements and fixes labels Oct 23, 2024
@utkarsharma2
utkarsharma2 marked this pull request as draft October 23, 2024 10:55
@utkarsharma2
utkarsharma2 marked this pull request as ready for review October 23, 2024 12:18
jedcunningham
jedcunningham reviewed Oct 23, 2024
View reviewed changes

@jedcunninghamjedcunningham left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.

Comment threadRELEASE_NOTES.rst Outdated
Comment threadRELEASE_NOTES.rst Outdated
vincbeckand others added 6 commits October 24, 2024 13:12
@vincbeck@lucasmo@utkarsharma2
Fix documentation for cpu and memory usage (#42147) (#42256)
bf0ba5a
These metrics are reported in airflow/task/task_runner/standard_task_runner.py without "percent"
(cherry picked from commit 3f6497b)
Co-authored-by: lucasmo <lucas.madar@gmail.com>
@romsharon98@onestn@utkarsharma2
fix: Correct docstring format in _get_template_context (#42244) (#42272)
1fc0d85
(cherry picked from commit 8fe2861)
Co-authored-by: Wonseok Yang <deadline.yang@gmail.com>
@pierrejeambrun@dependabot@utkarsharma2
Bump dompurify from 2.2.9 to 2.5.6 in /airflow/www (#42263) (#42270)
3696fd0
Bumps [dompurify](https://github.com/cure53/DOMPurify) from 2.2.9 to 2.5.6.
- [Release notes](https://github.com/cure53/DOMPurify/releases)
- [Commits](cure53/DOMPurify@2.2.9...2.5.6)
---
updated-dependencies:
- dependency-name: dompurify
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit fc5f686)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@jscheffl@utkarsharma2
Update StatsD Image Tag from failed dependencies check (#42264) (#42281)
c39d66c
(cherry picked from commit b5576c0)
@vincbeck@josephangbc@utkarsharma2
Useselectinloadin trigger (#40487) (#42351)
3fc3a54
(cherry picked from commit 46b41e3)
Co-authored-by: Joseph Ang <josephangbc@gmail.com>
@romsharon98@utkarsharma2
apply otel_service on metrics (#42242) (#42441)
ec1c4dc
* apply otel_service on metrics
* change version_added to 2.10.3
(cherry picked from commit e14b4ca)
kaxiland others added 5 commits October 24, 2024 13:12
@kaxil@utkarsharma2
Backport: Bump Flask-AppBuilder to4.5.2(#43309) (#43318)
4131ee0
@shahar1@Udbv@utkarsharma2
Fix instruction for docker compose(tested on Mac M1) (#43119) (#43321)
1eadd75
* Fix instruction for docker compose(tested on Mac M1)
Make fixes that allows to run airflow dags in pycharm debugger on Mac M1
* fix static checks
* fix linter error
* fix unexpected identation
---------
Co-authored-by: Shahar Epstein <60007259+shahar1@users.noreply.github.com>
(cherry picked from commit d725cf6)
Co-authored-by: Bohdan Udovenko <bohdan.udov@gmail.com>
@Joffreybvn@joffreybienvenu-infrabel@utkarsharma2
[Backport] BashOperator: Execute templated bash script as file (#43191)
c4ca3cd
---------
Co-authored-by: Joffrey Bienvenu <joffrey.bienvenu@infrabel.be>
@potiuk@amoghrajesh@utkarsharma2
Masking configuration values irrelevant to DAG author (#43040) (#43336)
4938ffc
Some configurations are irrelevant to DAG authors and hence we need to mask those to avoid it from getting logged unknowingly.
Co-authored-by: adesai <adesai@cloudera.com>
Co-authored-by: Ash Berlin-Taylor <ash_github@firemirror.com>
(cherry picked from commit 0b030c5)
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
@potiuk@amoghrajesh
@kaxil@utkarsharma2
Suppress warnings when masking sensitive confs (#43335) (#43337)
5ae628a
This is to prevent issues such as #43334
(cherry picked from commit 0a9c3c0)
---------
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
@utkarsharma2

utkarsharma2 commented Oct 24, 2024

Copy link
Copy Markdown
ContributorAuthor

The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.

@jedcunningham I made some changes to the PR title in changelogs, PTAL.

@kaxil

kaxil commented Oct 24, 2024

Copy link
Copy Markdown
Member

@utkarsharma2 we need to get #43348 in fyi

shahar1and others added 3 commits October 24, 2024 19:51
@shahar1@Baitur5@utkarsharma2
Fixed type in section Object Storage XCom Backend in file xcoms.rst (#…
07c77bd
…43339) (#43342)
(cherry picked from commit 7c6c106)
Co-authored-by: Baitur Ulukbekov <ulukbekovbr@gmail.com>
(cherry picked from commit a13c49e)
@kaxil@utkarsharma2
Add Airflow 3 ui & task_sdk directories to gitignore (#43319)
17dc189
(cherry picked from commit 0c6c850)
@kaxil@utkarsharma2
Remove Scarf analytics from Airflow Webserver (#43346) (#43348)
56a8da6
Since we have already made decisions about what we want to do for Plugins in Airflow 3 and revamping the entire UI, this data isn't that important. There were also concerns raised about de-depulications and other things.
(cherry picked from commit dc25301)
(cherry picked from commit 2860f81)
@utkarsharma2

utkarsharma2 commented Oct 24, 2024

Copy link
Copy Markdown
ContributorAuthor

@utkarsharma2 we need to get #43348 in fyi

Included it.

@potiuk

potiuk commented Oct 25, 2024•
edited
Loading

Copy link
Copy Markdown
Member

One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):

And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.

@potiuk

potiuk commented Oct 25, 2024•
edited
Loading

Copy link
Copy Markdown
Member

cc: @eladkal ^^

Lee-Wand others added 4 commits October 28, 2024 13:43
@Lee-W@utkarsharma2
ci(pre-commit): migrate pre-commit config (#43372)
65bcce2
We update the names of the pre-commit stages. From the https://pre-commit.com/#confining-hooks-to-run-at-certain-stages:
new in 3.2.0: The values of stages match the hook names. Previously, commit, push, and merge-commit matched pre-commit, pre-push, and pre-merge-commit respectively.
(cherry picked from commit add8e9d)
@romsharon98@utkarsharma2
prevent out of index error in getDagRunLabel function (#43388) (#43404)
6227911
(cherry picked from commit 4652fed)
@utkarsharma2
Update Airflow version to 2.10.3
0db817e
@utkarsharma2
Update RELEASE_NOTES.rst
7557819
@utkarsharma2

utkarsharma2 commented Oct 28, 2024

Copy link
Copy Markdown
ContributorAuthor

One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):

* [WTForms 3.2.0 broke Airflow main #43228](https://github.com/apache/airflow/issues/43228)
* [500 on any admin pages #43270](https://github.com/apache/airflow/issues/43270)
* [WTForms==3.2.1 breaks UI #43356](https://github.com/apache/airflow/issues/43356)
* [AttributeError: 'tuple' object has no attribute 'items' when entering UI Admin Variables Section #43375](https://github.com/apache/airflow/issues/43375)

And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.

Since we already have 1st wave of providers out, I'm proceeding with release.

@potiuk

potiuk commented Oct 28, 2024•
edited
Loading

Copy link
Copy Markdown
Member

Since we already have 1st wave of providers out, I'm proceeding with release.

Go ahead, we can always regenerate the constraints to include the new providers released - they are rather independent from the release and internal RC testing and we've already done it in the past.

@utkarsharma2
utkarsharma2 merged commit 7557819 into v2-10-stableOct 28, 2024
@potiuk
potiuk deleted the sync_v2_10_test branch January 11, 2025 19:44
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ephraimbuddyephraimbuddyephraimbuddy approved these changes
@phanikumvphanikumvphanikumv approved these changes
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin
@dstandishdstandishAwaiting requested review from dstandishdstandish is a code owner
@kaxilkaxilAwaiting requested review from kaxilkaxil is a code owner
@pierrejeambrunpierrejeambrunAwaiting requested review from pierrejeambrunpierrejeambrun is a code owner
@potiukpotiukAwaiting requested review from potiukpotiuk is a code owner
@ashbashbAwaiting requested review from ashbashb is a code owner
@eladkaleladkalAwaiting requested review from eladkaleladkal is a code owner
@mobuchowskimobuchowskiAwaiting requested review from mobuchowski
@o-nikolaso-nikolasAwaiting requested review from o-nikolaso-nikolas is a code owner
@hussein-awalahussein-awalaAwaiting requested review from hussein-awalahussein-awala is a code owner
@uranusjruranusjrAwaiting requested review from uranusjruranusjr is a code owner
@ryanahamiltonryanahamiltonAwaiting requested review from ryanahamiltonryanahamilton is a code owner
@bbovenzibbovenziAwaiting requested review from bbovenzibbovenzi is a code owner
@XD-DENGXD-DENGAwaiting requested review from XD-DENGXD-DENG is a code owner
@jedcunninghamjedcunninghamAwaiting requested review from jedcunninghamjedcunningham is a code owner

Assignees

No one assigned

Labels

area:APIAirflow's REST/HTTP APIarea:CLIarea:dev-toolsarea:production-imageProduction image improvements and fixes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

18 participants

@utkarsharma2@kaxil@potiuk@ephraimbuddy@jedcunningham@phanikumv@vincbeck@romsharon98@pierrejeambrun@jscheffl@shahar1@bbovenzi@Lee-W@infused-kim@jason810496@gopidesupavan@uranusjr@Joffreybvn
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all 
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 by utkarsharma2 · Pull Request #43306 · apache/airflow · GitHub
Skip to content
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 - #43306
Merged
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Oct 28, 2024
Merged
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3#43306
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Conversation
@utkarsharma2
@utkarsharma2utkarsharma2
commented
Oct 23, 2024

Copy link


Copy Markdown

Contributor
Time for 2.10.3rc1!
@boring-cyborgboring-cyborgBot
added

area:API
Airflow's REST/HTTP API
area:CLI

area:dev-tools

area:production-image
Production image improvements and fixes
labels
Oct 23, 2024
@utkarsharma2
utkarsharma2
marked this pull request as draft
October 23, 2024 10:55
@utkarsharma2
utkarsharma2
marked this pull request as ready for review
October 23, 2024 12:18
jedcunningham
jedcunningham
reviewed
Oct 23, 2024
View reviewed changes
@jedcunninghamjedcunningham
left a comment


Copy link


Copy Markdown

Member
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
Comment threadRELEASE_NOTES.rst
Outdated

Comment threadRELEASE_NOTES.rst
Outdated

vincbeckand others
added 6 commits
October 24, 2024 13:12
@vincbeck@lucasmo@utkarsharma2
Fix documentation for cpu and memory usage (#42147) (#42256)
bf0ba5a
These metrics are reported in airflow/task/task_runner/standard_task_runner.py without "percent"
(cherry picked from commit 3f6497b)
Co-authored-by: lucasmo <lucas.madar@gmail.com>
@romsharon98@onestn@utkarsharma2
fix: Correct docstring format in _get_template_context (#42244) (#42272)
1fc0d85
(cherry picked from commit 8fe2861)
Co-authored-by: Wonseok Yang <deadline.yang@gmail.com>
@pierrejeambrun@dependabot@utkarsharma2
Bump dompurify from 2.2.9 to 2.5.6 in /airflow/www (#42263) (#42270)
3696fd0
Bumps [dompurify](https://github.com/cure53/DOMPurify) from 2.2.9 to 2.5.6.
- [Release notes](https://github.com/cure53/DOMPurify/releases)
- [Commits](cure53/DOMPurify@2.2.9...2.5.6)
---
updated-dependencies:
- dependency-name: dompurify
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit fc5f686)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@jscheffl@utkarsharma2
Update StatsD Image Tag from failed dependencies check (#42264) (#42281)
c39d66c
(cherry picked from commit b5576c0)
@vincbeck@josephangbc@utkarsharma2
Useselectinloadin trigger (#40487) (#42351)
3fc3a54
(cherry picked from commit 46b41e3)
Co-authored-by: Joseph Ang <josephangbc@gmail.com>
@romsharon98@utkarsharma2
apply otel_service on metrics (#42242) (#42441)
ec1c4dc
* apply otel_service on metrics
* change version_added to 2.10.3
(cherry picked from commit e14b4ca)
kaxiland others
added 5 commits
October 24, 2024 13:12
@kaxil@utkarsharma2
Backport: Bump Flask-AppBuilder to4.5.2(#43309) (#43318)
4131ee0
@shahar1@Udbv@utkarsharma2
Fix instruction for docker compose(tested on Mac M1) (#43119) (#43321)
1eadd75
* Fix instruction for docker compose(tested on Mac M1)
Make fixes that allows to run airflow dags in pycharm debugger on Mac M1
* fix static checks
* fix linter error
* fix unexpected identation
---------
Co-authored-by: Shahar Epstein <60007259+shahar1@users.noreply.github.com>
(cherry picked from commit d725cf6)
Co-authored-by: Bohdan Udovenko <bohdan.udov@gmail.com>
@Joffreybvn@joffreybienvenu-infrabel@utkarsharma2
[Backport] BashOperator: Execute templated bash script as file (#43191)
c4ca3cd
---------
Co-authored-by: Joffrey Bienvenu <joffrey.bienvenu@infrabel.be>
@potiuk@amoghrajesh@utkarsharma2
Masking configuration values irrelevant to DAG author (#43040) (#43336)
4938ffc
Some configurations are irrelevant to DAG authors and hence we need to mask those to avoid it from getting logged unknowingly.
Co-authored-by: adesai <adesai@cloudera.com>
Co-authored-by: Ash Berlin-Taylor <ash_github@firemirror.com>
(cherry picked from commit 0b030c5)
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
@potiuk@amoghrajesh
@kaxil@utkarsharma2
Suppress warnings when masking sensitive confs (#43335) (#43337)
5ae628a
This is to prevent issues such as #43334
(cherry picked from commit 0a9c3c0)
---------
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
@jedcunningham I made some changes to the PR title in changelogs, PTAL.
@kaxil
kaxil
commented
Oct 24, 2024

Copy link


Copy Markdown

Member
@utkarsharma2 we need to get #43348 in fyi
shahar1and others
added 3 commits
October 24, 2024 19:51
@shahar1@Baitur5@utkarsharma2
Fixed type in section Object Storage XCom Backend in file xcoms.rst (#…
07c77bd
…43339) (#43342)
(cherry picked from commit 7c6c106)
Co-authored-by: Baitur Ulukbekov <ulukbekovbr@gmail.com>
(cherry picked from commit a13c49e)
@kaxil@utkarsharma2
Add Airflow 3 ui & task_sdk directories to gitignore (#43319)
17dc189
(cherry picked from commit 0c6c850)
@kaxil@utkarsharma2
Remove Scarf analytics from Airflow Webserver (#43346) (#43348)
56a8da6
Since we have already made decisions about what we want to do for Plugins in Airflow 3 and revamping the entire UI, this data isn't that important. There were also concerns raised about de-depulications and other things.
(cherry picked from commit dc25301)
(cherry picked from commit 2860f81)
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
@utkarsharma2 we need to get #43348 in fyi
Included it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
cc: @eladkal ^^
Lee-Wand others
added 4 commits
October 28, 2024 13:43
@Lee-W@utkarsharma2
ci(pre-commit): migrate pre-commit config (#43372)
65bcce2
We update the names of the pre-commit stages. From the https://pre-commit.com/#confining-hooks-to-run-at-certain-stages:
new in 3.2.0: The values of stages match the hook names. Previously, commit, push, and merge-commit matched pre-commit, pre-push, and pre-merge-commit respectively.
(cherry picked from commit add8e9d)
@romsharon98@utkarsharma2
prevent out of index error in getDagRunLabel function (#43388) (#43404)
6227911
(cherry picked from commit 4652fed)
@utkarsharma2
Update Airflow version to 2.10.3
0db817e
@utkarsharma2
Update RELEASE_NOTES.rst
7557819
@utkarsharma2
utkarsharma2
commented
Oct 28, 2024

Copy link


Copy Markdown

ContributorAuthor
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
* [WTForms 3.2.0 broke Airflow main #43228](https://github.com/apache/airflow/issues/43228)
* [500 on any admin pages #43270](https://github.com/apache/airflow/issues/43270)
* [WTForms==3.2.1 breaks UI #43356](https://github.com/apache/airflow/issues/43356)
* [AttributeError: 'tuple' object has no attribute 'items' when entering UI Admin Variables Section #43375](https://github.com/apache/airflow/issues/43375)

And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
Since we already have 1st wave of providers out, I'm proceeding with release.
@potiuk
potiuk
commented
Oct 28, 2024•

edited

Loading

Copy link


Copy Markdown

Member
Since we already have 1st wave of providers out, I'm proceeding with release.
Go ahead, we can always regenerate the constraints to include the new providers released - they are rather independent from the release and internal RC testing and we've already done it in the past.
@utkarsharma2
utkarsharma2
merged commit 7557819
into
v2-10-stableOct 28, 2024
@potiuk
potiuk
deleted the

sync_v2_10_test

branch
January 11, 2025 19:44
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@ephraimbuddyephraimbuddyephraimbuddy approved these changes
@phanikumvphanikumvphanikumv approved these changes
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin
@dstandishdstandishAwaiting requested review from dstandishdstandish is a code owner
@kaxilkaxilAwaiting requested review from kaxilkaxil is a code owner
@pierrejeambrunpierrejeambrunAwaiting requested review from pierrejeambrunpierrejeambrun is a code owner
@potiukpotiukAwaiting requested review from potiukpotiuk is a code owner
@ashbashbAwaiting requested review from ashbashb is a code owner
@eladkaleladkalAwaiting requested review from eladkaleladkal is a code owner
@mobuchowskimobuchowskiAwaiting requested review from mobuchowski
@o-nikolaso-nikolasAwaiting requested review from o-nikolaso-nikolas is a code owner
@hussein-awalahussein-awalaAwaiting requested review from hussein-awalahussein-awala is a code owner
@uranusjruranusjrAwaiting requested review from uranusjruranusjr is a code owner
@ryanahamiltonryanahamiltonAwaiting requested review from ryanahamiltonryanahamilton is a code owner
@bbovenzibbovenziAwaiting requested review from bbovenzibbovenzi is a code owner
@XD-DENGXD-DENGAwaiting requested review from XD-DENGXD-DENG is a code owner
@jedcunninghamjedcunninghamAwaiting requested review from jedcunninghamjedcunningham is a code owner

Assignees


No one assigned


Labels

area:APIAirflow's REST/HTTP APIarea:CLIarea:dev-toolsarea:production-imageProduction image improvements and fixes

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

18 participants

@utkarsharma2@kaxil@potiuk@ephraimbuddy@jedcunningham@phanikumv@vincbeck@romsharon98@pierrejeambrun@jscheffl@shahar1@bbovenzi@Lee-W@infused-kim@jason810496@gopidesupavan@uranusjr@Joffreybvn

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Force GitHub README to respect dark mode
(function() {
var style = document.createElement('style');
style.textContent = '
.markdown-body {
color-scheme: dark light;
}
.markdown-body pre { background: #161b22 !important; }
.markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }
.markdown-body table th, .markdown-body table td { border-color: #30363d !important; }
.markdown-body img { background: #0d1117; }
.markdown-body blockquote { border-left-color: #8b949e; }
.markdown-body hr { border-color: #30363d; }
';
document.head.appendChild(style);
})();
}
} catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 by utkarsharma2 · Pull Request #43306 · apache/airflow · GitHub
Skip to content
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 - #43306
Merged
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Oct 28, 2024
Merged
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3#43306
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Conversation
@utkarsharma2
@utkarsharma2utkarsharma2
commented
Oct 23, 2024

Copy link


Copy Markdown

Contributor
Time for 2.10.3rc1!
@boring-cyborgboring-cyborgBot
added

area:API
Airflow's REST/HTTP API
area:CLI

area:dev-tools

area:production-image
Production image improvements and fixes
labels
Oct 23, 2024
@utkarsharma2
utkarsharma2
marked this pull request as draft
October 23, 2024 10:55
@utkarsharma2
utkarsharma2
marked this pull request as ready for review
October 23, 2024 12:18
jedcunningham
jedcunningham
reviewed
Oct 23, 2024
View reviewed changes
@jedcunninghamjedcunningham
left a comment


Copy link


Copy Markdown

Member
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
Comment threadRELEASE_NOTES.rst
Outdated

Comment threadRELEASE_NOTES.rst
Outdated

vincbeckand others
added 6 commits
October 24, 2024 13:12
@vincbeck@lucasmo@utkarsharma2
Fix documentation for cpu and memory usage (#42147) (#42256)
bf0ba5a
These metrics are reported in airflow/task/task_runner/standard_task_runner.py without "percent"
(cherry picked from commit 3f6497b)
Co-authored-by: lucasmo <lucas.madar@gmail.com>
@romsharon98@onestn@utkarsharma2
fix: Correct docstring format in _get_template_context (#42244) (#42272)
1fc0d85
(cherry picked from commit 8fe2861)
Co-authored-by: Wonseok Yang <deadline.yang@gmail.com>
@pierrejeambrun@dependabot@utkarsharma2
Bump dompurify from 2.2.9 to 2.5.6 in /airflow/www (#42263) (#42270)
3696fd0
Bumps [dompurify](https://github.com/cure53/DOMPurify) from 2.2.9 to 2.5.6.
- [Release notes](https://github.com/cure53/DOMPurify/releases)
- [Commits](cure53/DOMPurify@2.2.9...2.5.6)
---
updated-dependencies:
- dependency-name: dompurify
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit fc5f686)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@jscheffl@utkarsharma2
Update StatsD Image Tag from failed dependencies check (#42264) (#42281)
c39d66c
(cherry picked from commit b5576c0)
@vincbeck@josephangbc@utkarsharma2
Useselectinloadin trigger (#40487) (#42351)
3fc3a54
(cherry picked from commit 46b41e3)
Co-authored-by: Joseph Ang <josephangbc@gmail.com>
@romsharon98@utkarsharma2
apply otel_service on metrics (#42242) (#42441)
ec1c4dc
* apply otel_service on metrics
* change version_added to 2.10.3
(cherry picked from commit e14b4ca)
kaxiland others
added 5 commits
October 24, 2024 13:12
@kaxil@utkarsharma2
Backport: Bump Flask-AppBuilder to4.5.2(#43309) (#43318)
4131ee0
@shahar1@Udbv@utkarsharma2
Fix instruction for docker compose(tested on Mac M1) (#43119) (#43321)
1eadd75
* Fix instruction for docker compose(tested on Mac M1)
Make fixes that allows to run airflow dags in pycharm debugger on Mac M1
* fix static checks
* fix linter error
* fix unexpected identation
---------
Co-authored-by: Shahar Epstein <60007259+shahar1@users.noreply.github.com>
(cherry picked from commit d725cf6)
Co-authored-by: Bohdan Udovenko <bohdan.udov@gmail.com>
@Joffreybvn@joffreybienvenu-infrabel@utkarsharma2
[Backport] BashOperator: Execute templated bash script as file (#43191)
c4ca3cd
---------
Co-authored-by: Joffrey Bienvenu <joffrey.bienvenu@infrabel.be>
@potiuk@amoghrajesh@utkarsharma2
Masking configuration values irrelevant to DAG author (#43040) (#43336)
4938ffc
Some configurations are irrelevant to DAG authors and hence we need to mask those to avoid it from getting logged unknowingly.
Co-authored-by: adesai <adesai@cloudera.com>
Co-authored-by: Ash Berlin-Taylor <ash_github@firemirror.com>
(cherry picked from commit 0b030c5)
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
@potiuk@amoghrajesh
@kaxil@utkarsharma2
Suppress warnings when masking sensitive confs (#43335) (#43337)
5ae628a
This is to prevent issues such as #43334
(cherry picked from commit 0a9c3c0)
---------
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
@jedcunningham I made some changes to the PR title in changelogs, PTAL.
@kaxil
kaxil
commented
Oct 24, 2024

Copy link


Copy Markdown

Member
@utkarsharma2 we need to get #43348 in fyi
shahar1and others
added 3 commits
October 24, 2024 19:51
@shahar1@Baitur5@utkarsharma2
Fixed type in section Object Storage XCom Backend in file xcoms.rst (#…
07c77bd
…43339) (#43342)
(cherry picked from commit 7c6c106)
Co-authored-by: Baitur Ulukbekov <ulukbekovbr@gmail.com>
(cherry picked from commit a13c49e)
@kaxil@utkarsharma2
Add Airflow 3 ui & task_sdk directories to gitignore (#43319)
17dc189
(cherry picked from commit 0c6c850)
@kaxil@utkarsharma2
Remove Scarf analytics from Airflow Webserver (#43346) (#43348)
56a8da6
Since we have already made decisions about what we want to do for Plugins in Airflow 3 and revamping the entire UI, this data isn't that important. There were also concerns raised about de-depulications and other things.
(cherry picked from commit dc25301)
(cherry picked from commit 2860f81)
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
@utkarsharma2 we need to get #43348 in fyi
Included it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
cc: @eladkal ^^
Lee-Wand others
added 4 commits
October 28, 2024 13:43
@Lee-W@utkarsharma2
ci(pre-commit): migrate pre-commit config (#43372)
65bcce2
We update the names of the pre-commit stages. From the https://pre-commit.com/#confining-hooks-to-run-at-certain-stages:
new in 3.2.0: The values of stages match the hook names. Previously, commit, push, and merge-commit matched pre-commit, pre-push, and pre-merge-commit respectively.
(cherry picked from commit add8e9d)
@romsharon98@utkarsharma2
prevent out of index error in getDagRunLabel function (#43388) (#43404)
6227911
(cherry picked from commit 4652fed)
@utkarsharma2
Update Airflow version to 2.10.3
0db817e
@utkarsharma2
Update RELEASE_NOTES.rst
7557819
@utkarsharma2
utkarsharma2
commented
Oct 28, 2024

Copy link


Copy Markdown

ContributorAuthor
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
* [WTForms 3.2.0 broke Airflow main #43228](https://github.com/apache/airflow/issues/43228)
* [500 on any admin pages #43270](https://github.com/apache/airflow/issues/43270)
* [WTForms==3.2.1 breaks UI #43356](https://github.com/apache/airflow/issues/43356)
* [AttributeError: 'tuple' object has no attribute 'items' when entering UI Admin Variables Section #43375](https://github.com/apache/airflow/issues/43375)

And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
Since we already have 1st wave of providers out, I'm proceeding with release.
@potiuk
potiuk
commented
Oct 28, 2024•

edited

Loading

Copy link


Copy Markdown

Member
Since we already have 1st wave of providers out, I'm proceeding with release.
Go ahead, we can always regenerate the constraints to include the new providers released - they are rather independent from the release and internal RC testing and we've already done it in the past.
@utkarsharma2
utkarsharma2
merged commit 7557819
into
v2-10-stableOct 28, 2024
@potiuk
potiuk
deleted the

sync_v2_10_test

branch
January 11, 2025 19:44
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@ephraimbuddyephraimbuddyephraimbuddy approved these changes
@phanikumvphanikumvphanikumv approved these changes
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin
@dstandishdstandishAwaiting requested review from dstandishdstandish is a code owner
@kaxilkaxilAwaiting requested review from kaxilkaxil is a code owner
@pierrejeambrunpierrejeambrunAwaiting requested review from pierrejeambrunpierrejeambrun is a code owner
@potiukpotiukAwaiting requested review from potiukpotiuk is a code owner
@ashbashbAwaiting requested review from ashbashb is a code owner
@eladkaleladkalAwaiting requested review from eladkaleladkal is a code owner
@mobuchowskimobuchowskiAwaiting requested review from mobuchowski
@o-nikolaso-nikolasAwaiting requested review from o-nikolaso-nikolas is a code owner
@hussein-awalahussein-awalaAwaiting requested review from hussein-awalahussein-awala is a code owner
@uranusjruranusjrAwaiting requested review from uranusjruranusjr is a code owner
@ryanahamiltonryanahamiltonAwaiting requested review from ryanahamiltonryanahamilton is a code owner
@bbovenzibbovenziAwaiting requested review from bbovenzibbovenzi is a code owner
@XD-DENGXD-DENGAwaiting requested review from XD-DENGXD-DENG is a code owner
@jedcunninghamjedcunninghamAwaiting requested review from jedcunninghamjedcunningham is a code owner

Assignees


No one assigned


Labels

area:APIAirflow's REST/HTTP APIarea:CLIarea:dev-toolsarea:production-imageProduction image improvements and fixes

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

18 participants

@utkarsharma2@kaxil@potiuk@ephraimbuddy@jedcunningham@phanikumv@vincbeck@romsharon98@pierrejeambrun@jscheffl@shahar1@bbovenzi@Lee-W@infused-kim@jason810496@gopidesupavan@uranusjr@Joffreybvn

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Highlight search terms from Google/DuckDuckGo/Bing referrer
(function() {
var ref = document.referrer;
var terms = [];
if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {
var url = new URL(ref);
var q = url.searchParams.get('q') || url.searchParams.get('p');
if (q) {
terms = q.split(/\s+/).filter(function(t) { return t.length > 2; });
}
}
if (terms.length === 0) return;
var style = document.createElement('style');
style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';
document.head.appendChild(style);
function highlight(node) {
if (node.nodeType === 3) { // text node
var text = node.textContent;
var found = false;
terms.forEach(function(term) {
var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi');
if (regex.test(text)) {
found = true;
var frag = document.createDocumentFragment();
var parts = text.split(regex);
parts.forEach(function(part, i) {
if (i % 2 === 0) {
frag.appendChild(document.createTextNode(part));
} else {
var span = document.createElement('span');
span.className = 'userscript-highlight';
span.textContent = part;
frag.appendChild(span);
}
});
node.parentNode.replaceChild(frag, node);
}
});
} else if (node.nodeType === 1 && node.childNodes) { // element
var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];
if (!skipTags.includes(node.tagName)) {
Array.from(node.childNodes).forEach(highlight);
}
}
}
highlight(document.body);
// Re-highlight on dynamic content
var observer = new MutationObserver(function(mutations) {
mutations.forEach(function(m) {
m.addedNodes.forEach(function(node) {
if (node.nodeType === 1 || node.nodeType === 3) highlight(node);
});
});
});
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 by utkarsharma2 · Pull Request #43306 · apache/airflow · GitHub
Skip to content
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 - #43306
Merged
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Oct 28, 2024
Merged
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3#43306
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Conversation
@utkarsharma2
@utkarsharma2utkarsharma2
commented
Oct 23, 2024

Copy link


Copy Markdown

Contributor
Time for 2.10.3rc1!
@boring-cyborgboring-cyborgBot
added

area:API
Airflow's REST/HTTP API
area:CLI

area:dev-tools

area:production-image
Production image improvements and fixes
labels
Oct 23, 2024
@utkarsharma2
utkarsharma2
marked this pull request as draft
October 23, 2024 10:55
@utkarsharma2
utkarsharma2
marked this pull request as ready for review
October 23, 2024 12:18
jedcunningham
jedcunningham
reviewed
Oct 23, 2024
View reviewed changes
@jedcunninghamjedcunningham
left a comment


Copy link


Copy Markdown

Member
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
Comment threadRELEASE_NOTES.rst
Outdated

Comment threadRELEASE_NOTES.rst
Outdated

vincbeckand others
added 6 commits
October 24, 2024 13:12
@vincbeck@lucasmo@utkarsharma2
Fix documentation for cpu and memory usage (#42147) (#42256)
bf0ba5a
These metrics are reported in airflow/task/task_runner/standard_task_runner.py without "percent"
(cherry picked from commit 3f6497b)
Co-authored-by: lucasmo <lucas.madar@gmail.com>
@romsharon98@onestn@utkarsharma2
fix: Correct docstring format in _get_template_context (#42244) (#42272)
1fc0d85
(cherry picked from commit 8fe2861)
Co-authored-by: Wonseok Yang <deadline.yang@gmail.com>
@pierrejeambrun@dependabot@utkarsharma2
Bump dompurify from 2.2.9 to 2.5.6 in /airflow/www (#42263) (#42270)
3696fd0
Bumps [dompurify](https://github.com/cure53/DOMPurify) from 2.2.9 to 2.5.6.
- [Release notes](https://github.com/cure53/DOMPurify/releases)
- [Commits](cure53/DOMPurify@2.2.9...2.5.6)
---
updated-dependencies:
- dependency-name: dompurify
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit fc5f686)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@jscheffl@utkarsharma2
Update StatsD Image Tag from failed dependencies check (#42264) (#42281)
c39d66c
(cherry picked from commit b5576c0)
@vincbeck@josephangbc@utkarsharma2
Useselectinloadin trigger (#40487) (#42351)
3fc3a54
(cherry picked from commit 46b41e3)
Co-authored-by: Joseph Ang <josephangbc@gmail.com>
@romsharon98@utkarsharma2
apply otel_service on metrics (#42242) (#42441)
ec1c4dc
* apply otel_service on metrics
* change version_added to 2.10.3
(cherry picked from commit e14b4ca)
kaxiland others
added 5 commits
October 24, 2024 13:12
@kaxil@utkarsharma2
Backport: Bump Flask-AppBuilder to4.5.2(#43309) (#43318)
4131ee0
@shahar1@Udbv@utkarsharma2
Fix instruction for docker compose(tested on Mac M1) (#43119) (#43321)
1eadd75
* Fix instruction for docker compose(tested on Mac M1)
Make fixes that allows to run airflow dags in pycharm debugger on Mac M1
* fix static checks
* fix linter error
* fix unexpected identation
---------
Co-authored-by: Shahar Epstein <60007259+shahar1@users.noreply.github.com>
(cherry picked from commit d725cf6)
Co-authored-by: Bohdan Udovenko <bohdan.udov@gmail.com>
@Joffreybvn@joffreybienvenu-infrabel@utkarsharma2
[Backport] BashOperator: Execute templated bash script as file (#43191)
c4ca3cd
---------
Co-authored-by: Joffrey Bienvenu <joffrey.bienvenu@infrabel.be>
@potiuk@amoghrajesh@utkarsharma2
Masking configuration values irrelevant to DAG author (#43040) (#43336)
4938ffc
Some configurations are irrelevant to DAG authors and hence we need to mask those to avoid it from getting logged unknowingly.
Co-authored-by: adesai <adesai@cloudera.com>
Co-authored-by: Ash Berlin-Taylor <ash_github@firemirror.com>
(cherry picked from commit 0b030c5)
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
@potiuk@amoghrajesh
@kaxil@utkarsharma2
Suppress warnings when masking sensitive confs (#43335) (#43337)
5ae628a
This is to prevent issues such as #43334
(cherry picked from commit 0a9c3c0)
---------
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
@jedcunningham I made some changes to the PR title in changelogs, PTAL.
@kaxil
kaxil
commented
Oct 24, 2024

Copy link


Copy Markdown

Member
@utkarsharma2 we need to get #43348 in fyi
shahar1and others
added 3 commits
October 24, 2024 19:51
@shahar1@Baitur5@utkarsharma2
Fixed type in section Object Storage XCom Backend in file xcoms.rst (#…
07c77bd
…43339) (#43342)
(cherry picked from commit 7c6c106)
Co-authored-by: Baitur Ulukbekov <ulukbekovbr@gmail.com>
(cherry picked from commit a13c49e)
@kaxil@utkarsharma2
Add Airflow 3 ui & task_sdk directories to gitignore (#43319)
17dc189
(cherry picked from commit 0c6c850)
@kaxil@utkarsharma2
Remove Scarf analytics from Airflow Webserver (#43346) (#43348)
56a8da6
Since we have already made decisions about what we want to do for Plugins in Airflow 3 and revamping the entire UI, this data isn't that important. There were also concerns raised about de-depulications and other things.
(cherry picked from commit dc25301)
(cherry picked from commit 2860f81)
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
@utkarsharma2 we need to get #43348 in fyi
Included it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
cc: @eladkal ^^
Lee-Wand others
added 4 commits
October 28, 2024 13:43
@Lee-W@utkarsharma2
ci(pre-commit): migrate pre-commit config (#43372)
65bcce2
We update the names of the pre-commit stages. From the https://pre-commit.com/#confining-hooks-to-run-at-certain-stages:
new in 3.2.0: The values of stages match the hook names. Previously, commit, push, and merge-commit matched pre-commit, pre-push, and pre-merge-commit respectively.
(cherry picked from commit add8e9d)
@romsharon98@utkarsharma2
prevent out of index error in getDagRunLabel function (#43388) (#43404)
6227911
(cherry picked from commit 4652fed)
@utkarsharma2
Update Airflow version to 2.10.3
0db817e
@utkarsharma2
Update RELEASE_NOTES.rst
7557819
@utkarsharma2
utkarsharma2
commented
Oct 28, 2024

Copy link


Copy Markdown

ContributorAuthor
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
* [WTForms 3.2.0 broke Airflow main #43228](https://github.com/apache/airflow/issues/43228)
* [500 on any admin pages #43270](https://github.com/apache/airflow/issues/43270)
* [WTForms==3.2.1 breaks UI #43356](https://github.com/apache/airflow/issues/43356)
* [AttributeError: 'tuple' object has no attribute 'items' when entering UI Admin Variables Section #43375](https://github.com/apache/airflow/issues/43375)

And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
Since we already have 1st wave of providers out, I'm proceeding with release.
@potiuk
potiuk
commented
Oct 28, 2024•

edited

Loading

Copy link


Copy Markdown

Member
Since we already have 1st wave of providers out, I'm proceeding with release.
Go ahead, we can always regenerate the constraints to include the new providers released - they are rather independent from the release and internal RC testing and we've already done it in the past.
@utkarsharma2
utkarsharma2
merged commit 7557819
into
v2-10-stableOct 28, 2024
@potiuk
potiuk
deleted the

sync_v2_10_test

branch
January 11, 2025 19:44
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@ephraimbuddyephraimbuddyephraimbuddy approved these changes
@phanikumvphanikumvphanikumv approved these changes
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin
@dstandishdstandishAwaiting requested review from dstandishdstandish is a code owner
@kaxilkaxilAwaiting requested review from kaxilkaxil is a code owner
@pierrejeambrunpierrejeambrunAwaiting requested review from pierrejeambrunpierrejeambrun is a code owner
@potiukpotiukAwaiting requested review from potiukpotiuk is a code owner
@ashbashbAwaiting requested review from ashbashb is a code owner
@eladkaleladkalAwaiting requested review from eladkaleladkal is a code owner
@mobuchowskimobuchowskiAwaiting requested review from mobuchowski
@o-nikolaso-nikolasAwaiting requested review from o-nikolaso-nikolas is a code owner
@hussein-awalahussein-awalaAwaiting requested review from hussein-awalahussein-awala is a code owner
@uranusjruranusjrAwaiting requested review from uranusjruranusjr is a code owner
@ryanahamiltonryanahamiltonAwaiting requested review from ryanahamiltonryanahamilton is a code owner
@bbovenzibbovenziAwaiting requested review from bbovenzibbovenzi is a code owner
@XD-DENGXD-DENGAwaiting requested review from XD-DENGXD-DENG is a code owner
@jedcunninghamjedcunninghamAwaiting requested review from jedcunninghamjedcunningham is a code owner

Assignees


No one assigned


Labels

area:APIAirflow's REST/HTTP APIarea:CLIarea:dev-toolsarea:production-imageProduction image improvements and fixes

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

18 participants

@utkarsharma2@kaxil@potiuk@ephraimbuddy@jedcunningham@phanikumv@vincbeck@romsharon98@pierrejeambrun@jscheffl@shahar1@bbovenzi@Lee-W@infused-kim@jason810496@gopidesupavan@uranusjr@Joffreybvn

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Strip utm_, fbclid, gclid, etc. from all links on page
(function() {
var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',
'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',
'ref', 'ref_src', 'source', 'medium', 'campaign'];
function cleanUrl(url) {
try {
var u = new URL(url, window.location.origin);
var changed = false;
trackingParams.forEach(function(p) {
if (u.searchParams.has(p)) {
u.searchParams.delete(p);
changed = true;
}
});
return changed ? u.toString() : url;
} catch (e) {
return url;
}
}
function cleanLinks() {
document.querySelectorAll('a[href]').forEach(function(a) {
var clean = cleanUrl(a.href);
if (clean !== a.href) a.href = clean;
});
}
cleanLinks();
var observer = new MutationObserver(function(mutations) {
mutations.forEach(function(m) {
m.addedNodes.forEach(function(node) {
if (node.nodeType === 1) {
if (node.tagName === 'A') cleanLinks();
node.querySelectorAll('a[href]').forEach(function(a) {
var clean = cleanUrl(a.href);
if (clean !== a.href) a.href = clean;
});
}
});
});
});
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); }
})();
(function(){
try {
var __m = "youtube.com";
var __re = new RegExp('^' + "youtube\\.com" + '
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 by utkarsharma2 · Pull Request #43306 · apache/airflow · GitHub
Skip to content
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 - #43306
Merged
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Oct 28, 2024
Merged
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3#43306
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Conversation
@utkarsharma2
@utkarsharma2utkarsharma2
commented
Oct 23, 2024

Copy link


Copy Markdown

Contributor
Time for 2.10.3rc1!
@boring-cyborgboring-cyborgBot
added

area:API
Airflow's REST/HTTP API
area:CLI

area:dev-tools

area:production-image
Production image improvements and fixes
labels
Oct 23, 2024
@utkarsharma2
utkarsharma2
marked this pull request as draft
October 23, 2024 10:55
@utkarsharma2
utkarsharma2
marked this pull request as ready for review
October 23, 2024 12:18
jedcunningham
jedcunningham
reviewed
Oct 23, 2024
View reviewed changes
@jedcunninghamjedcunningham
left a comment


Copy link


Copy Markdown

Member
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
Comment threadRELEASE_NOTES.rst
Outdated

Comment threadRELEASE_NOTES.rst
Outdated

vincbeckand others
added 6 commits
October 24, 2024 13:12
@vincbeck@lucasmo@utkarsharma2
Fix documentation for cpu and memory usage (#42147) (#42256)
bf0ba5a
These metrics are reported in airflow/task/task_runner/standard_task_runner.py without "percent"
(cherry picked from commit 3f6497b)
Co-authored-by: lucasmo <lucas.madar@gmail.com>
@romsharon98@onestn@utkarsharma2
fix: Correct docstring format in _get_template_context (#42244) (#42272)
1fc0d85
(cherry picked from commit 8fe2861)
Co-authored-by: Wonseok Yang <deadline.yang@gmail.com>
@pierrejeambrun@dependabot@utkarsharma2
Bump dompurify from 2.2.9 to 2.5.6 in /airflow/www (#42263) (#42270)
3696fd0
Bumps [dompurify](https://github.com/cure53/DOMPurify) from 2.2.9 to 2.5.6.
- [Release notes](https://github.com/cure53/DOMPurify/releases)
- [Commits](cure53/DOMPurify@2.2.9...2.5.6)
---
updated-dependencies:
- dependency-name: dompurify
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit fc5f686)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@jscheffl@utkarsharma2
Update StatsD Image Tag from failed dependencies check (#42264) (#42281)
c39d66c
(cherry picked from commit b5576c0)
@vincbeck@josephangbc@utkarsharma2
Useselectinloadin trigger (#40487) (#42351)
3fc3a54
(cherry picked from commit 46b41e3)
Co-authored-by: Joseph Ang <josephangbc@gmail.com>
@romsharon98@utkarsharma2
apply otel_service on metrics (#42242) (#42441)
ec1c4dc
* apply otel_service on metrics
* change version_added to 2.10.3
(cherry picked from commit e14b4ca)
kaxiland others
added 5 commits
October 24, 2024 13:12
@kaxil@utkarsharma2
Backport: Bump Flask-AppBuilder to4.5.2(#43309) (#43318)
4131ee0
@shahar1@Udbv@utkarsharma2
Fix instruction for docker compose(tested on Mac M1) (#43119) (#43321)
1eadd75
* Fix instruction for docker compose(tested on Mac M1)
Make fixes that allows to run airflow dags in pycharm debugger on Mac M1
* fix static checks
* fix linter error
* fix unexpected identation
---------
Co-authored-by: Shahar Epstein <60007259+shahar1@users.noreply.github.com>
(cherry picked from commit d725cf6)
Co-authored-by: Bohdan Udovenko <bohdan.udov@gmail.com>
@Joffreybvn@joffreybienvenu-infrabel@utkarsharma2
[Backport] BashOperator: Execute templated bash script as file (#43191)
c4ca3cd
---------
Co-authored-by: Joffrey Bienvenu <joffrey.bienvenu@infrabel.be>
@potiuk@amoghrajesh@utkarsharma2
Masking configuration values irrelevant to DAG author (#43040) (#43336)
4938ffc
Some configurations are irrelevant to DAG authors and hence we need to mask those to avoid it from getting logged unknowingly.
Co-authored-by: adesai <adesai@cloudera.com>
Co-authored-by: Ash Berlin-Taylor <ash_github@firemirror.com>
(cherry picked from commit 0b030c5)
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
@potiuk@amoghrajesh
@kaxil@utkarsharma2
Suppress warnings when masking sensitive confs (#43335) (#43337)
5ae628a
This is to prevent issues such as #43334
(cherry picked from commit 0a9c3c0)
---------
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
@jedcunningham I made some changes to the PR title in changelogs, PTAL.
@kaxil
kaxil
commented
Oct 24, 2024

Copy link


Copy Markdown

Member
@utkarsharma2 we need to get #43348 in fyi
shahar1and others
added 3 commits
October 24, 2024 19:51
@shahar1@Baitur5@utkarsharma2
Fixed type in section Object Storage XCom Backend in file xcoms.rst (#…
07c77bd
…43339) (#43342)
(cherry picked from commit 7c6c106)
Co-authored-by: Baitur Ulukbekov <ulukbekovbr@gmail.com>
(cherry picked from commit a13c49e)
@kaxil@utkarsharma2
Add Airflow 3 ui & task_sdk directories to gitignore (#43319)
17dc189
(cherry picked from commit 0c6c850)
@kaxil@utkarsharma2
Remove Scarf analytics from Airflow Webserver (#43346) (#43348)
56a8da6
Since we have already made decisions about what we want to do for Plugins in Airflow 3 and revamping the entire UI, this data isn't that important. There were also concerns raised about de-depulications and other things.
(cherry picked from commit dc25301)
(cherry picked from commit 2860f81)
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
@utkarsharma2 we need to get #43348 in fyi
Included it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
cc: @eladkal ^^
Lee-Wand others
added 4 commits
October 28, 2024 13:43
@Lee-W@utkarsharma2
ci(pre-commit): migrate pre-commit config (#43372)
65bcce2
We update the names of the pre-commit stages. From the https://pre-commit.com/#confining-hooks-to-run-at-certain-stages:
new in 3.2.0: The values of stages match the hook names. Previously, commit, push, and merge-commit matched pre-commit, pre-push, and pre-merge-commit respectively.
(cherry picked from commit add8e9d)
@romsharon98@utkarsharma2
prevent out of index error in getDagRunLabel function (#43388) (#43404)
6227911
(cherry picked from commit 4652fed)
@utkarsharma2
Update Airflow version to 2.10.3
0db817e
@utkarsharma2
Update RELEASE_NOTES.rst
7557819
@utkarsharma2
utkarsharma2
commented
Oct 28, 2024

Copy link


Copy Markdown

ContributorAuthor
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
* [WTForms 3.2.0 broke Airflow main #43228](https://github.com/apache/airflow/issues/43228)
* [500 on any admin pages #43270](https://github.com/apache/airflow/issues/43270)
* [WTForms==3.2.1 breaks UI #43356](https://github.com/apache/airflow/issues/43356)
* [AttributeError: 'tuple' object has no attribute 'items' when entering UI Admin Variables Section #43375](https://github.com/apache/airflow/issues/43375)

And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
Since we already have 1st wave of providers out, I'm proceeding with release.
@potiuk
potiuk
commented
Oct 28, 2024•

edited

Loading

Copy link


Copy Markdown

Member
Since we already have 1st wave of providers out, I'm proceeding with release.
Go ahead, we can always regenerate the constraints to include the new providers released - they are rather independent from the release and internal RC testing and we've already done it in the past.
@utkarsharma2
utkarsharma2
merged commit 7557819
into
v2-10-stableOct 28, 2024
@potiuk
potiuk
deleted the

sync_v2_10_test

branch
January 11, 2025 19:44
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@ephraimbuddyephraimbuddyephraimbuddy approved these changes
@phanikumvphanikumvphanikumv approved these changes
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin
@dstandishdstandishAwaiting requested review from dstandishdstandish is a code owner
@kaxilkaxilAwaiting requested review from kaxilkaxil is a code owner
@pierrejeambrunpierrejeambrunAwaiting requested review from pierrejeambrunpierrejeambrun is a code owner
@potiukpotiukAwaiting requested review from potiukpotiuk is a code owner
@ashbashbAwaiting requested review from ashbashb is a code owner
@eladkaleladkalAwaiting requested review from eladkaleladkal is a code owner
@mobuchowskimobuchowskiAwaiting requested review from mobuchowski
@o-nikolaso-nikolasAwaiting requested review from o-nikolaso-nikolas is a code owner
@hussein-awalahussein-awalaAwaiting requested review from hussein-awalahussein-awala is a code owner
@uranusjruranusjrAwaiting requested review from uranusjruranusjr is a code owner
@ryanahamiltonryanahamiltonAwaiting requested review from ryanahamiltonryanahamilton is a code owner
@bbovenzibbovenziAwaiting requested review from bbovenzibbovenzi is a code owner
@XD-DENGXD-DENGAwaiting requested review from XD-DENGXD-DENG is a code owner
@jedcunninghamjedcunninghamAwaiting requested review from jedcunninghamjedcunningham is a code owner

Assignees


No one assigned


Labels

area:APIAirflow's REST/HTTP APIarea:CLIarea:dev-toolsarea:production-imageProduction image improvements and fixes

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

18 participants

@utkarsharma2@kaxil@potiuk@ephraimbuddy@jedcunningham@phanikumv@vincbeck@romsharon98@pierrejeambrun@jscheffl@shahar1@bbovenzi@Lee-W@infused-kim@jason810496@gopidesupavan@uranusjr@Joffreybvn

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Auto-enable theater mode on YouTube
(function() {
function tryTheater() {
var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]');
if (btn && !btn.classList.contains('activated')) {
btn.click();
}
}
// Try immediately
tryTheater();
// Try after navigation (SPA)
var lastUrl = location.href;
setInterval(function() {
if (location.href !== lastUrl) {
lastUrl = location.href;
setTimeout(tryTheater, 500);
}
}, 1000);
// Also try on player load
var observer = new MutationObserver(tryTheater);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 by utkarsharma2 · Pull Request #43306 · apache/airflow · GitHub
Skip to content
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 - #43306
Merged
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Oct 28, 2024
Merged
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3#43306
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Conversation
@utkarsharma2
@utkarsharma2utkarsharma2
commented
Oct 23, 2024

Copy link


Copy Markdown

Contributor
Time for 2.10.3rc1!
@boring-cyborgboring-cyborgBot
added

area:API
Airflow's REST/HTTP API
area:CLI

area:dev-tools

area:production-image
Production image improvements and fixes
labels
Oct 23, 2024
@utkarsharma2
utkarsharma2
marked this pull request as draft
October 23, 2024 10:55
@utkarsharma2
utkarsharma2
marked this pull request as ready for review
October 23, 2024 12:18
jedcunningham
jedcunningham
reviewed
Oct 23, 2024
View reviewed changes
@jedcunninghamjedcunningham
left a comment


Copy link


Copy Markdown

Member
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
Comment threadRELEASE_NOTES.rst
Outdated

Comment threadRELEASE_NOTES.rst
Outdated

vincbeckand others
added 6 commits
October 24, 2024 13:12
@vincbeck@lucasmo@utkarsharma2
Fix documentation for cpu and memory usage (#42147) (#42256)
bf0ba5a
These metrics are reported in airflow/task/task_runner/standard_task_runner.py without "percent"
(cherry picked from commit 3f6497b)
Co-authored-by: lucasmo <lucas.madar@gmail.com>
@romsharon98@onestn@utkarsharma2
fix: Correct docstring format in _get_template_context (#42244) (#42272)
1fc0d85
(cherry picked from commit 8fe2861)
Co-authored-by: Wonseok Yang <deadline.yang@gmail.com>
@pierrejeambrun@dependabot@utkarsharma2
Bump dompurify from 2.2.9 to 2.5.6 in /airflow/www (#42263) (#42270)
3696fd0
Bumps [dompurify](https://github.com/cure53/DOMPurify) from 2.2.9 to 2.5.6.
- [Release notes](https://github.com/cure53/DOMPurify/releases)
- [Commits](cure53/DOMPurify@2.2.9...2.5.6)
---
updated-dependencies:
- dependency-name: dompurify
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit fc5f686)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@jscheffl@utkarsharma2
Update StatsD Image Tag from failed dependencies check (#42264) (#42281)
c39d66c
(cherry picked from commit b5576c0)
@vincbeck@josephangbc@utkarsharma2
Useselectinloadin trigger (#40487) (#42351)
3fc3a54
(cherry picked from commit 46b41e3)
Co-authored-by: Joseph Ang <josephangbc@gmail.com>
@romsharon98@utkarsharma2
apply otel_service on metrics (#42242) (#42441)
ec1c4dc
* apply otel_service on metrics
* change version_added to 2.10.3
(cherry picked from commit e14b4ca)
kaxiland others
added 5 commits
October 24, 2024 13:12
@kaxil@utkarsharma2
Backport: Bump Flask-AppBuilder to4.5.2(#43309) (#43318)
4131ee0
@shahar1@Udbv@utkarsharma2
Fix instruction for docker compose(tested on Mac M1) (#43119) (#43321)
1eadd75
* Fix instruction for docker compose(tested on Mac M1)
Make fixes that allows to run airflow dags in pycharm debugger on Mac M1
* fix static checks
* fix linter error
* fix unexpected identation
---------
Co-authored-by: Shahar Epstein <60007259+shahar1@users.noreply.github.com>
(cherry picked from commit d725cf6)
Co-authored-by: Bohdan Udovenko <bohdan.udov@gmail.com>
@Joffreybvn@joffreybienvenu-infrabel@utkarsharma2
[Backport] BashOperator: Execute templated bash script as file (#43191)
c4ca3cd
---------
Co-authored-by: Joffrey Bienvenu <joffrey.bienvenu@infrabel.be>
@potiuk@amoghrajesh@utkarsharma2
Masking configuration values irrelevant to DAG author (#43040) (#43336)
4938ffc
Some configurations are irrelevant to DAG authors and hence we need to mask those to avoid it from getting logged unknowingly.
Co-authored-by: adesai <adesai@cloudera.com>
Co-authored-by: Ash Berlin-Taylor <ash_github@firemirror.com>
(cherry picked from commit 0b030c5)
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
@potiuk@amoghrajesh
@kaxil@utkarsharma2
Suppress warnings when masking sensitive confs (#43335) (#43337)
5ae628a
This is to prevent issues such as #43334
(cherry picked from commit 0a9c3c0)
---------
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
@jedcunningham I made some changes to the PR title in changelogs, PTAL.
@kaxil
kaxil
commented
Oct 24, 2024

Copy link


Copy Markdown

Member
@utkarsharma2 we need to get #43348 in fyi
shahar1and others
added 3 commits
October 24, 2024 19:51
@shahar1@Baitur5@utkarsharma2
Fixed type in section Object Storage XCom Backend in file xcoms.rst (#…
07c77bd
…43339) (#43342)
(cherry picked from commit 7c6c106)
Co-authored-by: Baitur Ulukbekov <ulukbekovbr@gmail.com>
(cherry picked from commit a13c49e)
@kaxil@utkarsharma2
Add Airflow 3 ui & task_sdk directories to gitignore (#43319)
17dc189
(cherry picked from commit 0c6c850)
@kaxil@utkarsharma2
Remove Scarf analytics from Airflow Webserver (#43346) (#43348)
56a8da6
Since we have already made decisions about what we want to do for Plugins in Airflow 3 and revamping the entire UI, this data isn't that important. There were also concerns raised about de-depulications and other things.
(cherry picked from commit dc25301)
(cherry picked from commit 2860f81)
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
@utkarsharma2 we need to get #43348 in fyi
Included it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
cc: @eladkal ^^
Lee-Wand others
added 4 commits
October 28, 2024 13:43
@Lee-W@utkarsharma2
ci(pre-commit): migrate pre-commit config (#43372)
65bcce2
We update the names of the pre-commit stages. From the https://pre-commit.com/#confining-hooks-to-run-at-certain-stages:
new in 3.2.0: The values of stages match the hook names. Previously, commit, push, and merge-commit matched pre-commit, pre-push, and pre-merge-commit respectively.
(cherry picked from commit add8e9d)
@romsharon98@utkarsharma2
prevent out of index error in getDagRunLabel function (#43388) (#43404)
6227911
(cherry picked from commit 4652fed)
@utkarsharma2
Update Airflow version to 2.10.3
0db817e
@utkarsharma2
Update RELEASE_NOTES.rst
7557819
@utkarsharma2
utkarsharma2
commented
Oct 28, 2024

Copy link


Copy Markdown

ContributorAuthor
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
* [WTForms 3.2.0 broke Airflow main #43228](https://github.com/apache/airflow/issues/43228)
* [500 on any admin pages #43270](https://github.com/apache/airflow/issues/43270)
* [WTForms==3.2.1 breaks UI #43356](https://github.com/apache/airflow/issues/43356)
* [AttributeError: 'tuple' object has no attribute 'items' when entering UI Admin Variables Section #43375](https://github.com/apache/airflow/issues/43375)

And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
Since we already have 1st wave of providers out, I'm proceeding with release.
@potiuk
potiuk
commented
Oct 28, 2024•

edited

Loading

Copy link


Copy Markdown

Member
Since we already have 1st wave of providers out, I'm proceeding with release.
Go ahead, we can always regenerate the constraints to include the new providers released - they are rather independent from the release and internal RC testing and we've already done it in the past.
@utkarsharma2
utkarsharma2
merged commit 7557819
into
v2-10-stableOct 28, 2024
@potiuk
potiuk
deleted the

sync_v2_10_test

branch
January 11, 2025 19:44
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@ephraimbuddyephraimbuddyephraimbuddy approved these changes
@phanikumvphanikumvphanikumv approved these changes
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin
@dstandishdstandishAwaiting requested review from dstandishdstandish is a code owner
@kaxilkaxilAwaiting requested review from kaxilkaxil is a code owner
@pierrejeambrunpierrejeambrunAwaiting requested review from pierrejeambrunpierrejeambrun is a code owner
@potiukpotiukAwaiting requested review from potiukpotiuk is a code owner
@ashbashbAwaiting requested review from ashbashb is a code owner
@eladkaleladkalAwaiting requested review from eladkaleladkal is a code owner
@mobuchowskimobuchowskiAwaiting requested review from mobuchowski
@o-nikolaso-nikolasAwaiting requested review from o-nikolaso-nikolas is a code owner
@hussein-awalahussein-awalaAwaiting requested review from hussein-awalahussein-awala is a code owner
@uranusjruranusjrAwaiting requested review from uranusjruranusjr is a code owner
@ryanahamiltonryanahamiltonAwaiting requested review from ryanahamiltonryanahamilton is a code owner
@bbovenzibbovenziAwaiting requested review from bbovenzibbovenzi is a code owner
@XD-DENGXD-DENGAwaiting requested review from XD-DENGXD-DENG is a code owner
@jedcunninghamjedcunninghamAwaiting requested review from jedcunninghamjedcunningham is a code owner

Assignees


No one assigned


Labels

area:APIAirflow's REST/HTTP APIarea:CLIarea:dev-toolsarea:production-imageProduction image improvements and fixes

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

18 participants

@utkarsharma2@kaxil@potiuk@ephraimbuddy@jedcunningham@phanikumv@vincbeck@romsharon98@pierrejeambrun@jscheffl@shahar1@bbovenzi@Lee-W@infused-kim@jason810496@gopidesupavan@uranusjr@Joffreybvn

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Remove or un-stick sticky/fixed headers that block content
(function() {
function unstick() {
document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) {
if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {
el.style.position = 'static';
el.style.top = 'auto';
el.style.zIndex = 'auto';
}
});
}
unstick();
var observer = new MutationObserver(unstick);
observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });
})();
}
} catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 by utkarsharma2 · Pull Request #43306 · apache/airflow · GitHub
Skip to content
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 - #43306
Merged
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Oct 28, 2024
Merged
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3#43306
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Conversation
@utkarsharma2
@utkarsharma2utkarsharma2
commented
Oct 23, 2024

Copy link


Copy Markdown

Contributor
Time for 2.10.3rc1!
@boring-cyborgboring-cyborgBot
added

area:API
Airflow's REST/HTTP API
area:CLI

area:dev-tools

area:production-image
Production image improvements and fixes
labels
Oct 23, 2024
@utkarsharma2
utkarsharma2
marked this pull request as draft
October 23, 2024 10:55
@utkarsharma2
utkarsharma2
marked this pull request as ready for review
October 23, 2024 12:18
jedcunningham
jedcunningham
reviewed
Oct 23, 2024
View reviewed changes
@jedcunninghamjedcunningham
left a comment


Copy link


Copy Markdown

Member
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
Comment threadRELEASE_NOTES.rst
Outdated

Comment threadRELEASE_NOTES.rst
Outdated

vincbeckand others
added 6 commits
October 24, 2024 13:12
@vincbeck@lucasmo@utkarsharma2
Fix documentation for cpu and memory usage (#42147) (#42256)
bf0ba5a
These metrics are reported in airflow/task/task_runner/standard_task_runner.py without "percent"
(cherry picked from commit 3f6497b)
Co-authored-by: lucasmo <lucas.madar@gmail.com>
@romsharon98@onestn@utkarsharma2
fix: Correct docstring format in _get_template_context (#42244) (#42272)
1fc0d85
(cherry picked from commit 8fe2861)
Co-authored-by: Wonseok Yang <deadline.yang@gmail.com>
@pierrejeambrun@dependabot@utkarsharma2
Bump dompurify from 2.2.9 to 2.5.6 in /airflow/www (#42263) (#42270)
3696fd0
Bumps [dompurify](https://github.com/cure53/DOMPurify) from 2.2.9 to 2.5.6.
- [Release notes](https://github.com/cure53/DOMPurify/releases)
- [Commits](cure53/DOMPurify@2.2.9...2.5.6)
---
updated-dependencies:
- dependency-name: dompurify
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit fc5f686)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@jscheffl@utkarsharma2
Update StatsD Image Tag from failed dependencies check (#42264) (#42281)
c39d66c
(cherry picked from commit b5576c0)
@vincbeck@josephangbc@utkarsharma2
Useselectinloadin trigger (#40487) (#42351)
3fc3a54
(cherry picked from commit 46b41e3)
Co-authored-by: Joseph Ang <josephangbc@gmail.com>
@romsharon98@utkarsharma2
apply otel_service on metrics (#42242) (#42441)
ec1c4dc
* apply otel_service on metrics
* change version_added to 2.10.3
(cherry picked from commit e14b4ca)
kaxiland others
added 5 commits
October 24, 2024 13:12
@kaxil@utkarsharma2
Backport: Bump Flask-AppBuilder to4.5.2(#43309) (#43318)
4131ee0
@shahar1@Udbv@utkarsharma2
Fix instruction for docker compose(tested on Mac M1) (#43119) (#43321)
1eadd75
* Fix instruction for docker compose(tested on Mac M1)
Make fixes that allows to run airflow dags in pycharm debugger on Mac M1
* fix static checks
* fix linter error
* fix unexpected identation
---------
Co-authored-by: Shahar Epstein <60007259+shahar1@users.noreply.github.com>
(cherry picked from commit d725cf6)
Co-authored-by: Bohdan Udovenko <bohdan.udov@gmail.com>
@Joffreybvn@joffreybienvenu-infrabel@utkarsharma2
[Backport] BashOperator: Execute templated bash script as file (#43191)
c4ca3cd
---------
Co-authored-by: Joffrey Bienvenu <joffrey.bienvenu@infrabel.be>
@potiuk@amoghrajesh@utkarsharma2
Masking configuration values irrelevant to DAG author (#43040) (#43336)
4938ffc
Some configurations are irrelevant to DAG authors and hence we need to mask those to avoid it from getting logged unknowingly.
Co-authored-by: adesai <adesai@cloudera.com>
Co-authored-by: Ash Berlin-Taylor <ash_github@firemirror.com>
(cherry picked from commit 0b030c5)
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
@potiuk@amoghrajesh
@kaxil@utkarsharma2
Suppress warnings when masking sensitive confs (#43335) (#43337)
5ae628a
This is to prevent issues such as #43334
(cherry picked from commit 0a9c3c0)
---------
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
@jedcunningham I made some changes to the PR title in changelogs, PTAL.
@kaxil
kaxil
commented
Oct 24, 2024

Copy link


Copy Markdown

Member
@utkarsharma2 we need to get #43348 in fyi
shahar1and others
added 3 commits
October 24, 2024 19:51
@shahar1@Baitur5@utkarsharma2
Fixed type in section Object Storage XCom Backend in file xcoms.rst (#…
07c77bd
…43339) (#43342)
(cherry picked from commit 7c6c106)
Co-authored-by: Baitur Ulukbekov <ulukbekovbr@gmail.com>
(cherry picked from commit a13c49e)
@kaxil@utkarsharma2
Add Airflow 3 ui & task_sdk directories to gitignore (#43319)
17dc189
(cherry picked from commit 0c6c850)
@kaxil@utkarsharma2
Remove Scarf analytics from Airflow Webserver (#43346) (#43348)
56a8da6
Since we have already made decisions about what we want to do for Plugins in Airflow 3 and revamping the entire UI, this data isn't that important. There were also concerns raised about de-depulications and other things.
(cherry picked from commit dc25301)
(cherry picked from commit 2860f81)
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
@utkarsharma2 we need to get #43348 in fyi
Included it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
cc: @eladkal ^^
Lee-Wand others
added 4 commits
October 28, 2024 13:43
@Lee-W@utkarsharma2
ci(pre-commit): migrate pre-commit config (#43372)
65bcce2
We update the names of the pre-commit stages. From the https://pre-commit.com/#confining-hooks-to-run-at-certain-stages:
new in 3.2.0: The values of stages match the hook names. Previously, commit, push, and merge-commit matched pre-commit, pre-push, and pre-merge-commit respectively.
(cherry picked from commit add8e9d)
@romsharon98@utkarsharma2
prevent out of index error in getDagRunLabel function (#43388) (#43404)
6227911
(cherry picked from commit 4652fed)
@utkarsharma2
Update Airflow version to 2.10.3
0db817e
@utkarsharma2
Update RELEASE_NOTES.rst
7557819
@utkarsharma2
utkarsharma2
commented
Oct 28, 2024

Copy link


Copy Markdown

ContributorAuthor
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
* [WTForms 3.2.0 broke Airflow main #43228](https://github.com/apache/airflow/issues/43228)
* [500 on any admin pages #43270](https://github.com/apache/airflow/issues/43270)
* [WTForms==3.2.1 breaks UI #43356](https://github.com/apache/airflow/issues/43356)
* [AttributeError: 'tuple' object has no attribute 'items' when entering UI Admin Variables Section #43375](https://github.com/apache/airflow/issues/43375)

And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
Since we already have 1st wave of providers out, I'm proceeding with release.
@potiuk
potiuk
commented
Oct 28, 2024•

edited

Loading

Copy link


Copy Markdown

Member
Since we already have 1st wave of providers out, I'm proceeding with release.
Go ahead, we can always regenerate the constraints to include the new providers released - they are rather independent from the release and internal RC testing and we've already done it in the past.
@utkarsharma2
utkarsharma2
merged commit 7557819
into
v2-10-stableOct 28, 2024
@potiuk
potiuk
deleted the

sync_v2_10_test

branch
January 11, 2025 19:44
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@ephraimbuddyephraimbuddyephraimbuddy approved these changes
@phanikumvphanikumvphanikumv approved these changes
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin
@dstandishdstandishAwaiting requested review from dstandishdstandish is a code owner
@kaxilkaxilAwaiting requested review from kaxilkaxil is a code owner
@pierrejeambrunpierrejeambrunAwaiting requested review from pierrejeambrunpierrejeambrun is a code owner
@potiukpotiukAwaiting requested review from potiukpotiuk is a code owner
@ashbashbAwaiting requested review from ashbashb is a code owner
@eladkaleladkalAwaiting requested review from eladkaleladkal is a code owner
@mobuchowskimobuchowskiAwaiting requested review from mobuchowski
@o-nikolaso-nikolasAwaiting requested review from o-nikolaso-nikolas is a code owner
@hussein-awalahussein-awalaAwaiting requested review from hussein-awalahussein-awala is a code owner
@uranusjruranusjrAwaiting requested review from uranusjruranusjr is a code owner
@ryanahamiltonryanahamiltonAwaiting requested review from ryanahamiltonryanahamilton is a code owner
@bbovenzibbovenziAwaiting requested review from bbovenzibbovenzi is a code owner
@XD-DENGXD-DENGAwaiting requested review from XD-DENGXD-DENG is a code owner
@jedcunninghamjedcunninghamAwaiting requested review from jedcunninghamjedcunningham is a code owner

Assignees


No one assigned


Labels

area:APIAirflow's REST/HTTP APIarea:CLIarea:dev-toolsarea:production-imageProduction image improvements and fixes

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

18 participants

@utkarsharma2@kaxil@potiuk@ephraimbuddy@jedcunningham@phanikumv@vincbeck@romsharon98@pierrejeambrun@jscheffl@shahar1@bbovenzi@Lee-W@infused-kim@jason810496@gopidesupavan@uranusjr@Joffreybvn

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Universal Dark Mode - works on any site
(function() {
var enabled = true;
function applyDarkMode() {
if (!enabled) return;
// Create style element if it doesn't exist
var style = document.getElementById('universal-dark-mode-style');
if (!style) {
style = document.createElement('style');
style.id = 'universal-dark-mode-style';
document.head.appendChild(style);
}
// Dark mode CSS - inverts colors but preserves images/video
style.textContent = '
/* Invert everything except media */
html {
filter: invert(1) hue-rotate(180deg) !important;
background: #1a1a2e !important;
}
/* Restore images, videos, iframes, canvas */
img, video, iframe, canvas, svg, picture, [style*="background-image"] {
filter: invert(1) hue-rotate(180deg) !important;
}
/* Preserve specific elements that should not be inverted */
.no-dark-mode, .no-dark-mode *,
[data-theme="light"], [data-theme="light"],
.ace_editor, .ace_editor *,
.CodeMirror, .CodeMirror *,
.monaco-editor, .monaco-editor *,
.markdown-body pre, .markdown-body pre *,
.highlight, .highlight *,
pre code, pre code * {
filter: none !important;
}
/* Fix common UI elements */
.modal, .popup, .dropdown-menu, .tooltip, .popover {
filter: invert(1) hue-rotate(180deg) !important;
background: #2d2d44 !important;
border-color: #444 !important;
}
/* Scrollbars */
::-webkit-scrollbar { background: #1a1a2e !important; }
::-webkit-scrollbar-thumb { background: #444 !important; }
::-webkit-scrollbar-thumb:hover { background: #555 !important; }
/* Selection */
::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }
::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }
';
}
function removeDarkMode() {
var style = document.getElementById('universal-dark-mode-style');
if (style) style.remove();
}
// Toggle with Alt+Shift+D
document.addEventListener('keydown', function(e) {
if (e.altKey && e.shiftKey && e.key === 'D') {
e.preventDefault();
enabled = !enabled;
if (enabled) {
applyDarkMode();
console.log('[Universal Dark Mode] Enabled');
} else {
removeDarkMode();
console.log('[Universal Dark Mode] Disabled');
}
}
});
// Apply on load
applyDarkMode();
// Re-apply on dynamic content
var observer = new MutationObserver(function(mutations) {
if (enabled && !document.getElementById('universal-dark-mode-style')) {
applyDarkMode();
}
});
observer.observe(document.head, { childList: true });
console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');
})();
}
} catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); }
})();
})();
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 by utkarsharma2 · Pull Request #43306 · apache/airflow · GitHub
Skip to content
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3 - #43306
Merged
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Oct 28, 2024
Merged
Sync v2-10-stable with v2-10-test(sync_v2_10_test) to release 2.10.3#43306
utkarsharma2 merged 67 commits into
v2-10-stablefrom 
sync_v2_10_test
Conversation
@utkarsharma2
@utkarsharma2utkarsharma2
commented
Oct 23, 2024

Copy link


Copy Markdown

Contributor
Time for 2.10.3rc1!
@boring-cyborgboring-cyborgBot
added

area:API
Airflow's REST/HTTP API
area:CLI

area:dev-tools

area:production-image
Production image improvements and fixes
labels
Oct 23, 2024
@utkarsharma2
utkarsharma2
marked this pull request as draft
October 23, 2024 10:55
@utkarsharma2
utkarsharma2
marked this pull request as ready for review
October 23, 2024 12:18
jedcunningham
jedcunningham
reviewed
Oct 23, 2024
View reviewed changes
@jedcunninghamjedcunningham
left a comment


Copy link


Copy Markdown

Member
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
Comment threadRELEASE_NOTES.rst
Outdated

Comment threadRELEASE_NOTES.rst
Outdated

vincbeckand others
added 6 commits
October 24, 2024 13:12
@vincbeck@lucasmo@utkarsharma2
Fix documentation for cpu and memory usage (#42147) (#42256)
bf0ba5a
These metrics are reported in airflow/task/task_runner/standard_task_runner.py without "percent"
(cherry picked from commit 3f6497b)
Co-authored-by: lucasmo <lucas.madar@gmail.com>
@romsharon98@onestn@utkarsharma2
fix: Correct docstring format in _get_template_context (#42244) (#42272)
1fc0d85
(cherry picked from commit 8fe2861)
Co-authored-by: Wonseok Yang <deadline.yang@gmail.com>
@pierrejeambrun@dependabot@utkarsharma2
Bump dompurify from 2.2.9 to 2.5.6 in /airflow/www (#42263) (#42270)
3696fd0
Bumps [dompurify](https://github.com/cure53/DOMPurify) from 2.2.9 to 2.5.6.
- [Release notes](https://github.com/cure53/DOMPurify/releases)
- [Commits](cure53/DOMPurify@2.2.9...2.5.6)
---
updated-dependencies:
- dependency-name: dompurify
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit fc5f686)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@jscheffl@utkarsharma2
Update StatsD Image Tag from failed dependencies check (#42264) (#42281)
c39d66c
(cherry picked from commit b5576c0)
@vincbeck@josephangbc@utkarsharma2
Useselectinloadin trigger (#40487) (#42351)
3fc3a54
(cherry picked from commit 46b41e3)
Co-authored-by: Joseph Ang <josephangbc@gmail.com>
@romsharon98@utkarsharma2
apply otel_service on metrics (#42242) (#42441)
ec1c4dc
* apply otel_service on metrics
* change version_added to 2.10.3
(cherry picked from commit e14b4ca)
kaxiland others
added 5 commits
October 24, 2024 13:12
@kaxil@utkarsharma2
Backport: Bump Flask-AppBuilder to4.5.2(#43309) (#43318)
4131ee0
@shahar1@Udbv@utkarsharma2
Fix instruction for docker compose(tested on Mac M1) (#43119) (#43321)
1eadd75
* Fix instruction for docker compose(tested on Mac M1)
Make fixes that allows to run airflow dags in pycharm debugger on Mac M1
* fix static checks
* fix linter error
* fix unexpected identation
---------
Co-authored-by: Shahar Epstein <60007259+shahar1@users.noreply.github.com>
(cherry picked from commit d725cf6)
Co-authored-by: Bohdan Udovenko <bohdan.udov@gmail.com>
@Joffreybvn@joffreybienvenu-infrabel@utkarsharma2
[Backport] BashOperator: Execute templated bash script as file (#43191)
c4ca3cd
---------
Co-authored-by: Joffrey Bienvenu <joffrey.bienvenu@infrabel.be>
@potiuk@amoghrajesh@utkarsharma2
Masking configuration values irrelevant to DAG author (#43040) (#43336)
4938ffc
Some configurations are irrelevant to DAG authors and hence we need to mask those to avoid it from getting logged unknowingly.
Co-authored-by: adesai <adesai@cloudera.com>
Co-authored-by: Ash Berlin-Taylor <ash_github@firemirror.com>
(cherry picked from commit 0b030c5)
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
@potiuk@amoghrajesh
@kaxil@utkarsharma2
Suppress warnings when masking sensitive confs (#43335) (#43337)
5ae628a
This is to prevent issues such as #43334
(cherry picked from commit 0a9c3c0)
---------
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
The list could use a "does the title make sense for an end user" pass or 2, but overall looks good.
@jedcunningham I made some changes to the PR title in changelogs, PTAL.
@kaxil
kaxil
commented
Oct 24, 2024

Copy link


Copy Markdown

Member
@utkarsharma2 we need to get #43348 in fyi
shahar1and others
added 3 commits
October 24, 2024 19:51
@shahar1@Baitur5@utkarsharma2
Fixed type in section Object Storage XCom Backend in file xcoms.rst (#…
07c77bd
…43339) (#43342)
(cherry picked from commit 7c6c106)
Co-authored-by: Baitur Ulukbekov <ulukbekovbr@gmail.com>
(cherry picked from commit a13c49e)
@kaxil@utkarsharma2
Add Airflow 3 ui & task_sdk directories to gitignore (#43319)
17dc189
(cherry picked from commit 0c6c850)
@kaxil@utkarsharma2
Remove Scarf analytics from Airflow Webserver (#43346) (#43348)
56a8da6
Since we have already made decisions about what we want to do for Plugins in Airflow 3 and revamping the entire UI, this data isn't that important. There were also concerns raised about de-depulications and other things.
(cherry picked from commit dc25301)
(cherry picked from commit 2860f81)
@utkarsharma2
utkarsharma2
commented
Oct 24, 2024

Copy link


Copy Markdown

ContributorAuthor
@utkarsharma2 we need to get #43348 in fyi
Included it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
@potiuk
potiuk
commented
Oct 25, 2024•

edited

Loading

Copy link


Copy Markdown

Member
cc: @eladkal ^^
Lee-Wand others
added 4 commits
October 28, 2024 13:43
@Lee-W@utkarsharma2
ci(pre-commit): migrate pre-commit config (#43372)
65bcce2
We update the names of the pre-commit stages. From the https://pre-commit.com/#confining-hooks-to-run-at-certain-stages:
new in 3.2.0: The values of stages match the hook names. Previously, commit, push, and merge-commit matched pre-commit, pre-push, and pre-merge-commit respectively.
(cherry picked from commit add8e9d)
@romsharon98@utkarsharma2
prevent out of index error in getDagRunLabel function (#43388) (#43404)
6227911
(cherry picked from commit 4652fed)
@utkarsharma2
Update Airflow version to 2.10.3
0db817e
@utkarsharma2
Update RELEASE_NOTES.rst
7557819
@utkarsharma2
utkarsharma2
commented
Oct 28, 2024

Copy link


Copy Markdown

ContributorAuthor
One comment. I think - at least before final realease we need to release all the providers or at least the apache-airflow-providers-fab - with the Flask-Application-Builder == 4.5.2. We already have a number of issues of people who either do not use constraints or use and update their own constraints (because of WTForms release breaking FAB):
* [WTForms 3.2.0 broke Airflow main #43228](https://github.com/apache/airflow/issues/43228)
* [500 on any admin pages #43270](https://github.com/apache/airflow/issues/43270)
* [WTForms==3.2.1 breaks UI #43356](https://github.com/apache/airflow/issues/43356)
* [AttributeError: 'tuple' object has no attribute 'items' when entering UI Admin Variables Section #43375](https://github.com/apache/airflow/issues/43375)

And this is something we can only address by releasing the new FAB provider and making sure constraints are updated to point to it.
Since we already have 1st wave of providers out, I'm proceeding with release.
@potiuk
potiuk
commented
Oct 28, 2024•

edited

Loading

Copy link


Copy Markdown

Member
Since we already have 1st wave of providers out, I'm proceeding with release.
Go ahead, we can always regenerate the constraints to include the new providers released - they are rather independent from the release and internal RC testing and we've already done it in the past.
@utkarsharma2
utkarsharma2
merged commit 7557819
into
v2-10-stableOct 28, 2024
@potiuk
potiuk
deleted the

sync_v2_10_test

branch
January 11, 2025 19:44
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@ephraimbuddyephraimbuddyephraimbuddy approved these changes
@phanikumvphanikumvphanikumv approved these changes
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin
@dstandishdstandishAwaiting requested review from dstandishdstandish is a code owner
@kaxilkaxilAwaiting requested review from kaxilkaxil is a code owner
@pierrejeambrunpierrejeambrunAwaiting requested review from pierrejeambrunpierrejeambrun is a code owner
@potiukpotiukAwaiting requested review from potiukpotiuk is a code owner
@ashbashbAwaiting requested review from ashbashb is a code owner
@eladkaleladkalAwaiting requested review from eladkaleladkal is a code owner
@mobuchowskimobuchowskiAwaiting requested review from mobuchowski
@o-nikolaso-nikolasAwaiting requested review from o-nikolaso-nikolas is a code owner
@hussein-awalahussein-awalaAwaiting requested review from hussein-awalahussein-awala is a code owner
@uranusjruranusjrAwaiting requested review from uranusjruranusjr is a code owner
@ryanahamiltonryanahamiltonAwaiting requested review from ryanahamiltonryanahamilton is a code owner
@bbovenzibbovenziAwaiting requested review from bbovenzibbovenzi is a code owner
@XD-DENGXD-DENGAwaiting requested review from XD-DENGXD-DENG is a code owner
@jedcunninghamjedcunninghamAwaiting requested review from jedcunninghamjedcunningham is a code owner

Assignees


No one assigned


Labels

area:APIAirflow's REST/HTTP APIarea:CLIarea:dev-toolsarea:production-imageProduction image improvements and fixes

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

18 participants

@utkarsharma2@kaxil@potiuk@ephraimbuddy@jedcunningham@phanikumv@vincbeck@romsharon98@pierrejeambrun@jscheffl@shahar1@bbovenzi@Lee-W@infused-kim@jason810496@gopidesupavan@uranusjr@Joffreybvn