Skip to content

Fix: DAGs are not marked as stale if the dags folder change (#41433) - #41829

Merged
utkarsharma2 merged 1 commit into
apache:v2-10-testfrom
astronomer:backport_dag_parsing
Aug 28, 2024
Merged

Fix: DAGs are not marked as stale if the dags folder change (#41433)#41829
utkarsharma2 merged 1 commit into
apache:v2-10-testfrom
astronomer:backport_dag_parsing

Conversation

@utkarsharma2

Copy link
Copy Markdown
Contributor

Fix: DAGs are not marked as stale if the AIRFLOW__CORE__DAGS_FOLDER changes

Co-authored-by: Jed Cunningham 66968678+jedcunningham@users.noreply.github.com

  • Update if condition for readability

Co-authored-by: Jed Cunningham 66968678+jedcunningham@users.noreply.github.com
(cherry picked from commit 9f30a41)


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

…1433)
* Fix: DAGs are not marked as stale if the AIRFLOW__CORE__DAGS_FOLDER changes
* Update airflow/dag_processing/manager.py
* Add testcase
* Add code comment
* Update code comment
* Update the logic for checking the current dag_directory
* Update testcases
* Remove unwanted code
* Uncomment code
* Add processor_subdir when creating processor_subdir
* Fix test_retry_still_in_executor test
* Remove config from test
* Update airflow/dag_processing/manager.py
Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
* Update if condition for readability
---------
Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
(cherry picked from commit 9f30a41)
@utkarsharma2
utkarsharma2 merged commit 996af78 into apache:v2-10-testAug 28, 2024
@utkarsharma2
utkarsharma2 deleted the backport_dag_parsing branch August 28, 2024 12:48
@utkarsharma2utkarsharma2 added the type:bug-fix Changelog: Bug Fixes label Aug 30, 2024
utkarsharma2 added a commit that referenced this pull request Sep 2, 2024
…41829)
* Fix: DAGs are not marked as stale if the AIRFLOW__CORE__DAGS_FOLDER changes
* Update airflow/dag_processing/manager.py
* Add testcase
* Add code comment
* Update code comment
* Update the logic for checking the current dag_directory
* Update testcases
* Remove unwanted code
* Uncomment code
* Add processor_subdir when creating processor_subdir
* Fix test_retry_still_in_executor test
* Remove config from test
* Update airflow/dag_processing/manager.py
Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
* Update if condition for readability
---------
Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
(cherry picked from commit 9f30a41)
ephraimbuddy added a commit to astronomer/airflow that referenced this pull request Sep 13, 2024
jedcunningham pushed a commit that referenced this pull request Sep 13, 2024
…(41433) (#41829) (#41893) 41829 (#42220)
* Revert "Skip test_scan_stale_dags_when_dag_folder_change in DB isolation mode (#41893)"
This reverts commit 07af14a.
* Revert "Fix: DAGs are not marked as stale if the dags folder change (#41433) (#41829)"
This reverts commit 996af78.
ephraimbuddy added a commit that referenced this pull request Sep 13, 2024
…(41433) (#41829) (#41893) 41829 (#42220)
* Revert "Skip test_scan_stale_dags_when_dag_folder_change in DB isolation mode (#41893)"
This reverts commit 07af14a.
* Revert "Fix: DAGs are not marked as stale if the dags folder change (#41433) (#41829)"
This reverts commit 996af78.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:Schedulerincluding HA (high availability) schedulertype:bug-fixChangelog: Bug Fixes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@utkarsharma2@potiuk@Lee-W