Skip to content

Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath - #60519

Merged
potiuk merged 9 commits into
apache:mainfrom
ap--:update-universal-pathlib
Jan 29, 2026
Merged

Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath#60519
potiuk merged 9 commits into
apache:mainfrom
ap--:update-universal-pathlib

Conversation

@ap--

@ap--ap-- commented Jan 14, 2026•
edited
Loading

Copy link
Copy Markdown
Contributor

Closes#56369

This PR updates airflow's ObjectStoragePath class to be compatible with universal-pathlib >=0.3.8. It now uses upath.extensions.ProxyUPath as a base class, to avoid using the now deprecated _protocol_dispatch = False mechanism for class API extensions.

Also pathlib.Path added .copy, .copy_into, .move, and .move_into methods in 3.14, which means the ObjectStoragePath behavior for these is now different from standard pathlib, which defaults to recursive copies for directories and returns the target path.

Cheers,
Andreas ☺️

kaxil
kaxil reviewed Jan 14, 2026
View reviewed changes
Comment threadtask-sdk/src/airflow/sdk/io/path.py Outdated
@kaxil

kaxil commented Jan 15, 2026

Copy link
Copy Markdown
Member

cc @bolkedebruin

@potiukpotiuk added all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs full tests needed We need to run full set of tests for this PR to merge labels Jan 29, 2026
@potiuk
potiukforce-pushed the update-universal-pathlib branch from 779bf73 to 10dbeb3CompareJanuary 29, 2026 13:40
@potiuk

potiuk commented Jan 29, 2026

Copy link
Copy Markdown
Member

LGTM. Rebased and run it for all versions/full tests to see if all tests still pass.

@potiuk
potiuk merged commit e166926 into apache:mainJan 29, 2026
228 checks passed
@ap--

ap-- commented Jan 29, 2026

Copy link
Copy Markdown
ContributorAuthor

Thanks @potiuk! Feel free to tag me in case errors regarding ObjectStoragePath get reported.
I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.

And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.
Let me know if you have any suggestions.

Cheers,
Andreas

morelgeorge pushed a commit to morelgeorge/airflow that referenced this pull request Feb 1, 2026
@ap--@morelgeorge
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
1282438
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@ap--ap-- mentioned this pull request Feb 1, 2026
Open
2 tasks
shashbha14 pushed a commit to shashbha14/airflow that referenced this pull request Feb 2, 2026
@ap--Shashwati
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
79b80d2
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
jason810496 pushed a commit to abhijeets25012-tech/airflow that referenced this pull request Feb 3, 2026
@ap--@jason810496
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
bc99e78
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@potiuk

potiuk commented Feb 3, 2026

Copy link
Copy Markdown
Member

I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.

Only committers can be added :(

And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.
Let me know if you have any suggestions.

This should be rather easy - make an rc release and make a PR to airflow with universal-pathlib>=your_rc_release

jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
@ap--@jhgoebbert
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
a6d3e3b
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
@ap--@choo121600
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
831316f
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@jason810496jason810496 mentioned this pull request Mar 2, 2026
Merged
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
@ap--@Subham-KRLX
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
94bf042
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
@ap--@Ankurdeewan
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
e44dd5e
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@vatsrahul1001vatsrahul1001 mentioned this pull request Apr 2, 2026
Merged
1 task
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@kaxilkaxilkaxil left review comments
@potiukpotiukpotiuk approved these changes
@ashbashbAwaiting requested review from ashbashb is a code owner
@amoghrajeshamoghrajeshAwaiting requested review from amoghrajeshamoghrajesh is a code owner
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin

Assignees

No one assigned

Labels

all versionsIf set, the CI build will be forced to use all versions of Python/K8S/DBsarea:task-sdkfull tests neededWe need to run full set of tests for this PR to merge

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Rework universal-pathlib in ObjectStoragePath

3 participants

@ap--@kaxil@potiuk
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all 
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Update universal-pathlib to `>=0.3.8` and use upath.extensions.ProxyUPath by ap-- · Pull Request #60519 · apache/airflow · GitHub
Skip to content
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath - #60519
Merged
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Jan 29, 2026
Merged
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath#60519
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Conversation
@ap--
@ap--ap--
commented
Jan 14, 2026•

edited

Loading

Copy link


Copy Markdown

Contributor
Closes#56369
This PR updates airflow's ObjectStoragePath class to be compatible with universal-pathlib >=0.3.8. It now uses upath.extensions.ProxyUPath as a base class, to avoid using the now deprecated _protocol_dispatch = False mechanism for class API extensions.
Also pathlib.Path added .copy, .copy_into, .move, and .move_into methods in 3.14, which means the ObjectStoragePath behavior for these is now different from standard pathlib, which defaults to recursive copies for directories and returns the target path.
Cheers,

Andreas ☺️
kaxil
kaxil
reviewed
Jan 14, 2026
View reviewed changes
Comment threadtask-sdk/src/airflow/sdk/io/path.py
Outdated

@kaxil
kaxil
commented
Jan 15, 2026

Copy link


Copy Markdown

Member
cc @bolkedebruin
@potiukpotiuk
added

all versions
If set, the CI build will be forced to use all versions of Python/K8S/DBs
full tests needed
We need to run full set of tests for this PR to merge
labels
Jan 29, 2026
@potiuk
potiukforce-pushed
the
update-universal-pathlib
branch
from
779bf73 to
10dbeb3CompareJanuary 29, 2026 13:40
@potiuk
potiuk
commented
Jan 29, 2026

Copy link


Copy Markdown

Member
LGTM. Rebased and run it for all versions/full tests to see if all tests still pass.
@potiuk
potiuk
merged commit e166926
into
apache:mainJan 29, 2026

228 checks passed

@ap--
ap--
commented
Jan 29, 2026

Copy link


Copy Markdown

ContributorAuthor
Thanks @potiuk! Feel free to tag me in case errors regarding ObjectStoragePath get reported.

I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
Cheers,

Andreas
morelgeorge pushed a commit
to morelgeorge/airflow
that referenced
this pull request
Feb 1, 2026
@ap--@morelgeorge
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
1282438
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@ap--ap--
mentioned this pull request
Feb 1, 2026

Open

2 tasks
shashbha14 pushed a commit
to shashbha14/airflow
that referenced
this pull request
Feb 2, 2026
@ap--Shashwati
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
79b80d2
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
jason810496 pushed a commit
to abhijeets25012-tech/airflow
that referenced
this pull request
Feb 3, 2026
@ap--@jason810496
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
bc99e78
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@potiuk
potiuk
commented
Feb 3, 2026

Copy link


Copy Markdown

Member
I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
Only committers can be added :(
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
This should be rather easy - make an rc release and make a PR to airflow with universal-pathlib>=your_rc_release
jhgoebbert pushed a commit
to jhgoebbert/airflow_Owen-CH-Leung
that referenced
this pull request
Feb 8, 2026
@ap--@jhgoebbert
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
a6d3e3b
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
choo121600 pushed a commit
to choo121600/airflow
that referenced
this pull request
Feb 22, 2026
@ap--@choo121600
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
831316f
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@jason810496jason810496
mentioned this pull request
Mar 2, 2026
 Merged

Subham-KRLX pushed a commit
to Subham-KRLX/airflow
that referenced
this pull request
Mar 4, 2026
@ap--@Subham-KRLX
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
94bf042
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
Ankurdeewan pushed a commit
to Ankurdeewan/airflow
that referenced
this pull request
Mar 15, 2026
@ap--@Ankurdeewan
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
e44dd5e
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@vatsrahul1001vatsrahul1001
mentioned this pull request
Apr 2, 2026
 Merged

1 task
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaxilkaxilkaxil left review comments
@potiukpotiukpotiuk approved these changes
@ashbashbAwaiting requested review from ashbashb is a code owner
@amoghrajeshamoghrajeshAwaiting requested review from amoghrajeshamoghrajesh is a code owner
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin

Assignees


No one assigned


Labels

all versionsIf set, the CI build will be forced to use all versions of Python/K8S/DBsarea:task-sdkfull tests neededWe need to run full set of tests for this PR to merge

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

Rework universal-pathlib in ObjectStoragePath


3 participants

@ap--@kaxil@potiuk

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Force GitHub README to respect dark mode
(function() {
var style = document.createElement('style');
style.textContent = '
.markdown-body {
color-scheme: dark light;
}
.markdown-body pre { background: #161b22 !important; }
.markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }
.markdown-body table th, .markdown-body table td { border-color: #30363d !important; }
.markdown-body img { background: #0d1117; }
.markdown-body blockquote { border-left-color: #8b949e; }
.markdown-body hr { border-color: #30363d; }
';
document.head.appendChild(style);
})();
}
} catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Update universal-pathlib to `>=0.3.8` and use upath.extensions.ProxyUPath by ap-- · Pull Request #60519 · apache/airflow · GitHub
Skip to content
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath - #60519
Merged
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Jan 29, 2026
Merged
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath#60519
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Conversation
@ap--
@ap--ap--
commented
Jan 14, 2026•

edited

Loading

Copy link


Copy Markdown

Contributor
Closes#56369
This PR updates airflow's ObjectStoragePath class to be compatible with universal-pathlib >=0.3.8. It now uses upath.extensions.ProxyUPath as a base class, to avoid using the now deprecated _protocol_dispatch = False mechanism for class API extensions.
Also pathlib.Path added .copy, .copy_into, .move, and .move_into methods in 3.14, which means the ObjectStoragePath behavior for these is now different from standard pathlib, which defaults to recursive copies for directories and returns the target path.
Cheers,

Andreas ☺️
kaxil
kaxil
reviewed
Jan 14, 2026
View reviewed changes
Comment threadtask-sdk/src/airflow/sdk/io/path.py
Outdated

@kaxil
kaxil
commented
Jan 15, 2026

Copy link


Copy Markdown

Member
cc @bolkedebruin
@potiukpotiuk
added

all versions
If set, the CI build will be forced to use all versions of Python/K8S/DBs
full tests needed
We need to run full set of tests for this PR to merge
labels
Jan 29, 2026
@potiuk
potiukforce-pushed
the
update-universal-pathlib
branch
from
779bf73 to
10dbeb3CompareJanuary 29, 2026 13:40
@potiuk
potiuk
commented
Jan 29, 2026

Copy link


Copy Markdown

Member
LGTM. Rebased and run it for all versions/full tests to see if all tests still pass.
@potiuk
potiuk
merged commit e166926
into
apache:mainJan 29, 2026

228 checks passed

@ap--
ap--
commented
Jan 29, 2026

Copy link


Copy Markdown

ContributorAuthor
Thanks @potiuk! Feel free to tag me in case errors regarding ObjectStoragePath get reported.

I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
Cheers,

Andreas
morelgeorge pushed a commit
to morelgeorge/airflow
that referenced
this pull request
Feb 1, 2026
@ap--@morelgeorge
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
1282438
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@ap--ap--
mentioned this pull request
Feb 1, 2026

Open

2 tasks
shashbha14 pushed a commit
to shashbha14/airflow
that referenced
this pull request
Feb 2, 2026
@ap--Shashwati
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
79b80d2
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
jason810496 pushed a commit
to abhijeets25012-tech/airflow
that referenced
this pull request
Feb 3, 2026
@ap--@jason810496
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
bc99e78
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@potiuk
potiuk
commented
Feb 3, 2026

Copy link


Copy Markdown

Member
I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
Only committers can be added :(
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
This should be rather easy - make an rc release and make a PR to airflow with universal-pathlib>=your_rc_release
jhgoebbert pushed a commit
to jhgoebbert/airflow_Owen-CH-Leung
that referenced
this pull request
Feb 8, 2026
@ap--@jhgoebbert
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
a6d3e3b
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
choo121600 pushed a commit
to choo121600/airflow
that referenced
this pull request
Feb 22, 2026
@ap--@choo121600
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
831316f
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@jason810496jason810496
mentioned this pull request
Mar 2, 2026
 Merged

Subham-KRLX pushed a commit
to Subham-KRLX/airflow
that referenced
this pull request
Mar 4, 2026
@ap--@Subham-KRLX
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
94bf042
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
Ankurdeewan pushed a commit
to Ankurdeewan/airflow
that referenced
this pull request
Mar 15, 2026
@ap--@Ankurdeewan
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
e44dd5e
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@vatsrahul1001vatsrahul1001
mentioned this pull request
Apr 2, 2026
 Merged

1 task
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaxilkaxilkaxil left review comments
@potiukpotiukpotiuk approved these changes
@ashbashbAwaiting requested review from ashbashb is a code owner
@amoghrajeshamoghrajeshAwaiting requested review from amoghrajeshamoghrajesh is a code owner
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin

Assignees


No one assigned


Labels

all versionsIf set, the CI build will be forced to use all versions of Python/K8S/DBsarea:task-sdkfull tests neededWe need to run full set of tests for this PR to merge

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

Rework universal-pathlib in ObjectStoragePath


3 participants

@ap--@kaxil@potiuk

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Highlight search terms from Google/DuckDuckGo/Bing referrer
(function() {
var ref = document.referrer;
var terms = [];
if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {
var url = new URL(ref);
var q = url.searchParams.get('q') || url.searchParams.get('p');
if (q) {
terms = q.split(/\s+/).filter(function(t) { return t.length > 2; });
}
}
if (terms.length === 0) return;
var style = document.createElement('style');
style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';
document.head.appendChild(style);
function highlight(node) {
if (node.nodeType === 3) { // text node
var text = node.textContent;
var found = false;
terms.forEach(function(term) {
var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi');
if (regex.test(text)) {
found = true;
var frag = document.createDocumentFragment();
var parts = text.split(regex);
parts.forEach(function(part, i) {
if (i % 2 === 0) {
frag.appendChild(document.createTextNode(part));
} else {
var span = document.createElement('span');
span.className = 'userscript-highlight';
span.textContent = part;
frag.appendChild(span);
}
});
node.parentNode.replaceChild(frag, node);
}
});
} else if (node.nodeType === 1 && node.childNodes) { // element
var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];
if (!skipTags.includes(node.tagName)) {
Array.from(node.childNodes).forEach(highlight);
}
}
}
highlight(document.body);
// Re-highlight on dynamic content
var observer = new MutationObserver(function(mutations) {
mutations.forEach(function(m) {
m.addedNodes.forEach(function(node) {
if (node.nodeType === 1 || node.nodeType === 3) highlight(node);
});
});
});
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Update universal-pathlib to `>=0.3.8` and use upath.extensions.ProxyUPath by ap-- · Pull Request #60519 · apache/airflow · GitHub
Skip to content
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath - #60519
Merged
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Jan 29, 2026
Merged
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath#60519
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Conversation
@ap--
@ap--ap--
commented
Jan 14, 2026•

edited

Loading

Copy link


Copy Markdown

Contributor
Closes#56369
This PR updates airflow's ObjectStoragePath class to be compatible with universal-pathlib >=0.3.8. It now uses upath.extensions.ProxyUPath as a base class, to avoid using the now deprecated _protocol_dispatch = False mechanism for class API extensions.
Also pathlib.Path added .copy, .copy_into, .move, and .move_into methods in 3.14, which means the ObjectStoragePath behavior for these is now different from standard pathlib, which defaults to recursive copies for directories and returns the target path.
Cheers,

Andreas ☺️
kaxil
kaxil
reviewed
Jan 14, 2026
View reviewed changes
Comment threadtask-sdk/src/airflow/sdk/io/path.py
Outdated

@kaxil
kaxil
commented
Jan 15, 2026

Copy link


Copy Markdown

Member
cc @bolkedebruin
@potiukpotiuk
added

all versions
If set, the CI build will be forced to use all versions of Python/K8S/DBs
full tests needed
We need to run full set of tests for this PR to merge
labels
Jan 29, 2026
@potiuk
potiukforce-pushed
the
update-universal-pathlib
branch
from
779bf73 to
10dbeb3CompareJanuary 29, 2026 13:40
@potiuk
potiuk
commented
Jan 29, 2026

Copy link


Copy Markdown

Member
LGTM. Rebased and run it for all versions/full tests to see if all tests still pass.
@potiuk
potiuk
merged commit e166926
into
apache:mainJan 29, 2026

228 checks passed

@ap--
ap--
commented
Jan 29, 2026

Copy link


Copy Markdown

ContributorAuthor
Thanks @potiuk! Feel free to tag me in case errors regarding ObjectStoragePath get reported.

I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
Cheers,

Andreas
morelgeorge pushed a commit
to morelgeorge/airflow
that referenced
this pull request
Feb 1, 2026
@ap--@morelgeorge
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
1282438
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@ap--ap--
mentioned this pull request
Feb 1, 2026

Open

2 tasks
shashbha14 pushed a commit
to shashbha14/airflow
that referenced
this pull request
Feb 2, 2026
@ap--Shashwati
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
79b80d2
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
jason810496 pushed a commit
to abhijeets25012-tech/airflow
that referenced
this pull request
Feb 3, 2026
@ap--@jason810496
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
bc99e78
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@potiuk
potiuk
commented
Feb 3, 2026

Copy link


Copy Markdown

Member
I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
Only committers can be added :(
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
This should be rather easy - make an rc release and make a PR to airflow with universal-pathlib>=your_rc_release
jhgoebbert pushed a commit
to jhgoebbert/airflow_Owen-CH-Leung
that referenced
this pull request
Feb 8, 2026
@ap--@jhgoebbert
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
a6d3e3b
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
choo121600 pushed a commit
to choo121600/airflow
that referenced
this pull request
Feb 22, 2026
@ap--@choo121600
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
831316f
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@jason810496jason810496
mentioned this pull request
Mar 2, 2026
 Merged

Subham-KRLX pushed a commit
to Subham-KRLX/airflow
that referenced
this pull request
Mar 4, 2026
@ap--@Subham-KRLX
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
94bf042
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
Ankurdeewan pushed a commit
to Ankurdeewan/airflow
that referenced
this pull request
Mar 15, 2026
@ap--@Ankurdeewan
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
e44dd5e
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@vatsrahul1001vatsrahul1001
mentioned this pull request
Apr 2, 2026
 Merged

1 task
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaxilkaxilkaxil left review comments
@potiukpotiukpotiuk approved these changes
@ashbashbAwaiting requested review from ashbashb is a code owner
@amoghrajeshamoghrajeshAwaiting requested review from amoghrajeshamoghrajesh is a code owner
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin

Assignees


No one assigned


Labels

all versionsIf set, the CI build will be forced to use all versions of Python/K8S/DBsarea:task-sdkfull tests neededWe need to run full set of tests for this PR to merge

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

Rework universal-pathlib in ObjectStoragePath


3 participants

@ap--@kaxil@potiuk

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Strip utm_, fbclid, gclid, etc. from all links on page
(function() {
var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',
'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',
'ref', 'ref_src', 'source', 'medium', 'campaign'];
function cleanUrl(url) {
try {
var u = new URL(url, window.location.origin);
var changed = false;
trackingParams.forEach(function(p) {
if (u.searchParams.has(p)) {
u.searchParams.delete(p);
changed = true;
}
});
return changed ? u.toString() : url;
} catch (e) {
return url;
}
}
function cleanLinks() {
document.querySelectorAll('a[href]').forEach(function(a) {
var clean = cleanUrl(a.href);
if (clean !== a.href) a.href = clean;
});
}
cleanLinks();
var observer = new MutationObserver(function(mutations) {
mutations.forEach(function(m) {
m.addedNodes.forEach(function(node) {
if (node.nodeType === 1) {
if (node.tagName === 'A') cleanLinks();
node.querySelectorAll('a[href]').forEach(function(a) {
var clean = cleanUrl(a.href);
if (clean !== a.href) a.href = clean;
});
}
});
});
});
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); }
})();
(function(){
try {
var __m = "youtube.com";
var __re = new RegExp('^' + "youtube\\.com" + '
Update universal-pathlib to `>=0.3.8` and use upath.extensions.ProxyUPath by ap-- · Pull Request #60519 · apache/airflow · GitHub
Skip to content
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath - #60519
Merged
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Jan 29, 2026
Merged
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath#60519
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Conversation
@ap--
@ap--ap--
commented
Jan 14, 2026•

edited

Loading

Copy link


Copy Markdown

Contributor
Closes#56369
This PR updates airflow's ObjectStoragePath class to be compatible with universal-pathlib >=0.3.8. It now uses upath.extensions.ProxyUPath as a base class, to avoid using the now deprecated _protocol_dispatch = False mechanism for class API extensions.
Also pathlib.Path added .copy, .copy_into, .move, and .move_into methods in 3.14, which means the ObjectStoragePath behavior for these is now different from standard pathlib, which defaults to recursive copies for directories and returns the target path.
Cheers,

Andreas ☺️
kaxil
kaxil
reviewed
Jan 14, 2026
View reviewed changes
Comment threadtask-sdk/src/airflow/sdk/io/path.py
Outdated

@kaxil
kaxil
commented
Jan 15, 2026

Copy link


Copy Markdown

Member
cc @bolkedebruin
@potiukpotiuk
added

all versions
If set, the CI build will be forced to use all versions of Python/K8S/DBs
full tests needed
We need to run full set of tests for this PR to merge
labels
Jan 29, 2026
@potiuk
potiukforce-pushed
the
update-universal-pathlib
branch
from
779bf73 to
10dbeb3CompareJanuary 29, 2026 13:40
@potiuk
potiuk
commented
Jan 29, 2026

Copy link


Copy Markdown

Member
LGTM. Rebased and run it for all versions/full tests to see if all tests still pass.
@potiuk
potiuk
merged commit e166926
into
apache:mainJan 29, 2026

228 checks passed

@ap--
ap--
commented
Jan 29, 2026

Copy link


Copy Markdown

ContributorAuthor
Thanks @potiuk! Feel free to tag me in case errors regarding ObjectStoragePath get reported.

I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
Cheers,

Andreas
morelgeorge pushed a commit
to morelgeorge/airflow
that referenced
this pull request
Feb 1, 2026
@ap--@morelgeorge
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
1282438
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@ap--ap--
mentioned this pull request
Feb 1, 2026

Open

2 tasks
shashbha14 pushed a commit
to shashbha14/airflow
that referenced
this pull request
Feb 2, 2026
@ap--Shashwati
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
79b80d2
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
jason810496 pushed a commit
to abhijeets25012-tech/airflow
that referenced
this pull request
Feb 3, 2026
@ap--@jason810496
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
bc99e78
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@potiuk
potiuk
commented
Feb 3, 2026

Copy link


Copy Markdown

Member
I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
Only committers can be added :(
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
This should be rather easy - make an rc release and make a PR to airflow with universal-pathlib>=your_rc_release
jhgoebbert pushed a commit
to jhgoebbert/airflow_Owen-CH-Leung
that referenced
this pull request
Feb 8, 2026
@ap--@jhgoebbert
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
a6d3e3b
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
choo121600 pushed a commit
to choo121600/airflow
that referenced
this pull request
Feb 22, 2026
@ap--@choo121600
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
831316f
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@jason810496jason810496
mentioned this pull request
Mar 2, 2026
 Merged

Subham-KRLX pushed a commit
to Subham-KRLX/airflow
that referenced
this pull request
Mar 4, 2026
@ap--@Subham-KRLX
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
94bf042
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
Ankurdeewan pushed a commit
to Ankurdeewan/airflow
that referenced
this pull request
Mar 15, 2026
@ap--@Ankurdeewan
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
e44dd5e
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@vatsrahul1001vatsrahul1001
mentioned this pull request
Apr 2, 2026
 Merged

1 task
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaxilkaxilkaxil left review comments
@potiukpotiukpotiuk approved these changes
@ashbashbAwaiting requested review from ashbashb is a code owner
@amoghrajeshamoghrajeshAwaiting requested review from amoghrajeshamoghrajesh is a code owner
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin

Assignees


No one assigned


Labels

all versionsIf set, the CI build will be forced to use all versions of Python/K8S/DBsarea:task-sdkfull tests neededWe need to run full set of tests for this PR to merge

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

Rework universal-pathlib in ObjectStoragePath


3 participants

@ap--@kaxil@potiuk

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Auto-enable theater mode on YouTube
(function() {
function tryTheater() {
var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]');
if (btn && !btn.classList.contains('activated')) {
btn.click();
}
}
// Try immediately
tryTheater();
// Try after navigation (SPA)
var lastUrl = location.href;
setInterval(function() {
if (location.href !== lastUrl) {
lastUrl = location.href;
setTimeout(tryTheater, 500);
}
}, 1000);
// Also try on player load
var observer = new MutationObserver(tryTheater);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Update universal-pathlib to `>=0.3.8` and use upath.extensions.ProxyUPath by ap-- · Pull Request #60519 · apache/airflow · GitHub
Skip to content
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath - #60519
Merged
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Jan 29, 2026
Merged
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath#60519
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Conversation
@ap--
@ap--ap--
commented
Jan 14, 2026•

edited

Loading

Copy link


Copy Markdown

Contributor
Closes#56369
This PR updates airflow's ObjectStoragePath class to be compatible with universal-pathlib >=0.3.8. It now uses upath.extensions.ProxyUPath as a base class, to avoid using the now deprecated _protocol_dispatch = False mechanism for class API extensions.
Also pathlib.Path added .copy, .copy_into, .move, and .move_into methods in 3.14, which means the ObjectStoragePath behavior for these is now different from standard pathlib, which defaults to recursive copies for directories and returns the target path.
Cheers,

Andreas ☺️
kaxil
kaxil
reviewed
Jan 14, 2026
View reviewed changes
Comment threadtask-sdk/src/airflow/sdk/io/path.py
Outdated

@kaxil
kaxil
commented
Jan 15, 2026

Copy link


Copy Markdown

Member
cc @bolkedebruin
@potiukpotiuk
added

all versions
If set, the CI build will be forced to use all versions of Python/K8S/DBs
full tests needed
We need to run full set of tests for this PR to merge
labels
Jan 29, 2026
@potiuk
potiukforce-pushed
the
update-universal-pathlib
branch
from
779bf73 to
10dbeb3CompareJanuary 29, 2026 13:40
@potiuk
potiuk
commented
Jan 29, 2026

Copy link


Copy Markdown

Member
LGTM. Rebased and run it for all versions/full tests to see if all tests still pass.
@potiuk
potiuk
merged commit e166926
into
apache:mainJan 29, 2026

228 checks passed

@ap--
ap--
commented
Jan 29, 2026

Copy link


Copy Markdown

ContributorAuthor
Thanks @potiuk! Feel free to tag me in case errors regarding ObjectStoragePath get reported.

I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
Cheers,

Andreas
morelgeorge pushed a commit
to morelgeorge/airflow
that referenced
this pull request
Feb 1, 2026
@ap--@morelgeorge
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
1282438
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@ap--ap--
mentioned this pull request
Feb 1, 2026

Open

2 tasks
shashbha14 pushed a commit
to shashbha14/airflow
that referenced
this pull request
Feb 2, 2026
@ap--Shashwati
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
79b80d2
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
jason810496 pushed a commit
to abhijeets25012-tech/airflow
that referenced
this pull request
Feb 3, 2026
@ap--@jason810496
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
bc99e78
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@potiuk
potiuk
commented
Feb 3, 2026

Copy link


Copy Markdown

Member
I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
Only committers can be added :(
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
This should be rather easy - make an rc release and make a PR to airflow with universal-pathlib>=your_rc_release
jhgoebbert pushed a commit
to jhgoebbert/airflow_Owen-CH-Leung
that referenced
this pull request
Feb 8, 2026
@ap--@jhgoebbert
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
a6d3e3b
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
choo121600 pushed a commit
to choo121600/airflow
that referenced
this pull request
Feb 22, 2026
@ap--@choo121600
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
831316f
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@jason810496jason810496
mentioned this pull request
Mar 2, 2026
 Merged

Subham-KRLX pushed a commit
to Subham-KRLX/airflow
that referenced
this pull request
Mar 4, 2026
@ap--@Subham-KRLX
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
94bf042
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
Ankurdeewan pushed a commit
to Ankurdeewan/airflow
that referenced
this pull request
Mar 15, 2026
@ap--@Ankurdeewan
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
e44dd5e
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@vatsrahul1001vatsrahul1001
mentioned this pull request
Apr 2, 2026
 Merged

1 task
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaxilkaxilkaxil left review comments
@potiukpotiukpotiuk approved these changes
@ashbashbAwaiting requested review from ashbashb is a code owner
@amoghrajeshamoghrajeshAwaiting requested review from amoghrajeshamoghrajesh is a code owner
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin

Assignees


No one assigned


Labels

all versionsIf set, the CI build will be forced to use all versions of Python/K8S/DBsarea:task-sdkfull tests neededWe need to run full set of tests for this PR to merge

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

Rework universal-pathlib in ObjectStoragePath


3 participants

@ap--@kaxil@potiuk

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Remove or un-stick sticky/fixed headers that block content
(function() {
function unstick() {
document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) {
if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {
el.style.position = 'static';
el.style.top = 'auto';
el.style.zIndex = 'auto';
}
});
}
unstick();
var observer = new MutationObserver(unstick);
observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });
})();
}
} catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Update universal-pathlib to `>=0.3.8` and use upath.extensions.ProxyUPath by ap-- · Pull Request #60519 · apache/airflow · GitHub
Skip to content
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath - #60519
Merged
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Jan 29, 2026
Merged
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath#60519
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Conversation
@ap--
@ap--ap--
commented
Jan 14, 2026•

edited

Loading

Copy link


Copy Markdown

Contributor
Closes#56369
This PR updates airflow's ObjectStoragePath class to be compatible with universal-pathlib >=0.3.8. It now uses upath.extensions.ProxyUPath as a base class, to avoid using the now deprecated _protocol_dispatch = False mechanism for class API extensions.
Also pathlib.Path added .copy, .copy_into, .move, and .move_into methods in 3.14, which means the ObjectStoragePath behavior for these is now different from standard pathlib, which defaults to recursive copies for directories and returns the target path.
Cheers,

Andreas ☺️
kaxil
kaxil
reviewed
Jan 14, 2026
View reviewed changes
Comment threadtask-sdk/src/airflow/sdk/io/path.py
Outdated

@kaxil
kaxil
commented
Jan 15, 2026

Copy link


Copy Markdown

Member
cc @bolkedebruin
@potiukpotiuk
added

all versions
If set, the CI build will be forced to use all versions of Python/K8S/DBs
full tests needed
We need to run full set of tests for this PR to merge
labels
Jan 29, 2026
@potiuk
potiukforce-pushed
the
update-universal-pathlib
branch
from
779bf73 to
10dbeb3CompareJanuary 29, 2026 13:40
@potiuk
potiuk
commented
Jan 29, 2026

Copy link


Copy Markdown

Member
LGTM. Rebased and run it for all versions/full tests to see if all tests still pass.
@potiuk
potiuk
merged commit e166926
into
apache:mainJan 29, 2026

228 checks passed

@ap--
ap--
commented
Jan 29, 2026

Copy link


Copy Markdown

ContributorAuthor
Thanks @potiuk! Feel free to tag me in case errors regarding ObjectStoragePath get reported.

I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
Cheers,

Andreas
morelgeorge pushed a commit
to morelgeorge/airflow
that referenced
this pull request
Feb 1, 2026
@ap--@morelgeorge
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
1282438
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@ap--ap--
mentioned this pull request
Feb 1, 2026

Open

2 tasks
shashbha14 pushed a commit
to shashbha14/airflow
that referenced
this pull request
Feb 2, 2026
@ap--Shashwati
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
79b80d2
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
jason810496 pushed a commit
to abhijeets25012-tech/airflow
that referenced
this pull request
Feb 3, 2026
@ap--@jason810496
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
bc99e78
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@potiuk
potiuk
commented
Feb 3, 2026

Copy link


Copy Markdown

Member
I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
Only committers can be added :(
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
This should be rather easy - make an rc release and make a PR to airflow with universal-pathlib>=your_rc_release
jhgoebbert pushed a commit
to jhgoebbert/airflow_Owen-CH-Leung
that referenced
this pull request
Feb 8, 2026
@ap--@jhgoebbert
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
a6d3e3b
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
choo121600 pushed a commit
to choo121600/airflow
that referenced
this pull request
Feb 22, 2026
@ap--@choo121600
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
831316f
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@jason810496jason810496
mentioned this pull request
Mar 2, 2026
 Merged

Subham-KRLX pushed a commit
to Subham-KRLX/airflow
that referenced
this pull request
Mar 4, 2026
@ap--@Subham-KRLX
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
94bf042
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
Ankurdeewan pushed a commit
to Ankurdeewan/airflow
that referenced
this pull request
Mar 15, 2026
@ap--@Ankurdeewan
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
e44dd5e
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@vatsrahul1001vatsrahul1001
mentioned this pull request
Apr 2, 2026
 Merged

1 task
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaxilkaxilkaxil left review comments
@potiukpotiukpotiuk approved these changes
@ashbashbAwaiting requested review from ashbashb is a code owner
@amoghrajeshamoghrajeshAwaiting requested review from amoghrajeshamoghrajesh is a code owner
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin

Assignees


No one assigned


Labels

all versionsIf set, the CI build will be forced to use all versions of Python/K8S/DBsarea:task-sdkfull tests neededWe need to run full set of tests for this PR to merge

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

Rework universal-pathlib in ObjectStoragePath


3 participants

@ap--@kaxil@potiuk

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Universal Dark Mode - works on any site
(function() {
var enabled = true;
function applyDarkMode() {
if (!enabled) return;
// Create style element if it doesn't exist
var style = document.getElementById('universal-dark-mode-style');
if (!style) {
style = document.createElement('style');
style.id = 'universal-dark-mode-style';
document.head.appendChild(style);
}
// Dark mode CSS - inverts colors but preserves images/video
style.textContent = '
/* Invert everything except media */
html {
filter: invert(1) hue-rotate(180deg) !important;
background: #1a1a2e !important;
}
/* Restore images, videos, iframes, canvas */
img, video, iframe, canvas, svg, picture, [style*="background-image"] {
filter: invert(1) hue-rotate(180deg) !important;
}
/* Preserve specific elements that should not be inverted */
.no-dark-mode, .no-dark-mode *,
[data-theme="light"], [data-theme="light"],
.ace_editor, .ace_editor *,
.CodeMirror, .CodeMirror *,
.monaco-editor, .monaco-editor *,
.markdown-body pre, .markdown-body pre *,
.highlight, .highlight *,
pre code, pre code * {
filter: none !important;
}
/* Fix common UI elements */
.modal, .popup, .dropdown-menu, .tooltip, .popover {
filter: invert(1) hue-rotate(180deg) !important;
background: #2d2d44 !important;
border-color: #444 !important;
}
/* Scrollbars */
::-webkit-scrollbar { background: #1a1a2e !important; }
::-webkit-scrollbar-thumb { background: #444 !important; }
::-webkit-scrollbar-thumb:hover { background: #555 !important; }
/* Selection */
::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }
::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }
';
}
function removeDarkMode() {
var style = document.getElementById('universal-dark-mode-style');
if (style) style.remove();
}
// Toggle with Alt+Shift+D
document.addEventListener('keydown', function(e) {
if (e.altKey && e.shiftKey && e.key === 'D') {
e.preventDefault();
enabled = !enabled;
if (enabled) {
applyDarkMode();
console.log('[Universal Dark Mode] Enabled');
} else {
removeDarkMode();
console.log('[Universal Dark Mode] Disabled');
}
}
});
// Apply on load
applyDarkMode();
// Re-apply on dynamic content
var observer = new MutationObserver(function(mutations) {
if (enabled && !document.getElementById('universal-dark-mode-style')) {
applyDarkMode();
}
});
observer.observe(document.head, { childList: true });
console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');
})();
}
} catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); }
})();
})();
Update universal-pathlib to `>=0.3.8` and use upath.extensions.ProxyUPath by ap-- · Pull Request #60519 · apache/airflow · GitHub
Skip to content
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath - #60519
Merged
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Jan 29, 2026
Merged
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyUPath#60519
potiuk merged 9 commits into
apache:mainfrom 
ap--:update-universal-pathlib
Conversation
@ap--
@ap--ap--
commented
Jan 14, 2026•

edited

Loading

Copy link


Copy Markdown

Contributor
Closes#56369
This PR updates airflow's ObjectStoragePath class to be compatible with universal-pathlib >=0.3.8. It now uses upath.extensions.ProxyUPath as a base class, to avoid using the now deprecated _protocol_dispatch = False mechanism for class API extensions.
Also pathlib.Path added .copy, .copy_into, .move, and .move_into methods in 3.14, which means the ObjectStoragePath behavior for these is now different from standard pathlib, which defaults to recursive copies for directories and returns the target path.
Cheers,

Andreas ☺️
kaxil
kaxil
reviewed
Jan 14, 2026
View reviewed changes
Comment threadtask-sdk/src/airflow/sdk/io/path.py
Outdated

@kaxil
kaxil
commented
Jan 15, 2026

Copy link


Copy Markdown

Member
cc @bolkedebruin
@potiukpotiuk
added

all versions
If set, the CI build will be forced to use all versions of Python/K8S/DBs
full tests needed
We need to run full set of tests for this PR to merge
labels
Jan 29, 2026
@potiuk
potiukforce-pushed
the
update-universal-pathlib
branch
from
779bf73 to
10dbeb3CompareJanuary 29, 2026 13:40
@potiuk
potiuk
commented
Jan 29, 2026

Copy link


Copy Markdown

Member
LGTM. Rebased and run it for all versions/full tests to see if all tests still pass.
@potiuk
potiuk
merged commit e166926
into
apache:mainJan 29, 2026

228 checks passed

@ap--
ap--
commented
Jan 29, 2026

Copy link


Copy Markdown

ContributorAuthor
Thanks @potiuk! Feel free to tag me in case errors regarding ObjectStoragePath get reported.

I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
Cheers,

Andreas
morelgeorge pushed a commit
to morelgeorge/airflow
that referenced
this pull request
Feb 1, 2026
@ap--@morelgeorge
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
1282438
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@ap--ap--
mentioned this pull request
Feb 1, 2026

Open

2 tasks
shashbha14 pushed a commit
to shashbha14/airflow
that referenced
this pull request
Feb 2, 2026
@ap--Shashwati
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
79b80d2
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
jason810496 pushed a commit
to abhijeets25012-tech/airflow
that referenced
this pull request
Feb 3, 2026
@ap--@jason810496
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
bc99e78
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@potiuk
potiuk
commented
Feb 3, 2026

Copy link


Copy Markdown

Member
I'd be happy to be added to the code owners file if that would enable automated tagging in issues as well.
Only committers can be added :(
And I'm still interested in finding a way of running the airflow test suite with a new universal-pathlib version before I make a new release.

Let me know if you have any suggestions.
This should be rather easy - make an rc release and make a PR to airflow with universal-pathlib>=your_rc_release
jhgoebbert pushed a commit
to jhgoebbert/airflow_Owen-CH-Leung
that referenced
this pull request
Feb 8, 2026
@ap--@jhgoebbert
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
a6d3e3b
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
choo121600 pushed a commit
to choo121600/airflow
that referenced
this pull request
Feb 22, 2026
@ap--@choo121600
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
831316f
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@jason810496jason810496
mentioned this pull request
Mar 2, 2026
 Merged

Subham-KRLX pushed a commit
to Subham-KRLX/airflow
that referenced
this pull request
Mar 4, 2026
@ap--@Subham-KRLX
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
94bf042
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
Ankurdeewan pushed a commit
to Ankurdeewan/airflow
that referenced
this pull request
Mar 15, 2026
@ap--@Ankurdeewan
Update universal-pathlib to >=0.3.8 and use upath.extensions.ProxyU…
e44dd5e
…Path (apache#60519)
* pyproject.toml: update universal-pathlib version boundaries
* task_sdk.io.path: fix test regarding relative_to
* tests: adjust the lazy_load test to reflect caching is done via STORE_CACHE
* tests: update tests to register fake remote filesystem in fsspec
* airflow.sdk.io.path: implement ObjectStoragePath via ProxyUPath
* airflow.sdk.io.path: provide a basic implementation for copy_into and move_into
* airflow.sdk.io.path: fix __str__ method
* airflow.sdk.io.path: docstring fixes
* update spelling_wordlist.txt
@vatsrahul1001vatsrahul1001
mentioned this pull request
Apr 2, 2026
 Merged

1 task
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaxilkaxilkaxil left review comments
@potiukpotiukpotiuk approved these changes
@ashbashbAwaiting requested review from ashbashb is a code owner
@amoghrajeshamoghrajeshAwaiting requested review from amoghrajeshamoghrajesh is a code owner
@bolkedebruinbolkedebruinAwaiting requested review from bolkedebruin

Assignees


No one assigned


Labels

all versionsIf set, the CI build will be forced to use all versions of Python/K8S/DBsarea:task-sdkfull tests neededWe need to run full set of tests for this PR to merge

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

Rework universal-pathlib in ObjectStoragePath


3 participants

@ap--@kaxil@potiuk