Skip to content

passing missing parameters to ZarrStore.open_store when opening a datatree - #9377

Merged
keewis merged 5 commits into
pydata:mainfrom
aladinor:open-store
Aug 20, 2024
Merged

passing missing parameters to ZarrStore.open_store when opening a datatree#9377
keewis merged 5 commits into
pydata:mainfrom
aladinor:open-store

Conversation

@aladinor

@aladinoraladinor commented Aug 17, 2024

Copy link
Copy Markdown
Contributor

@TomNicholas

Copy link
Copy Markdown
Member

Nice catch. Does this make opening the store as fast as you would expect?

@aladinor

Copy link
Copy Markdown
ContributorAuthor

Yeap. In the example provided here it went from 2 mins to 5 secs

@TomNicholasTomNicholas added topic-DataTree Related to the implementation of a DataTree class topic-zarr Related to zarr storage library topic-backends topic-performance labels Aug 19, 2024
Comment threaddoc/whats-new.rst Outdated
@keewis
keewis enabled auto-merge (squash) August 20, 2024 15:41
@keewis
keewis merged commit 40291ad into pydata:mainAug 20, 2024
dcherian added a commit to TomNicholas/xarray that referenced this pull request Aug 22, 2024
* main: (214 commits)
Adds copy parameter to __array__ for numpy 2.0 (pydata#9393)
`numpy 2` compatibility in the `pydap` backend (pydata#9391)
pyarrow dependency added to doc environment (pydata#9394)
Extend padding functionalities (pydata#9353)
refactor GroupBy internals (pydata#9389)
Combine `UnsignedIntegerCoder` and `CFMaskCoder` (pydata#9274)
passing missing parameters to ZarrStore.open_store when opening a datatree (pydata#9377)
Fix tests on big-endian systems (pydata#9380)
Improve error message on `ds['x', 'y']` (pydata#9375)
Improve error message for missing coordinate index (pydata#9370)
Add flaky to TestNetCDF4ViaDaskData (pydata#9373)
Make chunk manager an option in `set_options` (pydata#9362)
Revise (pydata#9371)
Remove duplicate word from docs (pydata#9367)
Adding open_groups to BackendEntryPointEngine, NetCDF4BackendEntrypoint, and H5netcdfBackendEntrypoint (pydata#9243)
Revise (pydata#9366)
Fix rechunking to a frequency with empty bins. (pydata#9364)
whats-new entry for dropping python 3.9 (pydata#9359)
drop support for `python=3.9` (pydata#8937)
Revise (pydata#9357)
...
dcherian added a commit to dcherian/xarray that referenced this pull request Aug 30, 2024
* main:
Adds copy parameter to __array__ for numpy 2.0 (pydata#9393)
`numpy 2` compatibility in the `pydap` backend (pydata#9391)
pyarrow dependency added to doc environment (pydata#9394)
Extend padding functionalities (pydata#9353)
refactor GroupBy internals (pydata#9389)
Combine `UnsignedIntegerCoder` and `CFMaskCoder` (pydata#9274)
passing missing parameters to ZarrStore.open_store when opening a datatree (pydata#9377)
Fix tests on big-endian systems (pydata#9380)
Improve error message on `ds['x', 'y']` (pydata#9375)
@aladinor
aladinor deleted the open-store branch October 12, 2024 16:54
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

topic-backendstopic-DataTreeRelated to the implementation of a DataTree classtopic-performancetopic-zarrRelated to zarr storage library

Projects

None yet

Development

Successfully merging this pull request may close these issues.

xarray.open_datatree is taking too long to open datatree in a s3 bucket

3 participants

@aladinor@TomNicholas@keewis