Uh oh!
There was an error while loading. Please reload this page.
Support startFrom on List Blobs - #2688
Conversation
There was a problem hiding this comment.
Pull request overview
Adds support for the startFrom query parameter (introduced in Blob service version 2026-02-06) to container blob listing so clients can begin listings at an arbitrary blob name (inclusive), composing correctly with marker (exclusive).
Changes:
- Accepts API version
2026-02-06and plumbsstartFromfrom the raw request query into list-blobs handlers. - Implements
startFromfiltering in both Loki and SQL blob metadata stores, composing with existingmarkerandprefixfiltering. - Adds a test that exercises
startFromfor flat listings by rewriting the request query on the wire.
Reviewed changes
Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.
Show a summary per file
| File | Description |
|---|---|
| tests/blob/apis/container.test.ts | Adds a new integration test for startFrom with listBlobsFlat via query rewriting. |
| src/blob/utils/constants.ts | Adds 2026-02-06 to the accepted Blob service API versions. |
| src/blob/persistence/SqlBlobMetadataStore.ts | Adds inclusive startFrom filtering using Op.gte, composing with marker and prefix. |
| src/blob/persistence/LokiBlobMetadataStore.ts | Adds inclusive startFrom filtering in the Loki query chain, composing with marker. |
| src/blob/persistence/IBlobMetadataStore.ts | Extends listBlobs interface to include an optional startFrom parameter. |
| src/blob/handlers/ContainerHandler.ts | Passes startFrom from the request query into both flat and hierarchical list-blobs flows. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
d915511 to
f12ab95CompareCopilot, please update changelist file and readme with supported feature list |
Andrew Gaul (@gaul), could you please update changelist and readme accordingly for all of your PRs. |
f12ab95 to
9f1ce86CompareUh oh!
There was an error while loading. Please reload this page.
9f1ce86 to
6020162CompareService version 2026-02-06 adds a startFrom query parameter to List Blobs, which begins a listing at a given blob name. Azurite accepts that version but ignored the parameter, so a client asking to start partway through was handed the container from the beginning. Unlike marker, which is a name Azurite has already returned and which it treats as exclusive, startFrom names any blob and includes it. The two compose rather than conflict: paging a listing that began at startFrom carries a marker past it, so both filters can apply and neither has to exclude the other. Both metadata stores learn the parameter, and the handlers read it off the request rather than the generated operation parameters, since the swagger this repository generates from predates it. The tests drive the parameter by rewriting the query of a SAS-authenticated request, the same way the include= tests do, because the JavaScript SDK this repository depends on has no startFrom yet. A blob name is arbitrary text, so the value is encoded as a client would have to encode it, and one of the names carries an ampersand: unencoded it would end the parameter early and leave a startFrom that admits a blob too many. The hierarchical listing takes the parameter too, so it is covered as well. A delimiter squashes blobs into prefixes after startFrom has selected them, so a prefix survives exactly while one of its blobs does.
6020162 to
a1396f7CompareAndrew Gaul (gaul)
commented
Aug 21, 2026
Done. This is the more meaningful PR for S3Proxy users if you can prioritize it over the other two for the 3.37.0 release. |
6f975ba
into
Azure:mainUh oh!
There was an error while loading. Please reload this page.
Service version 2026-02-06 adds a startFrom query parameter to List
Blobs, which begins a listing at a given blob name. Azurite accepts that
version but ignored the parameter, so a client asking to start partway
through was handed the container from the beginning.
Unlike marker, which is a name Azurite has already returned and which it
treats as exclusive, startFrom names any blob and includes it. The two
compose rather than conflict: paging a listing that began at startFrom
carries a marker past it, so both filters can apply and neither has to
exclude the other.
Both metadata stores learn the parameter, and the handlers read it off
the request rather than the generated operation parameters, since the
swagger this repository generates from predates it.
The tests drive the parameter by rewriting the query of a
SAS-authenticated request, the same way the include= tests do, because
the JavaScript SDK this repository depends on has no startFrom yet. A
blob name is arbitrary text, so the value is encoded as a client would
have to encode it, and one of the names carries an ampersand: unencoded
it would end the parameter early and leave a startFrom that admits a blob
too many.
The hierarchical listing takes the parameter too, so it is covered as
well. A delimiter squashes blobs into prefixes after startFrom has
selected them, so a prefix survives exactly while one of its blobs does.