Skip to content

fix: Classify and retry failures while reading a streamed error body - #1020

Merged
vdusek merged 3 commits into
masterfrom
fix-streamed-error-body-read
Aug 18, 2026
Merged

fix: Classify and retry failures while reading a streamed error body#1020
vdusek merged 3 commits into
masterfrom
fix-streamed-error-body-read

Conversation

@vdusek

Copy link
Copy Markdown
Contributor

Before raising ApifyApiError, _make_request buffers the response so a streamed error body reaches the exception. That read sat outside the try block that classifies an attempt, so a failure there escaped the retry policy entirely: a non-retryable failure was retried through the whole backoff, and the response was left open.

The read now goes through the same classification as a failed send — retried when it is a transient transport failure, surfaced immediately when it is not — and the response is closed before the exception propagates.

Split out of #1006 and re-targeted at master, so the retry fixes can ship in a patch release ahead of the pipeline refactor in #1011.

✍️ Drafted by Claude Code

@vdusekvdusek added adhoc Ad-hoc unplanned task added during the sprint. t-tooling Issues with this label are in the ownership of the tooling team. labels Aug 18, 2026
@vdusekvdusek self-assigned this Aug 18, 2026
@github-actionsgithub-actionsBot added the tested Temporary label used only programatically for some analytics. label Aug 18, 2026
@codecov

codecovBot commented Aug 18, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 94.87%. Comparing base (334e131) to head (a810910).
⚠️ Report is 3 commits behind head on master.

Additional details and impacted files
@@ Coverage Diff @@## master #1020 +/- ##
==========================================
- Coverage 94.87% 94.87% -0.01% 
==========================================
Files 58 58 Lines 5367 5384 +17 ==========================================
+ Hits 5092 5108 +16 - Misses 275 276 +1 
FlagCoverage Δ
integration91.66% <81.81%> (-0.56%)⬇️
unit85.19% <100.00%> (+0.04%)⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@vdusek
vdusek marked this pull request as ready for review August 18, 2026 13:48
@vdusek
vdusek requested a review from PijukatelAugust 18, 2026 13:48
Comment threadsrc/apify_client/http_clients/_impit.py Outdated
@vdusek
vdusek merged commit 2760aa6 into masterAug 18, 2026
30 checks passed
@vdusek
vdusek deleted the fix-streamed-error-body-read branch August 18, 2026 16:32
vdusek added a commit that referenced this pull request Aug 19, 2026
Moves `call`, the retry loop, and the per-attempt request handling from
`ImpitHttpClient` and `ImpitHttpClientAsync` into `HttpClient` and
`HttpClientAsync`, leaving Impit as a thin adapter over the transport
hooks: `send_request`, `is_retryable_transport_error`,
`is_timeout_error`, and `close()` / `aclose()` plus context managers. A
custom client that overrides `call` keeps working unchanged and opts out
of the shared pipeline. `StreamedLog` classifies timeouts through the
transport-neutral `is_timeout_error` hook instead of importing Impit.
No behavior change for the built-in clients: the retry policy shipped in
#1019 (permanent transport errors fail fast) and #1020 (a failed read of
a streamed error body is classified like a failed send and the response
is closed) is preserved — the classification now lives in the
`is_retryable_transport_error` hook, and the error-body read handling in
the shared pipeline.
Supersedes #1011, rebased onto current master and squashed. Originally
split out of #1006.
*✍️ Drafted by Claude Code*
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

adhocAd-hoc unplanned task added during the sprint.t-toolingIssues with this label are in the ownership of the tooling team.testedTemporary label used only programatically for some analytics.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@vdusek@Pijukatel@apify-service-account