Skip to content

branch-4.0: [feat](storage) introduce backpressure algorithm to control version number (part I) #57133 - #57416

Merged
yiguolei merged 1 commit into
branch-4.0from
auto-pick-57133-branch-4.0
Nov 24, 2025
Merged

branch-4.0: [feat](storage) introduce backpressure algorithm to control version number (part I) #57133#57416
yiguolei merged 1 commit into
branch-4.0from
auto-pick-57133-branch-4.0

Conversation

@github-actions

@github-actionsgithub-actionsBot commented Oct 28, 2025

Copy link
Copy Markdown
Contributor

Cherry-picked from #57133

@sollhuiYour Name
[feat](storage) introduce backpressure algorithm to control version n…
30fe644
…umber (part I) (#57133)
### What problem does this PR solve?
#### background
`-235` error (too_many_version) may happened when high concurrent load
and compaction cannot keep up, this will cause load fail until version
number reduce to below max_tablet_version_num.
#### solution
This PR implements a backpressure algorithm to control version number by
slow down load speed when version number exceed the threshold.
@Thearas

Thearas commented Oct 28, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@Thearas

Thearas commented Oct 28, 2025

Copy link
Copy Markdown
Contributor

run buildall

1 similar comment
@sollhui

sollhui commented Nov 21, 2025

Copy link
Copy Markdown
Contributor

run buildall

@hello-stephen

hello-stephen commented Nov 21, 2025

Copy link
Copy Markdown
Contributor

BE UT Coverage Report

Increment line coverage 0.00% (0/56) 🎉

Increment coverage report
Complete coverage report

CategoryCoverage
Function Coverage52.80% (18164/34401)
Line Coverage38.15% (165439/433652)
Region Coverage33.15% (128461/387471)
Branch Coverage33.97% (55413/163138)

@yiguolei
yiguolei merged commit 58f1710 into branch-4.0Nov 24, 2025
24 of 27 checks passed
@github-actions
github-actionsBot deleted the auto-pick-57133-branch-4.0 branch November 24, 2025 04:45
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@yiguoleiyiguoleiyiguolei approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@Thearas@sollhui@hello-stephen@yiguolei@dataroaring