Uh oh!
There was an error while loading. Please reload this page.
[opt](cloud) Prioritize scheduling the most recently active tablets in cloud - #59539
Conversation
hello-stephen
commented
Jan 4, 2026
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
ac383bb to
a71331bComparedeardeng
commented
Jan 8, 2026
run buildall |
1 similar comment
deardeng
commented
Jan 8, 2026
run buildall |
doris-robot
commented
Jan 8, 2026
TPC-H: Total hot run time: 31449 ms |
doris-robot
commented
Jan 8, 2026
TPC-DS: Total hot run time: 176500 ms |
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
a36b7b0 to
c2861f8Comparedeardeng
commented
Jan 19, 2026
run buildall |
doris-robot
commented
Jan 19, 2026
TPC-H: Total hot run time: 31786 ms |
doris-robot
commented
Jan 19, 2026
TPC-DS: Total hot run time: 173765 ms |
doris-robot
commented
Jan 19, 2026
ClickBench: Total hot run time: 27.33 s |
hello-stephen
commented
Jan 19, 2026
FE Regression Coverage ReportIncrement line coverage |
dataroaring
commented
Jan 20, 2026
Code reviewFound 2 issues:
doris/fe/fe-core/src/main/java/org/apache/doris/catalog/Tablet.java Lines 247 to 252 in 0dbd4cf The same issue exists in CloudTablet: The correct pattern (recording outside the per-replica loop) is shown in doris/fe/fe-core/src/main/java/org/apache/doris/catalog/Tablet.java Lines 264 to 267 in 0dbd4cf
The modulo operation that will fail: 🤖 Generated with Claude Code - If this code review was useful, please react with 👍. Otherwise, react with 👎. |
deardeng
commented
Feb 12, 2026
run buildall |
PR approved by at least one committer and no changes requested. |
PR approved by anyone and no changes requested. |
hello-stephen
commented
Feb 12, 2026
FE UT Coverage ReportIncrement line coverage |
hello-stephen
commented
Feb 12, 2026
FE Regression Coverage ReportIncrement line coverage |
hello-stephen
commented
Feb 13, 2026
run buildall |
doris-robot
commented
Feb 13, 2026
TPC-H: Total hot run time: 28674 ms |
doris-robot
commented
Feb 13, 2026
TPC-DS: Total hot run time: 184629 ms |
hello-stephen
commented
Feb 13, 2026
FE Regression Coverage ReportIncrement line coverage |
Uh oh!
There was an error while loading. Please reload this page.
…n cloud (apache#59539) 1. Starting from the getBackendId of the replica, implement a sliding window approach (in TabletAccessStats.java) to count read and write operations over the last hour. The accuracy of this count isn't critical, as the aim is to indicate relative activity levels. 2. Display these statistics in the SHOW TABLETS FROM TABLE and SHOW TABLET {tabletId} commands. ``` show tablet 1767773242851\G ***************************[ 1. row ]*************************** ... AccessCount1H | 1107 LastAccessTime | 1767782384995 ... ``` 3. Integrate with the existing balancing strategy: - For each scheduling operation, identify active databases, tables, and partitions from the active tablets. Schedule operations first on the most active databases, tables, and partitions. - When selecting tablets from the source BE, modify the previous random selection to prioritize non-active tablets for scheduling, keeping active tablets as stable as possible on the source.
…n cloud (apache#59539) 1. Starting from the getBackendId of the replica, implement a sliding window approach (in TabletAccessStats.java) to count read and write operations over the last hour. The accuracy of this count isn't critical, as the aim is to indicate relative activity levels. 2. Display these statistics in the SHOW TABLETS FROM TABLE and SHOW TABLET {tabletId} commands. ``` show tablet 1767773242851\G ***************************[ 1. row ]*************************** ... AccessCount1H | 1107 LastAccessTime | 1767782384995 ... ``` 3. Integrate with the existing balancing strategy: - For each scheduling operation, identify active databases, tables, and partitions from the active tablets. Schedule operations first on the most active databases, tables, and partitions. - When selecting tablets from the source BE, modify the previous random selection to prioritize non-active tablets for scheduling, keeping active tablets as stable as possible on the source.
…n cloud #59539#57200#61562 (#61914) pick from #59539#57200#61562 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test <!-- At least one of them must be included. --> - [x] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason <!-- Add your reason? --> - Behavior changed: - [x] No. - [ ] Yes. <!-- Explain the behavior change --> - Does this need documentation? - [x] No. - [ ] Yes. <!-- Add document PR link here. eg: apache/doris-website#1214 --> ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
…n cloud #59539#57200#61562 (#62709) pick from #59539#57200#61562 Issue Number: close #xxx Related PR: #xxx Problem Summary: None - Test <!-- At least one of them must be included. --> - [x] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason <!-- Add your reason? --> - Behavior changed: - [x] No. - [ ] Yes. <!-- Explain the behavior change --> - Does this need documentation? - [x] No. - [ ] Yes. <!-- Add document PR link here. eg: apache/doris-website#1214 --> - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into --> ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test <!-- At least one of them must be included. --> - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason <!-- Add your reason? --> - Behavior changed: - [ ] No. - [ ] Yes. <!-- Explain the behavior change --> - Does this need documentation? - [ ] No. - [ ] Yes. <!-- Add document PR link here. eg: apache/doris-website#1214 --> ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
What problem does this PR solve?
Starting from the getBackendId of the replica, implement a sliding window approach (in TabletAccessStats.java) to count read and write operations over the last hour. The accuracy of this count isn't critical, as the aim is to indicate relative activity levels.
Display these statistics in the SHOW TABLETS FROM TABLE and SHOW TABLET {tabletId} commands.
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
Release note
None
Check List (For Author)
Test
Behavior changed:
Does this need documentation?
Check List (For Reviewer who merge this PR)