Skip to content

branch-3.0: [opt](cloud) Support cached cloud partition version for high frequency query #50439 - #50619

Merged
dataroaring merged 1 commit into
branch-3.0from
auto-pick-50439-branch-3.0
May 14, 2025
Merged

branch-3.0: [opt](cloud) Support cached cloud partition version for high frequency query #50439#50619
dataroaring merged 1 commit into
branch-3.0from
auto-pick-50439-branch-3.0

Conversation

@github-actions

Copy link
Copy Markdown
Contributor

Cherry-picked from #50439

…y query (#50439)
Support new session variable to get rid of frequent get_version request
to meta-service.
set `cloud_partition_version_cache_ttl_ms` with a suitable value as
needed, it means a partition's version may be cached on FE at most X
milliseconds.
pro: reduce RPC/IO to meta-service and fdb, increase query throughput
and reduce query latency (plan phase)
con: visibility may be delayed when doing point query; data consistency
(snapshot) may be broken when doing query wi involved multiple
partitions and there is continuous data import;
@Thearas

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@Thearas

Copy link
Copy Markdown
Contributor

run buildall

@dataroaringdataroaring left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label May 14, 2025
@github-actions

Copy link
Copy Markdown
ContributorAuthor

PR approved by at least one committer and no changes requested.

@github-actions

Copy link
Copy Markdown
ContributorAuthor

PR approved by anyone and no changes requested.

@dataroaring
dataroaring merged commit 53e0ab6 into branch-3.0May 14, 2025
@github-actions
github-actionsBot deleted the auto-pick-50439-branch-3.0 branch May 14, 2025 07:44
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approvedIndicates a PR has been approved by one committer.reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Thearas@dataroaring@gavinchou