Skip to content

Load: Implement region operations cache for load × region migration detection - #15210

Merged
SteveYurongSu merged 8 commits into
apache:masterfrom
liyuheng55555:Working/region-operations-cache
Mar 28, 2025
Merged

Load: Implement region operations cache for load × region migration detection#15210
SteveYurongSu merged 8 commits into
apache:masterfrom
liyuheng55555:Working/region-operations-cache

Conversation

@liyuheng55555

Copy link
Copy Markdown
Collaborator

No description provided.

@SteveYurongSuSteveYurongSu self-assigned this Mar 27, 2025

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR implements a caching mechanism for region operations to improve the management of region migration and its related notifications. Key changes include:

  • Refactoring in ProcedureManager to extract region operation procedures and provide a consensus ID list.
  • Introduction of a new RegionOperationsCache inner class in RegionMigrateService to cache region operations along with logical clock and timestamp updates.
  • Updates across ConfigNodeProcedureEnv, HeartbeatService, DataNodeInternalRPCServiceImpl, and RegionMigrateProcedure to integrate the new cache information in region migration notifications.

Reviewed Changes

Copilot reviewed 7 out of 8 changed files in this pull request and generated 1 comment.

Show a summary per file
FileDescription
ProcedureManager.javaRefactored methods for retrieving region operation procedures and duplication checks.
RegionMigrateService.javaIntroduced RegionOperationsCache to manage caching of region operation data and replaced the static lastNotifyTime.
ConfigNodeProcedureEnv.javaUpdated construction of TNotifyRegionMigrationReq to include logical clock, timestamp, and region operations list.
DataNodeInternalRPCServiceImpl.javaIntegrated region migration notifications with the new region operations update mechanism.
HeartbeatService.javaChanged heartbeat request generation to include logical clock and region operation updates.
RegionMigrateProcedure.javaUpdated logging calls to use RegionMaintainHandler for improved clarity.
DataNodeHeartbeatHandler.javaAdded logger import and initialization for enhanced logging.
Files not reviewed (1)
  • iotdb-protocol/thrift-datanode/src/main/thrift/datanode.thrift: Language not supported

@SteveYurongSuSteveYurongSu changed the title Implement region operations cacheLoad: Implement region operations cache for load × region migration detectionMar 28, 2025
@SteveYurongSu
SteveYurongSu merged commit 8889255 into apache:masterMar 28, 2025
liyuheng55555 added a commit to liyuheng55555/iotdb that referenced this pull request Apr 1, 2025
…etection (apache#15210)
Co-authored-by: Steve Yurong Su <rong@apache.org>
(cherry picked from commit 8889255)
SteveYurongSu pushed a commit that referenced this pull request Apr 1, 2025
…etection (#15210) (#15246)
Co-authored-by: Steve Yurong Su <rong@apache.org>
(cherry picked from commit 8889255)
JackieTien97 pushed a commit that referenced this pull request Apr 14, 2025
…etection (#15210)
Co-authored-by: Steve Yurong Su <rong@apache.org>
(cherry picked from commit 8889255)
Caideyipi pushed a commit to Caideyipi/iotdb that referenced this pull request Mar 25, 2026
…etection (apache#15210) (apache#15246)
Co-authored-by: Steve Yurong Su <rong@apache.org>
(cherry picked from commit 8889255)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@liyuheng55555@SteveYurongSu