Skip to content

Deserialize proto based (mutable key range) change stream return records - #35408

Merged
Abacn merged 1 commit into
apache:masterfrom
changliiu:v2-deserialization
Jun 27, 2025
Merged

Deserialize proto based (mutable key range) change stream return records#35408
Abacn merged 1 commit into
apache:masterfrom
changliiu:v2-deserialization

Conversation

@changliiu

@changliiuchangliiu commented Jun 24, 2025

Copy link
Copy Markdown
Contributor

Parse proto type change stream return records into connector models.

Including:

  1. DataChangeRecord
  2. HeartbeatRecord
  3. PartitionStartRecord
  4. PartitionEndRecord
  5. PartitionEventRecord

Also:

  1. increase grpc java client lib version so that change stream new records e.g. PartitionStartRecords can be used.
  2. add unit tests for each type or records.

@changliiu
changliiu marked this pull request as ready for review June 24, 2025 00:19
@github-actions

Copy link
Copy Markdown
Contributor

Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment assign set of reviewers

@changliiu
changliiuforce-pushed the v2-deserialization branch 2 times, most recently from 53081b9 to 458398fCompareJune 24, 2025 20:45

@dedocibuladedocibula left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

First batch of comments

@changliiu
changliiuforce-pushed the v2-deserialization branch 2 times, most recently from 684c368 to 52ebaacCompareJune 25, 2025 18:16
pick 4d2a5a7 # Fix API surface test (apache#35028)
Deserialize change stream proto based (mutable key range) return types.
@changliiu

Copy link
Copy Markdown
ContributorAuthor

Friendly ping :)

@Abacn
Abacn merged commit 3f3f214 into apache:masterJun 27, 2025
@changliiu
changliiu deleted the v2-deserialization branch June 27, 2025 17:20
Abacn added a commit that referenced this pull request Jun 28, 2025
liferoad pushed a commit that referenced this pull request Jun 28, 2025
changliiu added a commit to changliiu/beam that referenced this pull request Jun 30, 2025
changliiu added a commit to changliiu/beam that referenced this pull request Jun 30, 2025
changliiu added a commit to changliiu/beam that referenced this pull request Jul 1, 2025
changliiu added a commit to changliiu/beam that referenced this pull request Jul 1, 2025
changliiu added a commit to changliiu/beam that referenced this pull request Jul 1, 2025
changliiu added a commit to changliiu/beam that referenced this pull request Jul 1, 2025
changliiu added a commit to changliiu/beam that referenced this pull request Jul 1, 2025
changliiu added a commit to changliiu/beam that referenced this pull request Jul 1, 2025
jrmccluskey pushed a commit to jrmccluskey/beam that referenced this pull request Jul 1, 2025
Abacn pushed a commit that referenced this pull request Jul 1, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@changliiu@thiagotnunes@dedocibula@Abacn