Skip to content

fixes [21715] - fix ring range read for CassandraIO read() - #21786

Merged
brucearctor merged 1 commit into
apache:masterfrom
vmarquez:bugfix/21715/fix_cassandraio_wraparound_tokens
Jul 15, 2022
Merged

fixes [21715] - fix ring range read for CassandraIO read()#21786
brucearctor merged 1 commit into
apache:masterfrom
vmarquez:bugfix/21715/fix_cassandraio_wraparound_tokens

Conversation

@vmarquez

@vmarquezvmarquez commented Jun 10, 2022

Copy link
Copy Markdown
Contributor

fixes#21715 (missing data in CassandraIO)

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests

See CI.md for more information about GitHub Actions CI.

@asf-ci

Copy link
Copy Markdown

Can one of the admins verify this patch?

1 similar comment
@asf-ci

Copy link
Copy Markdown

Can one of the admins verify this patch?

@vmarquez
vmarquezforce-pushed the bugfix/21715/fix_cassandraio_wraparound_tokens branch from 48b5298 to 1e7fc95CompareJune 16, 2022 04:32
@vmarquezvmarquez changed the title WIP: fixing the missing wrap around ring range readfixing the missing wrap around ring range read for #21715Jun 16, 2022
@vmarquezvmarquez changed the title fixing the missing wrap around ring range read for #21715fixing the missing wrap around ring range read for CassandraIO read()Jun 16, 2022
@pabloem

Copy link
Copy Markdown
Member

Run Java PostCommit

@pabloem

Copy link
Copy Markdown
Member

@vmarquez
vmarquezforce-pushed the bugfix/21715/fix_cassandraio_wraparound_tokens branch 2 times, most recently from fc53b8a to 3e10063CompareJune 17, 2022 03:24
@vmarquez

Copy link
Copy Markdown
ContributorAuthor

@pabloem I fixed a query. Looks ok now. Could you or maybe @damccorm help out with a review if possible? Thanks.

@vmarquez
vmarquezforce-pushed the bugfix/21715/fix_cassandraio_wraparound_tokens branch from 3e10063 to b8041fcCompareJune 17, 2022 17:08
@pabloem

Copy link
Copy Markdown
Member

Run Java PostCommit

@brucearctor

Copy link
Copy Markdown
Contributor

Run Java PreCommit

@vmarquez

Copy link
Copy Markdown
ContributorAuthor

@brucearctor thanks, looks like the unrelated, flaky test now passed. What are the next steps to getting this merged?

@brucearctor

Copy link
Copy Markdown
Contributor

I haven't worked with this component [ cassandraIO ] -- so hoping either for more context, or for someone that's worked closer with it to step in.

Is there an associated issue [jira/github] that this relates to/addresses. That would be a start to provide context on what this is/why - which is also useful more generally for anyone looking through the code/changes/history.

Ex, from the PR template: Mention the appropriate issue in your description (for example: "addresses https://github.com/apache/beam/pull/123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment "fixes #" instead.

@vmarquez

Copy link
Copy Markdown
ContributorAuthor

@brucearctor thanks. I had "fixing" instead of "fixes" so I guess it didn't auto pick up the issue it addresses, but at the top you should see the issue it's for: #21715

@brucearctor

brucearctor commented Jun 24, 2022

Copy link
Copy Markdown
Contributor

@KriKroff you wrote --> https://github.com/KriKroff/beam-cassandraio-bug

Can you take a look and verify this PR addresses this issue?

In principle LGTM, but hoping for a set of eyes more familiar with the component/issue.

@vmarquez

Copy link
Copy Markdown
ContributorAuthor

Thanks for taking a look, really appreciate it @brucearctor

@vmarquezvmarquez changed the title fixing the missing wrap around ring range read for CassandraIO read()fixes [21715] - fix ring range read for CassandraIO read()Jul 12, 2022
@pabloem

Copy link
Copy Markdown
Member

so sorry. I can't look at this.

@pabloem

Copy link
Copy Markdown
Member

r: @Abacn

@github-actions

Copy link
Copy Markdown
Contributor

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control

@AbacnAbacn left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. The added unit test passed, and verified it fails on current master with java.lang.AssertionError: counting/Flatten.PCollections.out: expected:<100> but was:<99>, which means this change fixed the problem

@brucearctor
brucearctor merged commit 2ba5317 into apache:masterJul 15, 2022
@vmarquez

Copy link
Copy Markdown
ContributorAuthor

@Abacn Thank you so much for the review! :)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Data missing when using CassandraIO.Read

5 participants

@vmarquez@asf-ci@pabloem@brucearctor@Abacn