Skip to content

PHOENIX-5860 Throw exception which region is closing or splitting when delete data - #874

Open
wangchao316 wants to merge 2 commits into
apache:4.xfrom
wangchao316:4.x
Open

PHOENIX-5860 Throw exception which region is closing or splitting when delete data#874
wangchao316 wants to merge 2 commits into
apache:4.xfrom
wangchao316:4.x

Conversation

@wangchao316

Copy link
Copy Markdown
Member

No description provided.

@wangchao316

Copy link
Copy Markdown
MemberAuthor

@joshelser@gjacoby126@swaroopak , hello , could you please review this?
Thanks

@stoty

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 0sDocker mode activated.
-1 ❌docker5m 35sDocker failed to build yetus/phoenix:871ed211e.
SubsystemReport/Notes
GITHUB PR#874
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/1/console
versionsgit=2.17.1
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@wangchao316

Copy link
Copy Markdown
MemberAuthor

@joshelser , @stoty ,hello, I alter this code that postRollBackSplit. could you please review this?

@yanxinyi

Copy link
Copy Markdown
Contributor

Hi @wangchao316 , the logic looks good to me, do you have anything to add @joshelser ?

@wangchao316

Copy link
Copy Markdown
MemberAuthor

@joshelser ,hello, do you have anything to add?

@joshelser

Copy link
Copy Markdown
Member

(sorry for the wide ping)

@virajjasani@gjacoby126@ChinmaySKulkarni@apurtell have any of your noticed this one in 1.x? The change seems reasonable to me, but I haven't kept up with the later 1.x HBase releases to have confidence in the issue and fix.

@virajjasani

Copy link
Copy Markdown
Contributor

Thanks @joshelser for bringing this up. I just realized that we have this exact same issue reported sometime back this year with Phoenix 4.14.x + HBase 1.3.x for Delete queries.
Changes indeed look reasonable and simpler to understand.

I am confident about existence of the issue (not the fix though). And @wangchao316 seems to have been able to consistently repro this with minor changes in HBase split code by failing split all the times and let the flow through rollback of split, as per Jira comments.
However, let's trigger a QA run first, we don't have clear QA result on PR. If we don't see any issue, I am +1 for rolling out this change, feels worth shipping.

@gjacoby126@ChinmaySKulkarni@apurtell Thought?

@virajjasani

Copy link
Copy Markdown
Contributor

Precommit results are available: https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/229/testReport/
Looks good, failures don't seem relevant. +1(non-binding) for this PR.
Thanks @wangchao316

@chrajeshbabu

Copy link
Copy Markdown
Contributor

+1. It's really required to avoid issues on split rollback cases.

@stoty

stoty commented Dec 1, 2020

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec4m 20sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+1 💚mvninstall11m 12s4.x passed
+1 💚compile0m 55s4.x passed
+1 💚checkstyle0m 39s4.x passed
+1 💚javadoc0m 44s4.x passed
+0 🆗spotbugs2m 54sphoenix-core in 4.x has 950 extant spotbugs warnings.
_ Patch Compile Tests _
+1 💚mvninstall5m 26sthe patch passed
+1 💚compile0m 56sthe patch passed
+1 💚javac0m 56sthe patch passed
-1 ❌checkstyle0m 38sphoenix-core: The patch generated 3 new + 364 unchanged - 0 fixed = 367 total (was 364)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚javadoc0m 43sthe patch passed
+1 💚spotbugs3m 11sthe patch passed
_ Other Tests _
-1 ❌unit136m 2sphoenix-core in the patch failed.
+1 💚asflicense0m 37sThe patch does not generate ASF License warnings.
170m 58s
ReasonTests
Failed junit testsphoenix.end2end.index.LocalImmutableTxIndexIT
phoenix.end2end.IndexBuildTimestampIT
TEST-[RangeScanIT_0]
SubsystemReport/Notes
DockerClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/3/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#874
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile
unameLinux 64dce7320f26 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revision4.x / 277b6fd
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstylehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/3/artifact/yetus-general-check/output/diff-checkstyle-phoenix-core.txt
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/3/artifact/yetus-general-check/output/patch-unit-phoenix-core.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/3/testReport/
Max. process+thread count6709 (vs. ulimit of 30000)
modulesC: phoenix-core U: phoenix-core
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/3/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@wangchao316

Copy link
Copy Markdown
MemberAuthor

+1. It's really required to avoid issues on split rollback cases.

Thanks, can you please merge?

@stoty

stoty commented Dec 1, 2020

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 32sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+1 💚mvninstall11m 0s4.x passed
+1 💚compile0m 55s4.x passed
+1 💚checkstyle0m 38s4.x passed
+1 💚javadoc0m 44s4.x passed
+0 🆗spotbugs2m 53sphoenix-core in 4.x has 950 extant spotbugs warnings.
_ Patch Compile Tests _
+1 💚mvninstall5m 26sthe patch passed
+1 💚compile0m 57sthe patch passed
+1 💚javac0m 57sthe patch passed
-1 ❌checkstyle0m 38sphoenix-core: The patch generated 5 new + 362 unchanged - 2 fixed = 367 total (was 364)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚javadoc0m 46sthe patch passed
+1 💚spotbugs2m 59sthe patch passed
_ Other Tests _
-1 ❌unit140m 21sphoenix-core in the patch failed.
+1 💚asflicense0m 39sThe patch does not generate ASF License warnings.
171m 8s
ReasonTests
Failed junit testsphoenix.query.MaxConcurrentConnectionsIT
phoenix.end2end.AlterTableWithViewsIT
SubsystemReport/Notes
DockerClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/4/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#874
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile
unameLinux 0aa40ae946ff 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revision4.x / 18b9f76
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstylehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/4/artifact/yetus-general-check/output/diff-checkstyle-phoenix-core.txt
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/4/artifact/yetus-general-check/output/patch-unit-phoenix-core.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/4/testReport/
Max. process+thread count6597 (vs. ulimit of 30000)
modulesC: phoenix-core U: phoenix-core
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/4/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@ChinmaySKulkarniChinmaySKulkarni left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants

@wangchao316@stoty@yanxinyi@joshelser@virajjasani@chrajeshbabu@ChinmaySKulkarni