HBASE-23723 Ensure MOB compaction works in optimized mode after snaps… by huaxiangsun · Pull Request #4704 · apache/hbase

huaxiangsun · 2022-08-12T21:49:42Z

…hot clone (#4617)

HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone (HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone #1446)
Reorganize MOB compaction tests for more reuse.
Add tests for mob compaction after snapshot clone operations
note the original table used to write a given mob hfile and use that to find it later.

Signed-off-by: Esteban Gutierrez esteban@apache.org

spotless:apply to fix HBaseTestingUtility
Fix error-prone errors

Signed-off-by: Esteban Gutierrez esteban@apache.org
Co-authored-by: Sean Busbey busbey@apache.org

…hot clone (apache#4617) * HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone (apache#1446) * Reorganize MOB compaction tests for more reuse. * Add tests for mob compaction after snapshot clone operations * note the original table used to write a given mob hfile and use that to find it later. Signed-off-by: Esteban Gutierrez <esteban@apache.org> * spotless:apply to fix HBaseTestingUtility * Fix error-prone errors Signed-off-by: Esteban Gutierrez <esteban@apache.org> Co-authored-by: Sean Busbey <busbey@apache.org>

huaxiangsun · 2022-08-12T21:49:58Z

A backport from branch-2 to branch-2.5.

Apache-HBase · 2022-08-12T22:39:29Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 12s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+1 💚	hbaseanti	0m 0s	Patch does not have any anti-patterns.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ branch-2.5 Compile Tests _
+0 🆗	mvndep	0m 11s	Maven dependency ordering for branch
+1 💚	mvninstall	2m 16s	branch-2.5 passed
+1 💚	compile	2m 46s	branch-2.5 passed
+1 💚	checkstyle	0m 46s	branch-2.5 passed
+1 💚	spotless	0m 46s	branch has no errors when running spotless:check.
+1 💚	spotbugs	1m 46s	branch-2.5 passed
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 12s	Maven dependency ordering for patch
+1 💚	mvninstall	2m 8s	the patch passed
+1 💚	compile	2m 45s	the patch passed
-0 ⚠️	javac	0m 31s	hbase-common generated 2 new + 152 unchanged - 2 fixed = 154 total (was 154)
-0 ⚠️	javac	2m 14s	hbase-server generated 4 new + 189 unchanged - 4 fixed = 193 total (was 193)
+1 💚	checkstyle	0m 45s	the patch passed
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	hadoopcheck	15m 27s	Patch does not cause any errors with Hadoop 2.10.1 or 3.1.2 3.2.2 3.3.1.
+1 💚	spotless	0m 41s	patch has no errors when running spotless:check.
+1 💚	spotbugs	1m 58s	the patch passed
		_ Other Tests _
+1 💚	asflicense	0m 20s	The patch does not generate ASF License warnings.
		39m 21s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#4704
Optional Tests	dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
uname	Linux 86d1affa1621 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2.5 / `da472aa`
Default Java	AdoptOpenJDK-1.8.0_282-b08
javac	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-general-check/output/diff-compile-javac-hbase-common.txt
javac	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-general-check/output/diff-compile-javac-hbase-server.txt
Max. process+thread count	60 (vs. ulimit of 30000)
modules	C: hbase-common hbase-server U: .
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/console
versions	git=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2022-08-13T01:30:28Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	3m 52s	Docker mode activated.
-0 ⚠️	yetus	0m 5s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ branch-2.5 Compile Tests _
+0 🆗	mvndep	0m 13s	Maven dependency ordering for branch
+1 💚	mvninstall	2m 28s	branch-2.5 passed
+1 💚	compile	0m 50s	branch-2.5 passed
+1 💚	shadedjars	4m 0s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 36s	branch-2.5 passed
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 12s	Maven dependency ordering for patch
+1 💚	mvninstall	2m 9s	the patch passed
+1 💚	compile	0m 51s	the patch passed
+1 💚	javac	0m 51s	the patch passed
+1 💚	shadedjars	4m 0s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 35s	the patch passed
		_ Other Tests _
+1 💚	unit	1m 41s	hbase-common in the patch passed.
-1 ❌	unit	187m 6s	hbase-server in the patch failed.
		210m 13s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR	#4704
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 6775756d6dd4 5.4.0-1071-aws #76~18.04.1-Ubuntu SMP Mon Mar 28 17:49:57 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2.5 / `da472aa`
Default Java	AdoptOpenJDK-1.8.0_282-b08
unit	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-jdk8-hadoop2-check/output/patch-unit-hbase-server.txt
Test Results	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/testReport/
Max. process+thread count	2160 (vs. ulimit of 30000)
modules	C: hbase-common hbase-server U: .
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2022-08-13T02:02:21Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 36s	Docker mode activated.
-0 ⚠️	yetus	0m 5s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ branch-2.5 Compile Tests _
+0 🆗	mvndep	0m 11s	Maven dependency ordering for branch
+1 💚	mvninstall	3m 22s	branch-2.5 passed
+1 💚	compile	1m 10s	branch-2.5 passed
+1 💚	shadedjars	4m 34s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 47s	branch-2.5 passed
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 19s	Maven dependency ordering for patch
+1 💚	mvninstall	2m 59s	the patch passed
+1 💚	compile	1m 15s	the patch passed
+1 💚	javac	1m 15s	the patch passed
+1 💚	shadedjars	4m 41s	patch has no errors when building our shaded downstream artifacts.
-0 ⚠️	javadoc	0m 28s	hbase-server generated 1 new + 90 unchanged - 0 fixed = 91 total (was 90)
		_ Other Tests _
+1 💚	unit	1m 57s	hbase-common in the patch passed.
+1 💚	unit	216m 52s	hbase-server in the patch passed.
		242m 12s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#4704
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 3fc95726a348 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2.5 / `da472aa`
Default Java	AdoptOpenJDK-11.0.10+9
javadoc	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/artifact/yetus-jdk11-hadoop3-check/output/diff-javadoc-javadoc-hbase-server.txt
Test Results	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/testReport/
Max. process+thread count	2315 (vs. ulimit of 30000)
modules	C: hbase-common hbase-server U: .
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4704/1/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

huaxiangsun · 2022-08-15T17:31:24Z

I run the failed test case TestSplitRegionWhileRSCrash locally, it passed.

huaxiangsun added the backport This PR is a back port of some issue or issues already committed to master label Aug 12, 2022

huaxiangsun merged commit e595f15 into apache:branch-2.5Aug 15, 2022

Navigation Menu

Uh oh!

HBASE-23723 Ensure MOB compaction works in optimized mode after snaps… - #4704

HBASE-23723 Ensure MOB compaction works in optimized mode after snaps…#4704
huaxiangsun merged 1 commit into
apache:branch-2.5from
huaxiangsun:branch-2.5.HBASE-23723

huaxiangsun commented Aug 12, 2022

Uh oh!

huaxiangsun commented Aug 12, 2022

Uh oh!

Apache-HBase commented Aug 12, 2022

Uh oh!

Apache-HBase commented Aug 13, 2022

Uh oh!

Apache-HBase commented Aug 13, 2022

Uh oh!

huaxiangsun commented Aug 15, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

huaxiangsun commented Aug 12, 2022

Uh oh!

huaxiangsun commented Aug 12, 2022

Uh oh!

Apache-HBase commented Aug 12, 2022

Uh oh!

Apache-HBase commented Aug 13, 2022

Uh oh!

Apache-HBase commented Aug 13, 2022

Uh oh!

huaxiangsun commented Aug 15, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants