HBASE-27216 Revisit the ReplicationSyncUp tool by 2005hithlj · Pull Request #4947 · apache/hbase

2005hithlj · 2023-01-06T09:58:43Z

https://issues.apache.org/jira/browse/HBASE-27216

… make the minimum replication system work (apache#4672) Signed-off-by: Xin Sun <ddupgs@gmail.com>

Signed-off-by: Xin Sun <ddupgs@gmail.com>

) Signed-off-by: Xin Sun <ddupgs@gmail.com>

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>

…rations such as migration (apache#4803) Signed-off-by: Xin Sun <ddupgs@gmail.com>

…lication table does not exist (apache#4811) Signed-off-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Yu Li <liyu@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>

…ionQueueFromZkToTableProcedure Signed-off-by: Liangjun He <heliangjun@apache.org>

…lication queue data (apache#4901) Signed-off-by: Liangjun He <heliangjun@apache.org>

Apache-HBase · 2023-01-06T10:20:16Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 40s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ HBASE-27109/table_based_rqs Compile Tests _
+1 💚	mvninstall	2m 24s	HBASE-27109/table_based_rqs passed
+1 💚	compile	0m 34s	HBASE-27109/table_based_rqs passed
+1 💚	shadedjars	4m 2s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 23s	HBASE-27109/table_based_rqs passed
		_ Patch Compile Tests _
-1 ❌	mvninstall	1m 14s	root in the patch failed.
+1 💚	compile	0m 37s	the patch passed
+1 💚	javac	0m 37s	the patch passed
-1 ❌	shadedjars	3m 6s	patch has 11 errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 21s	the patch passed
		_ Other Tests _
-1 ❌	unit	0m 36s	hbase-server in the patch failed.
		14m 58s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR	#4947
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 8c59d6631241 5.4.0-1088-aws #96~18.04.1-Ubuntu SMP Mon Oct 17 02:57:48 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	HBASE-27109/table_based_rqs / `da59154`
Default Java	Temurin-1.8.0_352-b08
mvninstall	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-jdk8-hadoop3-check/output/patch-mvninstall-root.txt
shadedjars	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-jdk8-hadoop3-check/output/patch-shadedjars.txt
unit	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt
Test Results	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/testReport/
Max. process+thread count	52 (vs. ulimit of 30000)
modules	C: hbase-server U: hbase-server
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/console
versions	git=2.34.1 maven=3.8.6
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2023-01-06T10:24:04Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 23s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+1 💚	hbaseanti	0m 0s	Patch does not have any anti-patterns.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ HBASE-27109/table_based_rqs Compile Tests _
+1 💚	mvninstall	2m 45s	HBASE-27109/table_based_rqs passed
+1 💚	compile	2m 25s	HBASE-27109/table_based_rqs passed
+1 💚	checkstyle	0m 36s	HBASE-27109/table_based_rqs passed
+1 💚	spotless	0m 43s	branch has no errors when running spotless:check.
+1 💚	spotbugs	1m 31s	HBASE-27109/table_based_rqs passed
		_ Patch Compile Tests _
-1 ❌	mvninstall	1m 35s	root in the patch failed.
-1 ❌	compile	1m 2s	hbase-server in the patch failed.
-0 ⚠️	javac	1m 2s	hbase-server in the patch failed.
+1 💚	checkstyle	0m 32s	the patch passed
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
-1 ❌	hadoopcheck	1m 42s	The patch causes 11 errors with Hadoop v3.2.4.
-1 ❌	hadoopcheck	3m 31s	The patch causes 11 errors with Hadoop v3.3.4.
+1 💚	spotless	0m 39s	patch has no errors when running spotless:check.
-1 ❌	spotbugs	1m 36s	hbase-server generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
		_ Other Tests _
+1 💚	asflicense	0m 11s	The patch does not generate ASF License warnings.
		18m 52s

Reason	Tests
FindBugs	module:hbase-server
	Unwritten field:OfflineTableReplicationQueueStorage.java:[line 234]

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#4947
Optional Tests	dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
uname	Linux 3cb546e70882 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	HBASE-27109/table_based_rqs / `da59154`
Default Java	Eclipse Adoptium-11.0.17+8
mvninstall	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-general-check/output/patch-mvninstall-root.txt
compile	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-general-check/output/patch-compile-hbase-server.txt
javac	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-general-check/output/patch-compile-hbase-server.txt
hadoopcheck	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-general-check/output/patch-javac-3.2.4.txt
hadoopcheck	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-general-check/output/patch-javac-3.3.4.txt
spotbugs	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-general-check/output/new-spotbugs-hbase-server.html
Max. process+thread count	78 (vs. ulimit of 30000)
modules	C: hbase-server U: hbase-server
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/console
versions	git=2.34.1 maven=3.8.6 spotbugs=4.7.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2023-01-06T10:26:38Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 33s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ HBASE-27109/table_based_rqs Compile Tests _
+1 💚	mvninstall	4m 16s	HBASE-27109/table_based_rqs passed
+1 💚	compile	1m 8s	HBASE-27109/table_based_rqs passed
+1 💚	shadedjars	4m 30s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 31s	HBASE-27109/table_based_rqs passed
		_ Patch Compile Tests _
-1 ❌	mvninstall	2m 17s	root in the patch failed.
+1 💚	compile	0m 49s	the patch passed
+1 💚	javac	0m 49s	the patch passed
-1 ❌	shadedjars	3m 36s	patch has 11 errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 27s	the patch passed
		_ Other Tests _
-1 ❌	unit	0m 52s	hbase-server in the patch failed.
		21m 7s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#4947
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 01ad055a25d1 5.4.0-1088-aws #96~18.04.1-Ubuntu SMP Mon Oct 17 02:57:48 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	HBASE-27109/table_based_rqs / `da59154`
Default Java	Eclipse Adoptium-11.0.17+8
mvninstall	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-jdk11-hadoop3-check/output/patch-mvninstall-root.txt
shadedjars	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-jdk11-hadoop3-check/output/patch-shadedjars.txt
unit	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt
Test Results	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/testReport/
Max. process+thread count	79 (vs. ulimit of 30000)
modules	C: hbase-server U: hbase-server
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4947/1/console
versions	git=2.34.1 maven=3.8.6
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache9 · 2023-01-08T13:25:49Z

Thanks @2005hithlj for putting this up.

Let's convert this PR to draft. I will try to help here next week.

Apache9 · 2023-01-19T09:53:41Z

Close in favor of #4966

Apache9and others added 11 commits December 3, 2022 21:46

HBASE-27212 Implement a new table based replication queue storage and…
2dffb1f
… make the minimum replication system work (apache#4672) Signed-off-by: Xin Sun <ddupgs@gmail.com>

HBASE-27213 Add support for claim queue operation (apache#4708)
3065774
Signed-off-by: Xin Sun <ddupgs@gmail.com>

HBASE-27214 Implement the new replication hfile/log cleaner (apache#4722
002df54
) Signed-off-by: Xin Sun <ddupgs@gmail.com>

HBASE-27215 Add support for sync replication (apache#4762)
2845e7d
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>

HBASE-27392 Add a new procedure type for implementing some global ope…
0fc588d
…rations such as migration (apache#4803) Signed-off-by: Xin Sun <ddupgs@gmail.com>

HBASE-27405 Fix the replication hfile/log cleaner report that the rep…
07c435a
…lication table does not exist (apache#4811) Signed-off-by: Duo Zhang <zhangduo@apache.org>

HBASE-27218 Support rolling upgrading (apache#4808)
a22e4ed
Signed-off-by: Yu Li <liyu@apache.org>

HBASE-27217 Revisit the DumpReplicationQueues tool (apache#4810)
a78aac5
Signed-off-by: Duo Zhang <zhangduo@apache.org>

HBASE-27429 Add exponential retry backoff support for MigrateReplicat…
d218c77
…ionQueueFromZkToTableProcedure Signed-off-by: Liangjun He <heliangjun@apache.org>

HBASE-27430 Should disable replication log cleaner when migrating rep…
da59154
…lication queue data (apache#4901) Signed-off-by: Liangjun He <heliangjun@apache.org>

HBASE-27216 Revisit the ReplicationSyncUp tool
f544e7d

Apache9 force-pushed the HBASE-27109/table_based_rqs branch from da59154 to e4e3363Compare January 10, 2023 07:41

Apache9 force-pushed the HBASE-27109/table_based_rqs branch from e4e3363 to ff31d25Compare January 18, 2023 10:25

Apache9 closed this Jan 19, 2023

Navigation Menu

Uh oh!

HBASE-27216 Revisit the ReplicationSyncUp tool - #4947

HBASE-27216 Revisit the ReplicationSyncUp tool#4947
2005hithlj wants to merge 11 commits into
apache:HBASE-27109/table_based_rqsfrom
2005hithlj:HBASE-27216

2005hithlj commented Jan 6, 2023

Uh oh!

Apache-HBase commented Jan 6, 2023

Uh oh!

Apache-HBase commented Jan 6, 2023

Uh oh!

Apache-HBase commented Jan 6, 2023

Uh oh!

Apache9 commented Jan 8, 2023

Uh oh!

Apache9 commented Jan 19, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

2005hithlj commented Jan 6, 2023

Uh oh!

Apache-HBase commented Jan 6, 2023

Uh oh!

Apache-HBase commented Jan 6, 2023

Uh oh!

Apache-HBase commented Jan 6, 2023

Uh oh!

Apache9 commented Jan 8, 2023

Uh oh!

Apache9 commented Jan 19, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants