Skip to content

HBASE-27157 Potential race condition in WorkerAssigner - #4577

Merged
Apache9 merged 4 commits into
apache:masterfrom
frostruan:HBASE-27157
Jul 6, 2022
Merged

HBASE-27157 Potential race condition in WorkerAssigner#4577
Apache9 merged 4 commits into
apache:masterfrom
frostruan:HBASE-27157

Conversation

@frostruan

Copy link
Copy Markdown
Contributor

No description provided.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 45sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ master Compile Tests _
+1 💚mvninstall3m 24smaster passed
+1 💚compile2m 49smaster passed
+1 💚checkstyle0m 34smaster passed
+1 💚spotless0m 50sbranch has no errors when running spotless:check.
+1 💚spotbugs1m 37smaster passed
_ Patch Compile Tests _
+1 💚mvninstall3m 3sthe patch passed
+1 💚compile2m 45sthe patch passed
+1 💚javac2m 45sthe patch passed
+1 💚checkstyle0m 32sthe patch passed
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚hadoopcheck17m 15sPatch does not cause any errors with Hadoop 3.1.2 3.2.2 3.3.1.
+1 💚spotless1m 0spatch has no errors when running spotless:check.
+1 💚spotbugs1m 58sthe patch passed
_ Other Tests _
+1 💚asflicense0m 11sThe patch does not generate ASF License warnings.
44m 17s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#4577
Optional Testsdupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
unameLinux e644e5e45c3e 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / c0e7e98
Default JavaAdoptOpenJDK-1.8.0_282-b08
Max. process+thread count64 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/1/console
versionsgit=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 45sDocker mode activated.
-0 ⚠️yetus0m 3sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 💚mvninstall3m 22smaster passed
+1 💚compile0m 55smaster passed
+1 💚shadedjars4m 22sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 31smaster passed
_ Patch Compile Tests _
+1 💚mvninstall3m 12sthe patch passed
+1 💚compile0m 53sthe patch passed
+1 💚javac0m 53sthe patch passed
+1 💚shadedjars4m 18spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 26sthe patch passed
_ Other Tests _
+1 💚unit216m 8shbase-server in the patch passed.
237m 16s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR#4577
Optional Testsjavac javadoc unit shadedjars compile
unameLinux 01c29b468864 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / c0e7e98
Default JavaAdoptOpenJDK-1.8.0_282-b08
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/1/testReport/
Max. process+thread count2353 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/1/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 9sDocker mode activated.
-0 ⚠️yetus0m 4sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 💚mvninstall2m 54smaster passed
+1 💚compile0m 49smaster passed
+1 💚shadedjars3m 49sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 29smaster passed
_ Patch Compile Tests _
+1 💚mvninstall2m 37sthe patch passed
+1 💚compile0m 48sthe patch passed
+1 💚javac0m 48sthe patch passed
+1 💚shadedjars3m 43spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 27sthe patch passed
_ Other Tests _
-1 ❌unit220m 0shbase-server in the patch failed.
238m 41s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#4577
Optional Testsjavac javadoc unit shadedjars compile
unameLinux 85fcf347f18f 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / c0e7e98
Default JavaAdoptOpenJDK-11.0.10+9
unithttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/1/testReport/
Max. process+thread count2487 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/1/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@binlijinbinlijin left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Apache9

Copy link
Copy Markdown
Contributor

Skimmed the code, I think we'd better just fold the suspend method into acquire, and also fold the wake method into release.

I do not see the necessity to expose these methods to upper layer.

@frostruan

Copy link
Copy Markdown
ContributorAuthor

Good idea. I'll fix this.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 10sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ master Compile Tests _
+1 💚mvninstall2m 37smaster passed
+1 💚compile2m 25smaster passed
+1 💚checkstyle0m 31smaster passed
+1 💚spotless0m 47sbranch has no errors when running spotless:check.
+1 💚spotbugs1m 27smaster passed
_ Patch Compile Tests _
+1 💚mvninstall2m 26sthe patch passed
+1 💚compile2m 18sthe patch passed
+1 💚javac2m 18sthe patch passed
-0 ⚠️checkstyle0m 30shbase-server: The patch generated 3 new + 4 unchanged - 0 fixed = 7 total (was 4)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚hadoopcheck12m 0sPatch does not cause any errors with Hadoop 3.1.2 3.2.2 3.3.1.
-1 ❌spotless0m 36spatch has 39 errors when running spotless:check, run spotless:apply to fix.
+1 💚spotbugs1m 29sthe patch passed
_ Other Tests _
+1 💚asflicense0m 10sThe patch does not generate ASF License warnings.
33m 42s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#4577
Optional Testsdupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
unameLinux 79891a64dc96 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / d447fa0
Default JavaAdoptOpenJDK-1.8.0_282-b08
checkstylehttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/artifact/yetus-general-check/output/diff-checkstyle-hbase-server.txt
spotlesshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/artifact/yetus-general-check/output/patch-spotless.txt
Max. process+thread count69 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/console
versionsgit=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 2sDocker mode activated.
-0 ⚠️yetus0m 3sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 💚mvninstall2m 40smaster passed
+1 💚compile0m 39smaster passed
+1 💚shadedjars3m 40sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 28smaster passed
_ Patch Compile Tests _
+1 💚mvninstall2m 17sthe patch passed
+1 💚compile0m 40sthe patch passed
+1 💚javac0m 40sthe patch passed
+1 💚shadedjars3m 40spatch has no errors when building our shaded downstream artifacts.
-0 ⚠️javadoc0m 25shbase-server generated 1 new + 23 unchanged - 0 fixed = 24 total (was 23)
_ Other Tests _
-1 ❌unit218m 30shbase-server in the patch failed.
235m 48s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR#4577
Optional Testsjavac javadoc unit shadedjars compile
unameLinux 640f9e0ee64c 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / d447fa0
Default JavaAdoptOpenJDK-1.8.0_282-b08
javadochttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/artifact/yetus-jdk8-hadoop3-check/output/diff-javadoc-javadoc-hbase-server.txt
unithttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/testReport/
Max. process+thread count2302 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 22sDocker mode activated.
-0 ⚠️yetus0m 2sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 💚mvninstall3m 20smaster passed
+1 💚compile0m 56smaster passed
+1 💚shadedjars4m 26sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 33smaster passed
_ Patch Compile Tests _
+1 💚mvninstall3m 9sthe patch passed
+1 💚compile1m 1sthe patch passed
+1 💚javac1m 1sthe patch passed
+1 💚shadedjars4m 40spatch has no errors when building our shaded downstream artifacts.
-0 ⚠️javadoc0m 30shbase-server generated 1 new + 96 unchanged - 0 fixed = 97 total (was 96)
_ Other Tests _
-1 ❌unit252m 5shbase-server in the patch failed.
273m 55s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#4577
Optional Testsjavac javadoc unit shadedjars compile
unameLinux b6fff728889f 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / d447fa0
Default JavaAdoptOpenJDK-11.0.10+9
javadochttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/artifact/yetus-jdk11-hadoop3-check/output/diff-javadoc-javadoc-hbase-server.txt
unithttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/testReport/
Max. process+thread count2498 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/2/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

}

@Override
public void serverAdded(ServerName worker) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Better to also add synchronized here?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sorry, miss here. will fix it. Thanks for reminding.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 37sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ master Compile Tests _
+1 💚mvninstall2m 32smaster passed
+1 💚compile2m 14smaster passed
+1 💚checkstyle0m 29smaster passed
+1 💚spotless0m 41sbranch has no errors when running spotless:check.
+1 💚spotbugs1m 13smaster passed
_ Patch Compile Tests _
+1 💚mvninstall2m 8sthe patch passed
+1 💚compile2m 9sthe patch passed
+1 💚javac2m 9sthe patch passed
+1 💚checkstyle0m 27sthe patch passed
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚hadoopcheck11m 50sPatch does not cause any errors with Hadoop 3.1.2 3.2.2 3.3.1.
-1 ❌spotless0m 32spatch has 22 errors when running spotless:check, run spotless:apply to fix.
+1 💚spotbugs1m 18sthe patch passed
_ Other Tests _
+1 💚asflicense0m 9sThe patch does not generate ASF License warnings.
31m 28s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/3/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#4577
Optional Testsdupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
unameLinux 6c6c3202a7f4 5.4.0-1043-aws #45~18.04.1-Ubuntu SMP Fri Apr 9 23:32:25 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / d7f6861
Default JavaAdoptOpenJDK-1.8.0_282-b08
spotlesshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/3/artifact/yetus-general-check/output/patch-spotless.txt
Max. process+thread count64 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/3/console
versionsgit=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 6sDocker mode activated.
-0 ⚠️yetus0m 3sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 💚mvninstall2m 15smaster passed
+1 💚compile0m 39smaster passed
+1 💚shadedjars3m 42sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 25smaster passed
_ Patch Compile Tests _
+1 💚mvninstall2m 11sthe patch passed
+1 💚compile0m 40sthe patch passed
+1 💚javac0m 40sthe patch passed
+1 💚shadedjars3m 38spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 24sthe patch passed
_ Other Tests _
-1 ❌unit214m 34shbase-server in the patch failed.
231m 8s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/3/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR#4577
Optional Testsjavac javadoc unit shadedjars compile
unameLinux ee9f0c6d09b5 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / d7f6861
Default JavaAdoptOpenJDK-1.8.0_282-b08
unithttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/3/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/3/testReport/
Max. process+thread count2393 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/3/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@frostruan

Copy link
Copy Markdown
ContributorAuthor

Some unit tests failed. A little weird. Let me see why.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 6sDocker mode activated.
-0 ⚠️yetus0m 2sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 💚mvninstall2m 54smaster passed
+1 💚compile0m 47smaster passed
+1 💚shadedjars3m 47sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 29smaster passed
_ Patch Compile Tests _
+1 💚mvninstall2m 43sthe patch passed
+1 💚compile0m 49sthe patch passed
+1 💚javac0m 49sthe patch passed
+1 💚shadedjars3m 43spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 27sthe patch passed
_ Other Tests _
-1 ❌unit221m 15shbase-server in the patch failed.
239m 38s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/3/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#4577
Optional Testsjavac javadoc unit shadedjars compile
unameLinux eadb7397dc86 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / d7f6861
Default JavaAdoptOpenJDK-11.0.10+9
unithttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/3/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/3/testReport/
Max. process+thread count2387 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/3/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

.findAny();
worker.ifPresent(name -> currentWorkers.compute(name, (serverName,
availableWorker) -> availableWorker == null ? maxTasks - 1 : availableWorker - 1));
event.suspend();

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should only suspend the procedure when there is no worker available? And I think here we could make the return value as ServerName instead of Optional, and throw ProcedureSuspendedException directly if worker is not available.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok. Let me try. Thanks Duo.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 5sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ master Compile Tests _
+1 💚mvninstall2m 21smaster passed
+1 💚compile2m 22smaster passed
+1 💚checkstyle0m 31smaster passed
+1 💚spotless0m 43sbranch has no errors when running spotless:check.
+1 💚spotbugs1m 22smaster passed
_ Patch Compile Tests _
+1 💚mvninstall2m 24sthe patch passed
+1 💚compile2m 18sthe patch passed
+1 💚javac2m 18sthe patch passed
-0 ⚠️checkstyle0m 31shbase-server: The patch generated 2 new + 4 unchanged - 0 fixed = 6 total (was 4)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚hadoopcheck11m 54sPatch does not cause any errors with Hadoop 3.1.2 3.2.2 3.3.1.
-1 ❌spotless0m 35spatch has 39 errors when running spotless:check, run spotless:apply to fix.
+1 💚spotbugs1m 29sthe patch passed
_ Other Tests _
+1 💚asflicense0m 7sThe patch does not generate ASF License warnings.
32m 52s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/4/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#4577
Optional Testsdupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
unameLinux 26c935df6616 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / 724bf78
Default JavaAdoptOpenJDK-1.8.0_282-b08
checkstylehttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/4/artifact/yetus-general-check/output/diff-checkstyle-hbase-server.txt
spotlesshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/4/artifact/yetus-general-check/output/patch-spotless.txt
Max. process+thread count64 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4577/4/console
versionsgit=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache9
Apache9 merged commit f76d855 into apache:masterJul 6, 2022
Apache9 pushed a commit that referenced this pull request Jul 6, 2022
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit f76d855)
Apache9 added a commit that referenced this pull request Jul 7, 2022
Apache9 added a commit that referenced this pull request Jul 7, 2022
Apache9 added a commit to Apache9/hbase that referenced this pull request Sep 13, 2025
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Apache9 added a commit that referenced this pull request Sep 15, 2025
Close#7299
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Apache9 added a commit that referenced this pull request Sep 15, 2025
Close#7299
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 0d1ff8a)
Apache9 added a commit that referenced this pull request Sep 15, 2025
Close#7299
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 0d1ff8a)
Apache9 added a commit that referenced this pull request Sep 15, 2025
Close#7299
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 0d1ff8a)
anmolnar added a commit that referenced this pull request Feb 10, 2026
…ch (#7706)
* HBASE-29573: Fully load QuotaCache instead of reading individual rows on demand (#7282)
Signed-off by: Ray Mattingly <rmattingly@apache.org>
* HBASE-26974 Introduce a LogRollProcedure (#5408)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-27355 Separate meta read requests from master and client (#7261)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Aman Poonia <aman.poonia.29@gmail.com>
* HBASE-27157 Potential race condition in WorkerAssigner (#4577)
Close#7299
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
* HBASE-29451 Add Docs section describing BucketCache Time based priority (#7289)
Signed-off-by: Dávid Paksy <paksyd@apache.org>
Reviewed-by: Kevin Geiszler <kevin.j.geiszler@gmail.com>
Reviewed-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
* HBASE-29577 Fix NPE from RegionServerRpcQuotaManager when reloading configuration (#7285)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Charles Connell <cconnell@apache.org>
* HBASE-29590 Use hadoop 3.4.2 as default hadooop3 dependency (#7301)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* Modern backup failures can cause backup system to lock up (#7288)
Co-authored-by: Hernan Gelaf-Romer <hgelafromer@hubspot.com>
Signed-off-by: Charles Connell <cconnell@apache.org>
Signed-off-by: Ray Mattingly <rmattingly@apache.org>
* Revert "Modern backup failures can cause backup system to lock up (#7288)" (#7307)
This reverts commit c6a0c3b.
* HBASE-29448 Modern backup failures can cause backup system to lock up (#7308)
Co-authored-by: Hernan Romer <nanug33@gmail.com>
Co-authored-by: Hernan Gelaf-Romer <hgelafromer@hubspot.com>
Signed-off-by: Charles Connell <cconnell@apache.org>
Signed-off-by: Ray Mattingly <rmattingly@apache.org>
* HBASE-29548 Update ApacheDS to 2.0.0.AM27 and ldap-api to 2.1.7 (#7305)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29602 Add -Djava.security.manager=allow to JDK18+ surefire JVM flags (#7315)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
* HBASE-29601 Handle Junit 5 tests in TestCheckTestClasses (#7311)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29592 Add hadoop 3.4.2 in client integration tests (#7306)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29587 Set Test category for TestSnapshotProcedureEarlyExpiration (#7292)
Signed-off-by: Dávid Paksy <paksyd@apache.org>
* HBASE-29610 Add and use String constants for Junit 5 @tag annotations (#7322)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29591 Add hadoop 3.4.2 in hadoop check (#7320)
Signed-off-by: Istvan Toth <stoty@apache.org>
* HBASE-29609 Upgrade checkstyle and Maven checkstyle plugin (#7321)
Signed-off-by: Istvan Toth <stoty@apache.org>
* HBASE-29608 Add test to make sure we do not have copy paste errors in the TAG value (#7324)
Signed-off-by: Istvan Toth <stoty@apache.org>
* HBASE-29608 Addendum remove jdk9+ only API calls
* Revert "HBASE-29609 Upgrade checkstyle and Maven checkstyle plugin (#7321)" (#7332)
This reverts commit 04d48ee.
* HBASE-29612 Remove HBaseTestingUtil.forceChangeTaskLogDir (#7326)
Co-authored-by: Daniel Roudnitsky <droudnitsky1@bloomberg.net>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29576 Replicate HBaseClassTestRule functionality for Junit 5 (#7331)
Signed-off-by: Istvan Toth <stoty@apache.org>
* HBASE-29576 Addendum fix typo Jupitor -> Jupiter
* HBASE-29619 Don't use Java 14+ style case statements in RestoreBackupSystemTableProcedure (#7336)
Signed-off-by: Dávid Paksy <paksyd@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29550 Reflection error in TestRSGroupsKillRS with Java 21 (#7327)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29615 Update Small tests description wrt reuseForks in docs (#7335)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-28440 Add support for using mapreduce sort in HFileOutputFormat2 (#7294)
Co-authored-by: Hernan Gelaf-Romer <hgelafromer@hubspot.com>
Signed-off-by: Ray Mattingly <rmattingly@apache.org>
* HBASE-29623 Blocks for CFs with BlockCache disabled may still get cached on write or compaction (#7339)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
* HBASE-29627 Handle any block cache fetching errors when reading a block in HFileReaderImpl (#7341)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
* HBASE-29614 Remove static final field modification in tests around Unsafe (#7337)
Signed-off-by: Peng Lu <lupeng@apache.org>
* HBASE-29504 [DOC] Document Namespace Auto-Creation During Restore (#7199)
* HBASE-29629 Record the quota user name value on metrics for RpcThrottlingExceptions (#7345)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
* HBASE-29497 Mention HFiles for incremental backups (#7216)
* HBASE-29497 Mention HFiles for incremental backups
* enhance the documention change
* HBASE-29505 [DOC] Document Enhanced Options for Backup Delete Command (#7200)
* HBASE-29505 [DOC] Document Enhanced Options for Backup Delete Command
* update the doc with cautions
* HBASE-29631 Fix race condition in IncrementalTableBackupClient when HFiles are archived during backup (#7346)
Co-authored-by: Hernan Romer <nanug33@gmail.com>
Co-authored-by: skhillon <skhillon@hubspot.com>
Signed-off-by: Ray Mattingly <rmattingly@apache.org>
* HBASE-29626: Refactor server side scan metrics for Coproc hooks (#7340)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
* HBASE-29152 Replace site skin with Reflow2 Maven skin (#7355)
- Replaced the Maven Fluido skin with the newer [Reflow2 Maven skin](https://devacfr.github.io/reflow-maven-skin/doc/reflow-documentation.html#doc-get-started) (Apache Phoenix project uses this). This brings newer Bootstrap (before we used 2.3.2, after 4.x - still not ideal because 5.x is the latest major version but it is an improvement).
- The new skin also brings new more modern look.
- Made sure only local resources are used by the website and the book.html - so no CDN is used - as before. We cannot load remote content as it is banned by central ASF Content Security Policy.
- Fixed our site text customization was not working in project-info-reports.properties file (fixed filename, fixed keys)
Signed-off-by: Istvan Toth <stoty@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
* HBASE-29636 Implement TimedOutTestsListener for junit 5 (#7352)
Signed-off by: Chandra Sekhar K <chandrasekhar188k@gmail.com>
* HBASE-29223 Migrate Master Status Jamon page back to JSP (#6875)
The JSP code is equivalent to the Jamon code, just changed the syntax back to JSP.
Request attributes are used to transfer data between JSP pages.
Tried to preserve the code as much as possible but did some changes:
Sub-templates were usually extracted to separate JSP file (and included with `<jsp:include`), in some case it was extracted as Java method.
Extracted some sections from master page to separate JSP pages:
- Software Attributes
- Warnings
Extracted the long JavaScript from the master page which executes on page load to separate JS file.
Extracted some frequently used static methods to a new util class: `MasterStatusUtil`. Also added unit tests for the static methods in `MasterStatusUtil`. Changed the Master Status page back to `/master.jsp` again. Now made sure that `/master-status` redirects to `/master.jsp`.
Signed-off-by: Istvan Toth <stoty@apache.org>
* HBASE-29647 Restore preWALRestore and postWALRestore coprocessor hooks (#7368)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29637 Implement ResourceCheckerJUnitListener for junit 5 (#7366)
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Istvan Toth <stoty@apache.org>
* HBASE-29604 BackupHFileCleaner uses flawed time based check (#7360)
Adds javadoc mentioning the concurrent usage and thread-safety need of
FileCleanerDelegate#getDeletableFiles.
Fixes a potential thread-safety issue in BackupHFileCleaner: this class
tracks timestamps to block the deletion of recently loaded HFiles that
might be needed for backup purposes. The timestamps were being registered
from inside the concurrent method, which could result in recently added
files getting deleted. Moved the timestamp registration to the postClean
method, which is called only a single time per cleaner run, so recently
loaded HFiles are in fact protected from deletion.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
* HBASE-29650 Upgrade tomcat-jasper to 9.0.110 (#7372)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29653 Upgrade os-maven-plugin to 1.7.1 for RISC-V riscv64 support (#7376)
Signed-off-by: Istvan Toth <stoty@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29659 Replace reflow-default-webdeps to fix site build failure (#7386)
Replace reflow-default-webdeps with separate webjar dependencies because reflow-default-webdeps causes a Maven ERROR in the build log and Yetus build considers the site build to be broken.
Turned off these features in the site skin which we don't need and would require to add more JavaScript:
- highlight.js,
- lightbox.js,
- smooth scrolling.
Improved code blocks style to look good without highlight.js.
Also extracted MathJax.js and fontawesome (needed for RefGuide) versions to Maven properties.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29531 Migrate RegionServer Status Jamon page back to JSP (#7371)
This is the 2/3 step of the Jamon to JSP migration: the Region Server Status page.
Did the migration the same way as for the Master Status page: #6875
Migrated the Jamon code to JSP as close as possible. Extracted the duplicated `formatZKString` method to new java class: ZKStringFormatter and added unit tests.
Changed the Region Server Status page back to `/regionserver.jsp`. Made sure that `/rs-status` redirects to `/regionserver.jsp`.
Extracted the BlockCache inline CSS styles to `hbase.css` file. Also extracted the large BlockCache Hit Ratio periods paging JavaScript code to separate .js file.
Introduced a `src/main/resources/hbase-webapps/common` directory where we can place common JSP files which are used by both Master and RegionServer JSP pages. This required to adjust the JSP compiler Maven Antrun plugin a bit.
Extracted the inline tablesorter initialization JavaScript code to separate file.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29663 TimeBasedLimiters should support dynamic configuration refresh (#7387)
Co-authored-by: Ray Mattingly <rmattingly@hubspot.com>
Signed-off-by: Charles Connell <cconnell@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
* HBASE-29609 Upgrade checkstyle and Maven checkstyle plugin to support Java 14+ syntax
Signed-off-by: Istvan Toth <stoty@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29680 release-util.sh should not hardcode JAVA_HOME for spotless (#7404)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29677: Thread safety in QuotaRefresherChore (#7401)
Signed-off by: Ray Mattingly <rmattingly@apache.org>
* HBASE-29351 Quotas: adaptive wait intervals (#7396)
Co-authored-by: Ray Mattingly <rmattingly@hubspot.com>
Signed-off-by: Charles Connell <cconnell@apache.org>
* HBASE-29679: Suppress stack trace in RpcThrottlingException (#7403)
Signed-off by: Ray Mattingly <rmattingly@apache.org>
* HBASE-29461 Alphabetize the list of variables that can be dynamically configured (#7165)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Istvan Toth <stoty@apache.org>
Reviewed by: Kota-SH <shanmukhaharipriya@gmail.com>
* HBASE-29690 Correct typo in TableReplicationQueueStorage.removeAllQueues exception message (#7420)
Co-authored-by: Daniel Roudnitsky <droudnitsky1@bloomberg.net>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
* HBASE-29651 Bump jruby to 9.4.14.0 to fix multiple CVEs (#7405)
This change fixes the following list of CVEs:
- **CVE-2025-43857**: Fixed in JRuby 9.4.13.0
- **CVE-2025-27219**: Fixed in JRuby 9.4.14.0
- **CVE-2025-27220**: Fixed in JRuby 9.4.14.0
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
* HBASE-27126 Support multi-threads cleaner for MOB files (#5833)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
* HBASE-29662 - Avoid regionDir/tableDir creation as part of .regioninfo file creation in HRegion initialize (#7406)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
* HBASE-29686 Compatible issue of HFileOutputFormat2#configureRemoteCluster (#7415)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Junegunn Choi <junegunn@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Reviewed-by: chaijunjie0101 <1340011734@qq.com>
* HBASE-29667 Correct block priority to SINGLE on the first write to the bucket cache (#7399)
Reviewed by: Kota-SH <shanmukhaharipriya@gmail.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
* [ADDENDUM] HBASE-29223 Fix TestMasterStatusUtil (#7416)
TestMasterStatusUtil.testGetFragmentationInfoTurnedOn failed in master nightly build
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29700 Always close RPC servers in AbstractTestIPC (#7434)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29703 Remove duplicate calls to withNextBlockOnDiskSize (#7440)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-29702 Remove shade plugin from hbase-protocol-shaded (#7438)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
* HBASE-28996: Implement Custom ReplicationEndpoint to Enable WAL Backup to External Storage (#6633)
* HBASE-28996: Implement Custom ReplicationEndpoint to Enable WAL Backup to External Storage
* fix spotless error
* HBASE-29025: Enhance the full backup command to support Continuous Backup (#6710)
* HBASE-29025: Enhance the full backup command to support continuous backup
* add new check for full backup command regards to continuous backup flag
* minor fixes
* HBASE-29210: Introduce Validation for PITR-Critical Backup Deletion (#6848)
Signed-off-by: Andor Molnár <andor@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
* HBASE-29261: Investigate flaw in backup deletion validation of PITR-critical backups and propose correct approach (#6922)
* improve the logic of backup deletion validation of PITR-critical backups
* add new tests
* HBASE-29133: Implement "pitr" Command for Point-in-Time Restore (#6717)
Signed-off-by: Andor Molnar <andor@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
* HBASE-29255: Integrate backup WAL cleanup logic with the delete command (#7007)
* Store bulkload files in daywise bucket as well
* Integrate backup WAL cleanup logic with the delete command
* address the review comments
* address the review comments
* address the review comments
* add more unit tests to cover all cases
* address the review comments
* HBASE-28990 Modify Incremental Backup for Continuous Backup (#6788)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Andor Molnár andor@apache.org
Reviewed by: Kota-SH <shanmukhaharipriya@gmail.com>
Reviewed by: Vinayak Hegde <vinayakph123@gmail.com>
Reviewed by: Kevin Geiszler <kevin.j.geiszler@gmail.com>
* HBASE-29350: Ensure Cleanup of Continuous Backup WALs After Last Backup is Force Deleted (#7090)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org> Reviewed by: Kevin Geiszler <kevin.j.geiszler@gmail.com>
* HBASE-29219 Ignore Empty WAL Files While Consuming Backed-Up WAL Files (#7106)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Reviewed by: Kota-SH <shanmukhaharipriya@gmail.com>
Reviewed by: Kevin Geiszler <kevin.j.geiszler@gmail.com>
* HBASE-29406: Skip Copying Bulkloaded Files to Backup Location in Continuous Backup (#7119)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Reviewed by: Kevin Geiszler <kevin.j.geiszler@gmail.com>
* HBASE-29449 Update backup describe command for continuous backup (#7045)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Reviewed by: Kevin Geiszler <kevin.j.geiszler@gmail.com>
* HBASE-29445 Add Option to Specify Custom Backup Location in PITR (#7153)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
* HBASE-29441 ReplicationSourceShipper should delegate the empty wal entries handling to ReplicationEndpoint (#7145)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
* HBASE-29459 Capture bulkload files only till IncrCommittedWalTs during Incremental Backup (#7166)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Reviewed by: Kevin Geiszler <kevin.j.geiszler@gmail.com>
* HBASE-29310 Handle Bulk Load Operations in Continuous Backup (#7150)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Reviewed by: Kevin Geiszler <kevin.j.geiszler@gmail.com>
* HBASE-28957 spotless apply after rebase
* HBASE-29375 Add Unit Tests for BackupAdminImpl and Improve Test Granularity (#7171)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Reviewed by: Kevin Geiszler <kevin.j.geiszler@gmail.com>
* HBASE-29519 Copy Bulkloaded Files in Continuous Backup (#7222)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Andor Molnár <andor@apache.org>
* HBASE-29524 Handle bulk-loaded HFiles in delete and cleanup process (#7239)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Reviewed by: Kota-SH <shanmukhaharipriya@gmail.com>
* [HBASE-29520] Utilize Backed-up Bulkloaded Files in Incremental Backup (#7246)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
* Revert "HBASE-29310 Handle Bulk Load Operations in Continuous Backup (#7150)" (#7290)
This reverts commit 5ac2a73.
* HBASE-29521: Update Restore Command to Handle Bulkloaded Files (#7300)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Andor Molnár andor@apache.org
Reviewed by: Kevin Geiszler <kevin.j.geiszler@gmail.com>
Reviewed by: Kota-SH <shanmukhaharipriya@gmail.com>
* HBASE-29656 Scan WALs to identify bulkload operations for incremental backup (#7400)
* Scan WALs to identify bulkload operations for incremental backup
* Update unit test
* Info log
* Minor test fix
* Address review comments
* Spotless apply
* Addressed review comment
* spotless
* Remove log
* Retrigger CI
---------
Co-authored-by: Ankit Solomon <asolomon@cloudera.com>
* HBASE-28957. Build + spotless fix
* HBASE-29826: Backup merge is failing because .backup.manifest cannot be found (#7664)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
* HBASE-29825: Incremental backup is failing due to incorrect timezone (#7683)
Change-Id: I8702eca4adc81bad2c18ea4990d09556c9506a34
* HBASE-29687: Extend IntegrationTestBackupRestore to handle continuous backups (#7417)
* Extend IntegrationTestBackup restore into a base class with continuous and non-continuous subclasses
Change-Id: I0c70c417b86c7732b58642a51c75897c35b16cb6
* Add more test cases to runTestSingle for testContinuousBackupRestore
Change-Id: Id043400bf85c7b696bb94bef7cb17ed9dad13334
* Add more test cases for full continuous backup; Change while loop to a for loop
Change-Id: I5ba3276919e6bbdf343c134fa287c69f3854a8a2
* Add delete test case
Change-Id: I25fe484e9c227b7a31cb3768def3c12f66d617ac
* Start adding changes after looking at WIP PR in GitHub
Change-Id: Ie9aece8a3ec55739d618ebf2d2f173a41a116eb6
* Continue adding changes after looking at WIP PR in GitHub
Change-Id: Ie345e623089979f028b13aed13e5ec93e025eff8
* Run mvn spotless:apply
Change-Id: I98eb019dd93dfc8e21b6c730e0e2e60314102724
* Add documentation for runTestMulti and runTestSingle
Change-Id: I4de6fc485aa1ff6e0d8d837e081f8dde20bb3f67
* Update documentation
Change-Id: I911180a8f263f801a5c299d43d0215fe444f22d3
* Enhance delete test case
Change-Id: I78fe59f800cde7c89b11760a49d774c5173a862c
* Update method name to verifyBackupExistenceAfterMerge
Change-Id: Ia150d21f48bb160d9e8bcf922799dc18c0b7c77c
* Address review comments
Change-Id: I9d5b55e36b44367ac8ace08a5859c42b796fefd4
* Add wait for region servers in replication checkpoint to catch up with latest Put timestamp
Change-Id: Ic438ca292bc01827d46725e006bfa0c21bc95f01
* Handle command line arg parsing and conf setup in base class
Change-Id: I9d52e774e84dc389d42aa63315529a2590c40cb8
* Fix spotless error
Change-Id: I27eec25091842376ee7a059a9688c6f5ab385ac7
* Fix checkstyle errors for IntegrationTestBackupRestore.java
Change-Id: I18ab629df4af4e93b42ec1b0d576fd411279c775
* Remove initializeConfFromCommandLine()
Change-Id: Ibc96fd712e384cc3ca5a2c4575e47e65e62c60fa
* Change info log message to debug
Change-Id: Ie8e94ce978836b1314525138726a13641360aae6
* Run mvn spotless:apply
Change-Id: Ibeea379a65e801b60ec5124938b7aa17087025f0
* HBASE-29815: Fix issue where backup integration tests are not running in IntelliJ (#7625)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
---------
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Dávid Paksy <paksyd@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Charles Connell <cconnell@apache.org>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Ray Mattingly <rmattingly@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
Signed-off-by: Istvan Toth <stoty@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Peng Lu <lupeng@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Junegunn Choi <junegunn@apache.org>
Signed-off-by: Andor Molnár <andor@apache.org>
Signed-off-by: Andor Molnar <andor@apache.org>
Signed-off-by: Andor Molnár andor@apache.org
Co-authored-by: Charles Connell <cconnell@apache.org>
Co-authored-by: Ruanhui <32773751+frostruan@users.noreply.github.com>
Co-authored-by: huiruan <huiruan@tencent.com>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Co-authored-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
Co-authored-by: Junegunn Choi <junegunn@apache.org>
Co-authored-by: Istvan Toth <stoty@apache.org>
Co-authored-by: Hernan Romer <nanug33@gmail.com>
Co-authored-by: Hernan Gelaf-Romer <hgelafromer@hubspot.com>
Co-authored-by: Ray Mattingly <rmattingly@apache.org>
Co-authored-by: Sreenivasulu <sreenivasulured2y@gmail.com>
Co-authored-by: Dávid Paksy <paksyd@apache.org>
Co-authored-by: Daniel Roudnitsky <droudnitsky1@bloomberg.net>
Co-authored-by: vinayak hegde <vinayakph123@gmail.com>
Co-authored-by: Siddharth Khillon <sidkhillon24@gmail.com>
Co-authored-by: skhillon <skhillon@hubspot.com>
Co-authored-by: sanjeet006py <36011005+sanjeet006py@users.noreply.github.com>
Co-authored-by: DieterDP <90392398+DieterDP-ng@users.noreply.github.com>
Co-authored-by: gong-flying <106514313+gong-flying@users.noreply.github.com>
Co-authored-by: Ray Mattingly <rmattingly@hubspot.com>
Co-authored-by: Andrew Purtell <apurtell@apache.org>
Co-authored-by: droudnitsky <168442446+droudnitsky@users.noreply.github.com>
Co-authored-by: xavifeds8 <65709700+xavifeds8@users.noreply.github.com>
Co-authored-by: Chandra Sekhar K <chandra@apache.org>
Co-authored-by: gvprathyusha6 <70918688+gvprathyusha6@users.noreply.github.com>
Co-authored-by: mokai <mokai87@126.com>
Co-authored-by: Huginn <63332600+Huginn-kio@users.noreply.github.com>
Co-authored-by: Liu Xiao <42756849+liuxiaocs7@users.noreply.github.com>
Co-authored-by: asolomon <ankitsolomon@gmail.com>
Co-authored-by: Andor Molnár <andor@apache.org>
Co-authored-by: Ankit Solomon <asolomon@cloudera.com>
Co-authored-by: Andor Molnar <andor@cloudera.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@frostruan@Apache-HBase@Apache9@binlijin