Skip to content

HBASE-27627 Improve efficiency of SnapshotHFileCleaner - #5017

Merged
petersomogyi merged 1 commit into
apache:branch-2.4from
petersomogyi:HBASE-27627
Feb 9, 2023
Merged

HBASE-27627 Improve efficiency of SnapshotHFileCleaner#5017
petersomogyi merged 1 commit into
apache:branch-2.4from
petersomogyi:HBASE-27627

Conversation

@petersomogyi

Copy link
Copy Markdown
Contributor

Backport of HBASE-25899

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 57sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ branch-2.4 Compile Tests _
+1 💚mvninstall3m 41sbranch-2.4 passed
+1 💚compile2m 26sbranch-2.4 passed
+1 💚checkstyle0m 35sbranch-2.4 passed
-1 ❌spotless0m 9sbranch has 19 errors when running spotless:check, run spotless:apply to fix.
+1 💚spotbugs1m 29sbranch-2.4 passed
_ Patch Compile Tests _
+1 💚mvninstall3m 2sthe patch passed
+1 💚compile2m 27sthe patch passed
+1 💚javac2m 27sthe patch passed
+1 💚checkstyle0m 33sthe patch passed
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚hadoopcheck23m 36sPatch does not cause any errors with Hadoop 2.10.2 or 3.1.4 3.2.4 3.3.4.
-1 ❌spotless0m 8spatch has 19 errors when running spotless:check, run spotless:apply to fix.
+1 💚spotbugs1m 30sthe patch passed
_ Other Tests _
+1 💚asflicense0m 9sThe patch does not generate ASF License warnings.
42m 28s
SubsystemReport/Notes
DockerClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5017/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#5017
Optional Testsdupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
unameLinux bec3dda3d662 5.4.0-1092-aws #100~18.04.2-Ubuntu SMP Tue Nov 29 08:39:52 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / 447846d
Default JavaEclipse Adoptium-11.0.17+8
spotlesshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5017/1/artifact/yetus-general-check/output/branch-spotless.txt
spotlesshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5017/1/artifact/yetus-general-check/output/patch-spotless.txt
Max. process+thread count86 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5017/1/console
versionsgit=2.34.1 maven=3.8.6 spotbugs=4.7.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@petersomogyi

Copy link
Copy Markdown
ContributorAuthor

The spotless fix was merged in HBASE-27628#5018

@taklwutaklwu left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM and 99% same as 76d56bc, only line were conflict because branch-2.4 does not have the check of if (!ArrayUtils.isEmpty(snapshotsInProgress))

can we retrigger the precommit ?

@petersomogyi

Copy link
Copy Markdown
ContributorAuthor

can we retrigger the precommit ?

Precommit is running but it is not linked somehow. I've seen GitHub rate limit problems earlier on Jenkins.
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5017/

The reported spotless violation was merged in HBASE #5018.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 40sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2.4 Compile Tests _
+1 💚mvninstall2m 44sbranch-2.4 passed
+1 💚compile0m 32sbranch-2.4 passed
+1 💚shadedjars4m 34sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 21sbranch-2.4 passed
_ Patch Compile Tests _
+1 💚mvninstall2m 15sthe patch passed
+1 💚compile0m 31sthe patch passed
+1 💚javac0m 31sthe patch passed
+1 💚shadedjars4m 34spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 20sthe patch passed
_ Other Tests _
+1 💚unit165m 49shbase-server in the patch passed.
186m 23s
SubsystemReport/Notes
DockerClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5017/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR#5017
Optional Testsjavac javadoc unit shadedjars compile
unameLinux a4b81df6d8ab 5.4.0-1094-aws #102~18.04.1-Ubuntu SMP Tue Jan 10 21:07:03 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / 447846d
Default JavaTemurin-1.8.0_352-b08
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5017/1/testReport/
Max. process+thread count2725 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5017/1/console
versionsgit=2.34.1 maven=3.8.6
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 13sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2.4 Compile Tests _
+1 💚mvninstall3m 49sbranch-2.4 passed
+1 💚compile0m 47sbranch-2.4 passed
+1 💚shadedjars5m 40sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 27sbranch-2.4 passed
_ Patch Compile Tests _
+1 💚mvninstall3m 23sthe patch passed
+1 💚compile0m 58sthe patch passed
+1 💚javac0m 58sthe patch passed
+1 💚shadedjars5m 39spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 28sthe patch passed
_ Other Tests _
+1 💚unit185m 40shbase-server in the patch passed.
212m 35s
SubsystemReport/Notes
DockerClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5017/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#5017
Optional Testsjavac javadoc unit shadedjars compile
unameLinux 0a1d5cbb3425 5.4.0-135-generic #152-Ubuntu SMP Wed Nov 23 20:19:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / 447846d
Default JavaEclipse Adoptium-11.0.17+8
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5017/1/testReport/
Max. process+thread count2666 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5017/1/console
versionsgit=2.34.1 maven=3.8.6
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@petersomogyi
petersomogyi merged commit 1843cef into apache:branch-2.4Feb 9, 2023
@petersomogyi
petersomogyi deleted the HBASE-27627 branch February 9, 2023 18:08
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@petersomogyi@Apache-HBase@taklwu