Skip to content

HBASE-28937 Should check if compaction are needed after flushing - #6396

Closed
guluo2016 wants to merge 3 commits into
apache:masterfrom
guluo2016:hbase_HBASE-28937
Closed

HBASE-28937 Should check if compaction are needed after flushing#6396
guluo2016 wants to merge 3 commits into
apache:masterfrom
guluo2016:hbase_HBASE-28937

Conversation

@guluo2016

Copy link
Copy Markdown
Member

Details see: HBASE-28937

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache9

Copy link
Copy Markdown
Contributor

We still use this to flush regions?

IIRC we have introduced a FlushTableProcedure at mastert side and use the proc-v2 framework to trigger flush table operation?

@guluo2016

Copy link
Copy Markdown
MemberAuthor

Yes.

  • When flush procdure is enabled, the flush operation will ultimately execute FlushRegionCallable.doCall()
  • When flush procedure is disabled, the flush operation will ultimately execute FlushTableSubprocedure.RegionFlushTask.call()

@guluo2016

Copy link
Copy Markdown
MemberAuthor

The related tests failed, i will update it later.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 54sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗codespell0m 0scodespell was not available.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
_ master Compile Tests _
+1 💚mvninstall4m 35smaster passed
+1 💚compile3m 58smaster passed
+1 💚checkstyle0m 42smaster passed
+1 💚spotbugs1m 53smaster passed
+1 💚spotless0m 51sbranch has no errors when running spotless:check.
_ Patch Compile Tests _
+1 💚mvninstall4m 1sthe patch passed
+1 💚compile3m 44sthe patch passed
+1 💚javac3m 44sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 44sthe patch passed
+1 💚spotbugs1m 55sthe patch passed
+1 💚hadoopcheck16m 32sPatch does not cause any errors with Hadoop 3.3.6 3.4.0.
+1 💚spotless1m 3spatch has no errors when running spotless:check.
_ Other Tests _
+1 💚asflicense0m 28sThe patch does not generate ASF License warnings.
50m 57s
SubsystemReport/Notes
DockerClientAPI=1.47 ServerAPI=1.47 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6396/3/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#6396
Optional Testsdupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
unameLinux 6c21826c1f22 5.4.0-195-generic #215-Ubuntu SMP Fri Aug 2 18:28:05 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / 7e8ff11
Default JavaEclipse Adoptium-17.0.11+9
Max. process+thread count84 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6396/3/console
versionsgit=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec1m 0sDocker mode activated.
-0 ⚠️yetus0m 3sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 💚mvninstall4m 32smaster passed
+1 💚compile1m 21smaster passed
+1 💚javadoc0m 34smaster passed
+1 💚shadedjars6m 36sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 💚mvninstall3m 55sthe patch passed
+1 💚compile1m 11sthe patch passed
+1 💚javac1m 11sthe patch passed
+1 💚javadoc0m 36sthe patch passed
+1 💚shadedjars6m 26spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 ❌unit229m 9s/patch-unit-hbase-server.txthbase-server in the patch failed.
259m 58s
SubsystemReport/Notes
DockerClientAPI=1.47 ServerAPI=1.47 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6396/3/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR#6396
Optional Testsjavac javadoc unit compile shadedjars
unameLinux 94ab4a98417d 5.4.0-195-generic #215-Ubuntu SMP Fri Aug 2 18:28:05 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / 7e8ff11
Default JavaEclipse Adoptium-17.0.11+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6396/3/testReport/
Max. process+thread count4714 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6396/3/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@guluo2016

Copy link
Copy Markdown
MemberAuthor

Maybe my idea is wrong.
After manually triggering flush, no need for HBase to check internally whether compaction is required , because there are threads within HBase that periodically check it.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@guluo2016@Apache-HBase@Apache9