Skip to content

HBASE-22540 [Memstore] Correct counters in MemStoreChunkPool - #288

Merged
Reidddddd merged 2 commits into
apache:branch-1from
Reidddddd:HBASE-22540
Jun 5, 2019
Merged

HBASE-22540 [Memstore] Correct counters in MemStoreChunkPool#288
Reidddddd merged 2 commits into
apache:branch-1from
Reidddddd:HBASE-22540

Conversation

@Reidddddd

Copy link
Copy Markdown
Contributor

Add a new counter gotChunkCount for calculating reuse ratio.
Correct createdChunkCount initial count.
Set logStats INFO level, every 5 minutes which is not very chatty, and it is useful information.

@apurtellapurtell left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

private static final int statThreadPeriod = 60 * 5;
private AtomicLong createdChunkCount = new AtomicLong();
private AtomicLong reusedChunkCount = new AtomicLong();
private AtomicLong gotChunkCount = new AtomicLong();

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Super minor nit.
"has" instead of "got" is more common, in our code base and elsewhere

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a counter for the number of method Chunk#getChunk get called. Agree, "got" is not good. What about requestedChunkCount.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec1225Docker mode activated.
_ Prechecks _
0findbugs0Findbugs executables are not available.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-1 Compile Tests _
+1mvninstall127branch-1 passed
+1compile39branch-1 passed with JDK v1.8.0_212
+1compile41branch-1 passed with JDK v1.7.0_222
+1checkstyle79branch-1 passed
+1shadedjars166branch has no errors when building our shaded downstream artifacts.
+1javadoc30branch-1 passed with JDK v1.8.0_212
+1javadoc38branch-1 passed with JDK v1.7.0_222
_ Patch Compile Tests _
+1mvninstall101the patch passed
+1compile40the patch passed with JDK v1.8.0_212
+1javac40the patch passed
+1compile41the patch passed with JDK v1.7.0_222
+1javac41the patch passed
+1checkstyle73hbase-server: The patch generated 0 new + 8 unchanged - 1 fixed = 8 total (was 9)
+1whitespace0The patch has no whitespace issues.
+1shadedjars167patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck222Patch does not cause any errors with Hadoop 2.8.5 2.9.2.
+1javadoc29the patch passed with JDK v1.8.0_212
+1javadoc37the patch passed with JDK v1.7.0_222
_ Other Tests _
-1unit8687hbase-server in the patch failed.
+1asflicense30The patch does not generate ASF License warnings.
11361
ReasonTests
Failed junit testshadoop.hbase.client.TestAdmin1
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-288/1/artifact/out/Dockerfile
GITHUB PR#288
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 4768c83df863 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-1 / e058ffe
mavenversion: Apache Maven 3.0.5
Default Java1.7.0_222
Multi-JDK versions/usr/lib/jvm/java-8-openjdk-amd64:1.8.0_212 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_222
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-288/1/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-288/1/testReport/
Max. process+thread count4389 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-288/1/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Reidddddd

Reidddddd commented Jun 5, 2019

Copy link
Copy Markdown
ContributorAuthor

2nd commit removed the parent thread info from statistics thread which looks like thisStoreOpener-79d229f8aa7a4a99bfbff213cb37ab0f-1-MemStoreChunkPool Statistics, there is only one MemStoreChunkPool instance in RS.

And address one nit, "got" > "requested".

@Reidddddd

Copy link
Copy Markdown
ContributorAuthor

Thank you sir, @apurtell
It's a small improvement, I think it should not occupy too much time of you.
Please allow me S&M, free to revert or ping me if any inappropriate.

@Reidddddd
Reidddddd merged commit c950de7 into apache:branch-1Jun 5, 2019
@ReiddddddReidddddd self-assigned this Jun 5, 2019
@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec790Docker mode activated.
_ Prechecks _
0findbugs1Findbugs executables are not available.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-1 Compile Tests _
+1mvninstall113branch-1 passed
+1compile37branch-1 passed with JDK v1.8.0_212
+1compile42branch-1 passed with JDK v1.7.0_222
+1checkstyle80branch-1 passed
+1shadedjars165branch has no errors when building our shaded downstream artifacts.
+1javadoc30branch-1 passed with JDK v1.8.0_212
+1javadoc38branch-1 passed with JDK v1.7.0_222
_ Patch Compile Tests _
+1mvninstall98the patch passed
+1compile37the patch passed with JDK v1.8.0_212
+1javac37the patch passed
+1compile41the patch passed with JDK v1.7.0_222
+1javac41the patch passed
+1checkstyle81hbase-server: The patch generated 0 new + 8 unchanged - 1 fixed = 8 total (was 9)
+1whitespace0The patch has no whitespace issues.
+1shadedjars168patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck198Patch does not cause any errors with Hadoop 2.8.5 2.9.2.
+1javadoc28the patch passed with JDK v1.8.0_212
+1javadoc37the patch passed with JDK v1.7.0_222
_ Other Tests _
+1unit6246hbase-server in the patch passed.
+1asflicense25The patch does not generate ASF License warnings.
8434
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-288/2/artifact/out/Dockerfile
GITHUB PR#288
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 114f8c111ed4 4.4.0-131-generic #157~14.04.1-Ubuntu SMP Fri Jul 13 08:53:17 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-1 / 749d58f
mavenversion: Apache Maven 3.0.5
Default Java1.7.0_222
Multi-JDK versions/usr/lib/jvm/java-8-openjdk-amd64:1.8.0_212 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_222
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-288/2/testReport/
Max. process+thread count3784 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-288/2/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Reidddddd@Apache-HBase@apurtell