Skip to content

HBASE-28845 table level wal appendSize and replication source metrics… - #6259

Closed
terrytlu wants to merge 1 commit into
apache:masterfrom
terrytlu:master-HBASE-28845
Closed

HBASE-28845 table level wal appendSize and replication source metrics…#6259
terrytlu wants to merge 1 commit into
apache:masterfrom
terrytlu:master-HBASE-28845

Conversation

@terrytlu

Copy link
Copy Markdown
Contributor

Found 2 metrics did not display in the /jmx http interface response, table level wal appendSize and table level replication source.

I suspect it's because the metric name contains a colon :
image

image

after modify the table name string to "Namespace_$namespace_table_$table, the metric really display correctly in the /jmx response

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@terrytlu
terrytluforce-pushed the master-HBASE-28845 branch 2 times, most recently from baf8457 to 3058da9CompareSeptember 18, 2024 06:20
@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 51sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗codespell0m 1scodespell was not available.
+0 🆗detsecrets0m 1sdetect-secrets was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
_ master Compile Tests _
+0 🆗mvndep0m 9sMaven dependency ordering for branch
+1 💚mvninstall3m 52smaster passed
+1 💚compile5m 11smaster passed
+1 💚checkstyle1m 16smaster passed
+1 💚spotbugs2m 52smaster passed
+1 💚spotless0m 45sbranch has no errors when running spotless:check.
_ Patch Compile Tests _
+0 🆗mvndep0m 11sMaven dependency ordering for patch
+1 💚mvninstall2m 59sthe patch passed
+1 💚compile4m 4sthe patch passed
+1 💚javac4m 4sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle1m 5sthe patch passed
+1 💚spotbugs2m 53sthe patch passed
+1 💚hadoopcheck10m 42sPatch does not cause any errors with Hadoop 3.3.6 3.4.0.
+1 💚spotless0m 44spatch has no errors when running spotless:check.
_ Other Tests _
+1 💚asflicense0m 31sThe patch does not generate ASF License warnings.
45m 19s
SubsystemReport/Notes
DockerClientAPI=1.47 ServerAPI=1.47 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6259/6/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#6259
Optional Testsdupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
unameLinux b52dedec68e5 5.4.0-195-generic #215-Ubuntu SMP Fri Aug 2 18:28:05 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / 4bbf647
Default JavaEclipse Adoptium-17.0.11+9
Max. process+thread count84 (vs. ulimit of 30000)
modulesC: hbase-common hbase-hadoop-compat hbase-server U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6259/6/console
versionsgit=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 28sDocker mode activated.
-0 ⚠️yetus0m 2sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+0 🆗mvndep0m 11sMaven dependency ordering for branch
+1 💚mvninstall3m 20smaster passed
+1 💚compile1m 32smaster passed
+1 💚javadoc0m 55smaster passed
+1 💚shadedjars5m 46sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗mvndep0m 13sMaven dependency ordering for patch
+1 💚mvninstall3m 8sthe patch passed
+1 💚compile1m 31sthe patch passed
+1 💚javac1m 31sthe patch passed
+1 💚javadoc0m 54sthe patch passed
+1 💚shadedjars5m 43spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 💚unit2m 17shbase-common in the patch passed.
+1 💚unit0m 38shbase-hadoop-compat in the patch passed.
+1 💚unit216m 56shbase-server in the patch passed.
248m 57s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6259/6/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR#6259
Optional Testsjavac javadoc unit compile shadedjars
unameLinux bf08fc2b1819 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / 4bbf647
Default JavaEclipse Adoptium-17.0.11+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6259/6/testReport/
Max. process+thread count5639 (vs. ulimit of 30000)
modulesC: hbase-common hbase-hadoop-compat hbase-server U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6259/6/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

return qualifierAsString;
}

public String getMetricPrefixTableName() {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TableName is IA.Public so we'd better not add new method unless you are sure it is useful for everyone.

// Ideally putIfAbsent is atomic and we don't need a branch check but we still do it to avoid
// expensive string construction for every append.
String metricsKey = String.format("%s.%s", tableName, APPEND_SIZE);
String metricsKey = String.format("%s.%s", tableName.getMetricPrefixTableName(), APPEND_SIZE);

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So the problem here is that, if we have ':' in th table name, it can not be displayed in jmx?

But this is still a breaking change... do we have other ways to obtain the metrics beside jmx? Do these ways also require that there is no ':' in the metrics name?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry for the late reply, I tried jmxterm tool, found we could get this metric correctly 😂 ...
Also found this issue already fixed https://issues.apache.org/jira/browse/HBASE-26745, I will close this issue as it is duplicated and already fixed by HBASE-26745.

@terrytluterrytlu closed this Jan 2, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@terrytlu@Apache-HBase@Apache9