Skip to content

HBASE-28972 Limit the number of retries in FanOutOneBlockAsyncDFSOutp… - #6453

Merged
Apache9 merged 2 commits into
apache:masterfrom
Apache9:HBASE-28972
Nov 11, 2024
Merged

HBASE-28972 Limit the number of retries in FanOutOneBlockAsyncDFSOutp…#6453
Apache9 merged 2 commits into
apache:masterfrom
Apache9:HBASE-28972

Conversation

@Apache9

Copy link
Copy Markdown
Contributor

…utHelper.completeFile

@Apache9Apache9 self-assigned this Nov 8, 2024
@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache9
Apache9 requested a review from stotyNovember 11, 2024 02:16
HdfsFileStatus stat) {
for (int retry = 0;; retry++) {
HdfsFileStatus stat) throws IOException {
int maxRetries = client.getConf().getBlockWriteLocateFollowingInitialDelayMs();

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The method name refers to milliseconds, which makes this sound we're using a temporal value for the number of retries.

Is this really the config option we want here ? Is the Hadoop getter misnamed ?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, should be a typo, there is a retry number config.

Let me fix.

@stotystoty left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 LGTM (pending tests)

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec2m 38sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗codespell0m 0scodespell was not available.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
_ master Compile Tests _
+0 🆗mvndep0m 15sMaven dependency ordering for branch
+1 💚mvninstall2m 55smaster passed
+1 💚compile7m 36smaster passed
+1 💚checkstyle1m 8smaster passed
+1 💚spotbugs7m 28smaster passed
+1 💚spotless0m 42sbranch has no errors when running spotless:check.
_ Patch Compile Tests _
+0 🆗mvndep0m 14sMaven dependency ordering for patch
+1 💚mvninstall2m 46sthe patch passed
+1 💚compile7m 37sthe patch passed
+1 💚javac7m 37sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle1m 10sthe patch passed
+1 💚xmllint0m 0sNo new issues.
+1 💚spotbugs7m 39sthe patch passed
+1 💚hadoopcheck10m 42sPatch does not cause any errors with Hadoop 3.3.6 3.4.0.
+1 💚spotless0m 44spatch has no errors when running spotless:check.
_ Other Tests _
+1 💚asflicense0m 20sThe patch does not generate ASF License warnings.
60m 57s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6453/3/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#6453
Optional Testsdupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless xmllint
unameLinux d9e2d585b098 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / 5875c93
Default JavaEclipse Adoptium-17.0.11+9
Max. process+thread count191 (vs. ulimit of 30000)
modulesC: hbase-asyncfs . U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6453/3/console
versionsgit=2.34.1 maven=3.9.8 spotbugs=4.7.3 xmllint=20913
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 42sDocker mode activated.
-0 ⚠️yetus0m 3sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+0 🆗mvndep0m 15sMaven dependency ordering for branch
+1 💚mvninstall3m 8smaster passed
+1 💚compile2m 7smaster passed
+1 💚javadoc2m 21smaster passed
+1 💚shadedjars5m 23sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗mvndep0m 16sMaven dependency ordering for patch
+1 💚mvninstall3m 5sthe patch passed
+1 💚compile2m 9sthe patch passed
+1 💚javac2m 9sthe patch passed
+1 💚javadoc2m 20sthe patch passed
+1 💚shadedjars5m 25spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 ❌unit298m 6s/patch-unit-root.txtroot in the patch failed.
331m 51s
SubsystemReport/Notes
DockerClientAPI=1.47 ServerAPI=1.47 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6453/3/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR#6453
Optional Testsjavac javadoc unit compile shadedjars
unameLinux 010177dbf731 5.4.0-195-generic #215-Ubuntu SMP Fri Aug 2 18:28:05 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / 5875c93
Default JavaEclipse Adoptium-17.0.11+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6453/3/testReport/
Max. process+thread count8087 (vs. ulimit of 30000)
modulesC: hbase-asyncfs . U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6453/3/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache9
Apache9 merged commit 05bd810 into apache:masterNov 11, 2024
Apache9 added a commit that referenced this pull request Nov 11, 2024
…utHelper.completeFile (#6453)
Signed-off-by: Istvan Toth <stoty@apache.org>
(cherry picked from commit 05bd810)
Apache9 added a commit that referenced this pull request Nov 11, 2024
…utHelper.completeFile (#6453)
Signed-off-by: Istvan Toth <stoty@apache.org>
(cherry picked from commit 05bd810)
Apache9 added a commit that referenced this pull request Nov 11, 2024
…utHelper.completeFile (#6453)
Signed-off-by: Istvan Toth <stoty@apache.org>
(cherry picked from commit 05bd810)
Apache9 added a commit that referenced this pull request Nov 11, 2024
…utHelper.completeFile (#6453)
Signed-off-by: Istvan Toth <stoty@apache.org>
(cherry picked from commit 05bd810)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Apache9@Apache-HBase@stoty