Skip to content

TEZ-4750: Relax yarn nodemanager health checker in tez_run_example.sh - #533

Merged
abstractdog merged 1 commit into
apache:masterfrom
abstractdog:TEZ-4750
Aug 19, 2026
Merged

TEZ-4750: Relax yarn nodemanager health checker in tez_run_example.sh#533
abstractdog merged 1 commit into
apache:masterfrom
abstractdog:TEZ-4750

Conversation

@abstractdog

Copy link
Copy Markdown
Contributor

No description provided.

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec3m 48sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+0 🆗shelldocs0m 0sShelldocs was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
-1 ❌test4tests0m 0sThe patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 💚mvninstall4m 47smaster passed
+1 💚compile4m 4smaster passed
_ Patch Compile Tests _
+1 💚mvninstall3m 42sthe patch passed
+1 💚codespell1m 37sNo new issues.
+1 💚compile4m 0sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚shellcheck0m 0sNo new issues.
_ Other Tests _
-1 ❌unit71m 40s/patch-unit-root.txtroot in the patch passed.
+1 💚asflicense0m 54sThe patch does not generate ASF License warnings.
95m 51s
ReasonTests
Failed junit teststez.test.TestAMRecovery
SubsystemReport/Notes
DockerClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-533/1/artifact/out/Dockerfile
Optional Testsdupname compile unit asflicense codespell detsecrets shellcheck shelldocs
unameLinux 5fd2057bc787 5.15.0-186-generic #196-Ubuntu SMP Sat Jun 20 16:09:34 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitytez-personality.sh
git revisionmaster / d348bf1
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-533/1/testReport/
Max. process+thread count1515 (vs. ulimit of 5500)
modulesC: . U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-533/1/console
versionsgit=2.43.0 maven=3.9.15 codespell=2.4.1 shellcheck=0.11.0
Powered byApache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

</property>
<property>
<name>yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage</name>
<value>99.0</value>

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

By default the value is 90 as per, any particular reason to chase extra 9%
https://hadoop.apache.org/docs/r3.5.0/hadoop-yarn/hadoop-yarn-common/yarn-default.xml

@abstractdogabstractdogAug 18, 2026

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, it's because I bump into it all the time: I believe other developers like me are also fine with spending most of their time with 90+ percent full disk without bumping into issues like this, 99% is the upper limit I consider serious (at that level, my laptop also starts to warn about disk space)

(bumping into it all the time, I mean: TEZ-4366, TEZ-4123)

@Aggarwal-RaghavAggarwal-Raghav left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please rerun the CI as there are UT failures .

@abstractdog

Copy link
Copy Markdown
ContributorAuthor

Please rerun the CI as there are UT failures .

sure, also created TEZ-4751 about TestAMRecovery

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 12sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+0 🆗shelldocs0m 0sShelldocs was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
-1 ❌test4tests0m 0sThe patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 💚mvninstall4m 48smaster passed
+1 💚compile4m 1smaster passed
_ Patch Compile Tests _
+1 💚mvninstall3m 45sthe patch passed
+1 💚codespell1m 36sNo new issues.
+1 💚compile4m 2sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚shellcheck0m 0sNo new issues.
_ Other Tests _
-1 ❌unit76m 35s/patch-unit-root.txtroot in the patch passed.
+1 💚asflicense0m 54sThe patch does not generate ASF License warnings.
97m 17s
ReasonTests
Failed junit teststez.dag.app.TestSpeculation
SubsystemReport/Notes
DockerClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-533/2/artifact/out/Dockerfile
Optional Testsdupname compile unit asflicense codespell detsecrets shellcheck shelldocs
unameLinux 4a501f5513a7 5.15.0-186-generic #196-Ubuntu SMP Sat Jun 20 16:09:34 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitytez-personality.sh
git revisionmaster / 64e79ee
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-533/2/testReport/
Max. process+thread count1492 (vs. ulimit of 5500)
modulesC: . U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-533/2/console
versionsgit=2.43.0 maven=3.9.15 codespell=2.4.1 shellcheck=0.11.0
Powered byApache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor

tez.dag.app.TestSpeculation is flaky as well, it failed for my PR also, yesterday

@abstractdog

Copy link
Copy Markdown
ContributorAuthor

tez.dag.app.TestSpeculation is flaky as well, it failed for my PR also, yesterday

sigh, yes, I created TEZ-4752 about that

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec4m 19sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+0 🆗shelldocs0m 0sShelldocs was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
-1 ❌test4tests0m 0sThe patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 💚mvninstall4m 49smaster passed
+1 💚compile4m 3smaster passed
_ Patch Compile Tests _
+1 💚mvninstall3m 47sthe patch passed
+1 💚codespell1m 38sNo new issues.
+1 💚compile4m 1sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚shellcheck0m 0sNo new issues.
_ Other Tests _
+1 💚unit75m 8sroot in the patch passed.
+1 💚asflicense0m 54sThe patch does not generate ASF License warnings.
99m 59s
SubsystemReport/Notes
DockerClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-533/3/artifact/out/Dockerfile
Optional Testsdupname compile unit asflicense codespell detsecrets shellcheck shelldocs
unameLinux 56ed8e978bca 5.15.0-186-generic #196-Ubuntu SMP Sat Jun 20 16:09:34 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitytez-personality.sh
git revisionmaster / 64e79ee
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-533/3/testReport/
Max. process+thread count1537 (vs. ulimit of 5500)
modulesC: . U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-533/3/console
versionsgit=2.43.0 maven=3.9.15 codespell=2.4.1 shellcheck=0.11.0
Powered byApache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@abstractdog
abstractdog merged commit c2fca35 into apache:masterAug 19, 2026
6 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@abstractdog@tez-yetus@Aggarwal-Raghav@ayushtkn