Skip to content

TEZ-4643: Enforce speculation configuration to prevent execution on normal tasks. - #424

Open
qijiale76 wants to merge 1 commit into
apache:masterfrom
qijiale76:speculation
Open

TEZ-4643: Enforce speculation configuration to prevent execution on normal tasks.#424
qijiale76 wants to merge 1 commit into
apache:masterfrom
qijiale76:speculation

Conversation

@qijiale76

Copy link
Copy Markdown

A configuration meant to distinguish between slow and normal task attempts is not working correctly. This causes the speculation mechanism to target normal tasks as well, wasting considerable resources. This fix ensures the configuration is enforced, limiting speculative execution to only outlier or slow tasks.

tez.am.legacy.speculative.slowtask.threshold

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec26m 35sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
-1 ❌test4tests0m 0sThe patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 💚mvninstall11m 19smaster passed
+1 💚compile0m 42smaster passed
+1 💚checkstyle1m 7smaster passed
+1 💚javadoc0m 32smaster passed
+0 🆗spotbugs2m 34stez-dag in master has 785 extant spotbugs warnings.
_ Patch Compile Tests _
+1 💚mvninstall0m 30sthe patch passed
+1 💚codespell0m 34sNo new issues.
+1 💚compile0m 28sthe patch passed
+1 💚javac0m 28sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 16sthe patch passed
+1 💚javadoc0m 10sthe patch passed
+1 💚spotbugs1m 51sthe patch passed
_ Other Tests _
+1 💚unit5m 0stez-dag in the patch passed.
+1 💚asflicense0m 13sThe patch does not generate ASF License warnings.
53m 7s
SubsystemReport/Notes
DockerClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-424/1/artifact/out/Dockerfile
GITHUB PR#424
Optional Testsdupname asflicense javac javadoc unit spotbugs checkstyle codespell detsecrets compile
unameLinux 050a0d2686b2 5.15.0-144-generic #157-Ubuntu SMP Mon Jun 16 07:33:10 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-agent/workspace/tez-multibranch_PR-424/src/.yetus/personality.sh
git revisionmaster / 598b1d3
Default JavaUbuntu-21.0.8+9-Ubuntu-0ubuntu124.04.1
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-424/1/testReport/
Max. process+thread count244 (vs. ulimit of 5500)
modulesC: tez-dag U: tez-dag
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-424/1/console
versionsgit=2.43.0 maven=3.8.7 spotbugs=4.9.3 codespell=2.0.0
Powered byApache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@qijiale76@tez-yetus