Skip to content

TEZ-4445: Tez task can get stuck when waiting for all initializers on LogicalIOProcessorRuntimeTask:initialize - #238

Open
zhangbutao wants to merge 1 commit into
apache:masterfrom
zhangbutao:TEZ-4445
Open

TEZ-4445: Tez task can get stuck when waiting for all initializers on LogicalIOProcessorRuntimeTask:initialize#238
zhangbutao wants to merge 1 commit into
apache:masterfrom
zhangbutao:TEZ-4445

Conversation

@zhangbutao

@zhangbutaozhangbutao commented Aug 19, 2022

Copy link
Copy Markdown
Contributor

Please see more information from https://issues.apache.org/jira/browse/TEZ-4445

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec36m 29sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚@author0m 0sThe patch does not contain any @author tags.
-1 ❌test4tests0m 0sThe patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+0 🆗mvndep4m 46sMaven dependency ordering for branch
+1 💚mvninstall11m 5smaster passed
+1 💚compile1m 24smaster passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚compile1m 20smaster passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚checkstyle1m 21smaster passed
+1 💚javadoc1m 32smaster passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚javadoc1m 21smaster passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+0 🆗spotbugs0m 56sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs2m 28smaster passed
_ Patch Compile Tests _
+0 🆗mvndep0m 9sMaven dependency ordering for patch
+1 💚mvninstall0m 41sthe patch passed
+1 💚compile0m 45sthe patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚javac0m 45sthe patch passed
+1 💚compile0m 39sthe patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚javac0m 39sthe patch passed
-0 ⚠️checkstyle0m 11stez-runtime-internals: The patch generated 2 new + 44 unchanged - 0 fixed = 46 total (was 44)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚javadoc0m 41sthe patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚javadoc0m 42sthe patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚findbugs1m 49sthe patch passed
_ Other Tests _
+1 💚unit2m 11stez-api in the patch passed.
+1 💚unit0m 38stez-runtime-internals in the patch passed.
+1 💚asflicense0m 23sThe patch does not generate ASF License warnings.
71m 59s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-238/1/artifact/out/Dockerfile
GITHUB PR#238
JIRA IssueTEZ-4445
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile
unameLinux d9dcff2cc676 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/tez.sh
git revisionmaster / 621a831
Default JavaPrivate Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Multi-JDK versions/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
checkstylehttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-238/1/artifact/out/diff-checkstyle-tez-runtime-internals.txt
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-238/1/testReport/
Max. process+thread count394 (vs. ulimit of 5500)
modulesC: tez-api tez-runtime-internals U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-238/1/console
versionsgit=2.25.1 maven=3.6.3 findbugs=3.0.1
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 21sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚@author0m 0sThe patch does not contain any @author tags.
-1 ❌test4tests0m 0sThe patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+0 🆗mvndep4m 34sMaven dependency ordering for branch
+1 💚mvninstall11m 14smaster passed
+1 💚compile1m 19smaster passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚compile1m 15smaster passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚checkstyle1m 12smaster passed
+1 💚javadoc1m 26smaster passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚javadoc1m 14smaster passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+0 🆗spotbugs1m 1sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs2m 37smaster passed
_ Patch Compile Tests _
+0 🆗mvndep0m 10sMaven dependency ordering for patch
+1 💚mvninstall0m 49sthe patch passed
+1 💚compile0m 55sthe patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚javac0m 55sthe patch passed
+1 💚compile0m 44sthe patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚javac0m 44sthe patch passed
-0 ⚠️checkstyle0m 11stez-runtime-internals: The patch generated 2 new + 44 unchanged - 0 fixed = 46 total (was 44)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚javadoc0m 46sthe patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚javadoc0m 47sthe patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚findbugs2m 6sthe patch passed
_ Other Tests _
+1 💚unit2m 15stez-api in the patch passed.
+1 💚unit0m 39stez-runtime-internals in the patch passed.
+1 💚asflicense0m 21sThe patch does not generate ASF License warnings.
37m 24s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-238/2/artifact/out/Dockerfile
GITHUB PR#238
JIRA IssueTEZ-4445
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile
unameLinux dcfe15ebc92a 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/tez.sh
git revisionmaster / 621a831
Default JavaPrivate Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Multi-JDK versions/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
checkstylehttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-238/2/artifact/out/diff-checkstyle-tez-runtime-internals.txt
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-238/2/testReport/
Max. process+thread count362 (vs. ulimit of 5500)
modulesC: tez-api tez-runtime-internals U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-238/2/console
versionsgit=2.25.1 maven=3.6.3 findbugs=3.0.1
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@zhangbutao

Copy link
Copy Markdown
ContributorAuthor

@abstractdog Would you like to take look? Thanks.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@zhangbutao@tez-yetus