Skip to content

TEZ-4501: Fix TestLocalMode timeouts - #300

Merged
ayushtkn merged 1 commit into
apache:masterfrom
abstractdog:TEZ-4501
Jan 25, 2024
Merged

TEZ-4501: Fix TestLocalMode timeouts#300
ayushtkn merged 1 commit into
apache:masterfrom
abstractdog:TEZ-4501

Conversation

@abstractdog

Copy link
Copy Markdown
Contributor

No description provided.

@abstractdog

Copy link
Copy Markdown
ContributorAuthor

can you please take a look at this @rbalamohan , @bikassaha ? simple fix in AsyncDispatcher

@tez-yetus

This comment was marked as outdated.

Comment on lines +379 to +385
// this is needed because in serviceStop we're looping to drain the rest of the events and checking !drained
// in that case, an interruption here would lead to an empty queue with drained=false, leading to
// a useless loop with a timeout (this can even cause unit test timeouts)
drained = eventQueue.isEmpty();
LOG.info(
"Setting drained to {} due to interruption while putting a new event, stopped: {}, blockNewEvents: {}",
drained, stopped, blockNewEvents);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why in serviceStop we don't directly check eventQueue.isEmpty?

@abstractdogabstractdogJul 20, 2023

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

eh, right, let me try that :)
NOTE: even if it works, I'll have to check the special meaning of having a separate boolean

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tried to look out for reasons for separate boolean, but didn't find anything reasonable, maybe the coding style then...

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec13m 21sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚@author0m 0sThe patch does not contain any @author tags.
-1 ❌test4tests0m 0sThe patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 💚mvninstall12m 46smaster passed
+1 💚compile0m 13smaster passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 💚compile0m 13smaster passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 💚checkstyle1m 12smaster passed
+1 💚javadoc0m 26smaster passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 💚javadoc0m 14smaster passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+0 🆗spotbugs0m 57sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs0m 55smaster passed
_ Patch Compile Tests _
+1 💚mvninstall0m 11sthe patch passed
+1 💚compile0m 10sthe patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 💚javac0m 10sthe patch passed
+1 💚compile0m 8sthe patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 💚javac0m 8sthe patch passed
+1 💚checkstyle0m 6sthe patch passed
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚javadoc0m 7sthe patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 💚javadoc0m 7sthe patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 💚findbugs0m 26sthe patch passed
_ Other Tests _
+1 💚unit0m 26stez-common in the patch passed.
+1 💚asflicense0m 14sThe patch does not generate ASF License warnings.
31m 53s
SubsystemReport/Notes
DockerClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-300/2/artifact/out/Dockerfile
GITHUB PR#300
JIRA IssueTEZ-4501
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile
unameLinux 6f122039705c 5.15.0-88-generic #98-Ubuntu SMP Mon Oct 2 15:18:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/tez.sh
git revisionmaster / d8dda5c
Default JavaPrivate Build-1.8.0_392-8u392-ga-1~22.04-b08
Multi-JDK versions/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_392-8u392-ga-1~22.04-b08
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-300/2/testReport/
Max. process+thread count101 (vs. ulimit of 5500)
modulesC: tez-common U: tez-common
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-300/2/console
versionsgit=2.34.1 maven=3.6.3 findbugs=3.0.1
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@ayushtknayushtkn left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ayushtkn
ayushtkn merged commit 5a2df54 into apache:masterJan 25, 2024
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@abstractdog@tez-yetus@ayushtkn