Skip to content

TEZ-4357: Report url to logs in case of fetcher connection failure - #169

Merged
ayushtkn merged 1 commit into
apache:masterfrom
abstractdog:TEZ-4357
Jan 25, 2024
Merged

TEZ-4357: Report url to logs in case of fetcher connection failure#169
ayushtkn merged 1 commit into
apache:masterfrom
abstractdog:TEZ-4357

Conversation

@abstractdog

Copy link
Copy Markdown
Contributor

No description provided.

@tez-yetus

This comment was marked as outdated.

"Fetch Failure while connecting from %s to: %s:%d, attempt: %sInforming ShuffleManager: ",
localHostname, host, port, firstAttempt), e);
"Fetch Failure while connecting from %s to: %s:%d, attempt: %s, url: %s Informing ShuffleManager",
localHostname, host, port, firstAttempt, baseURI.toString()), e);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to call toString() here, %s can take any type & the output is always string right? BTW why aren't we using Logger format here like {} instead of String.format?

@abstractdogabstractdogNov 17, 2022

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

using {} format would make sense but we cannot mix the format arguments and exception in any of the LOG.warn methods
toString can be removed yeah

UPDATE: oh wait, just checked, last argument of vararg is a throwable candidate, so we can use formats here|

 public void warn(String format, Object... argArray) {
if (logger.isEnabledFor(Level.WARN)) {
FormattingTuple ft = MessageFormatter.arrayFormat(format, argArray);
logger.log(FQCN, Level.WARN, ft.getMessage(), ft.getThrowable());
}
}

@abstractdog
abstractdogforce-pushed the TEZ-4357 branch 2 times, most recently from 8fd6d0f to 36559dfCompareNovember 17, 2022 10:17
@abstractdog

Copy link
Copy Markdown
ContributorAuthor

addressed comments + added a "FETCH_FAILURE" log prefix which is common for Fetcher and FetcherOrderedGrouped, so makes it easier to scan through app logs for fetch failures

@tez-yetus

This comment was marked as outdated.

@tez-yetus

This comment was marked as outdated.

@tez-yetus

This comment was marked as outdated.

@ayushtknayushtkn left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec12m 22sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚@author0m 0sThe patch does not contain any @author tags.
-1 ❌test4tests0m 0sThe patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 💚mvninstall12m 24smaster passed
+1 💚compile0m 21smaster passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 💚compile0m 17smaster passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 💚checkstyle1m 0smaster passed
+1 💚javadoc0m 28smaster passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 💚javadoc0m 17smaster passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+0 🆗spotbugs1m 9sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs1m 8smaster passed
_ Patch Compile Tests _
+1 💚mvninstall0m 15sthe patch passed
+1 💚compile0m 13sthe patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 💚javac0m 13sthe patch passed
+1 💚compile0m 11sthe patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 💚javac0m 11sthe patch passed
+1 💚checkstyle0m 8sthe patch passed
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚javadoc0m 11sthe patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 💚javadoc0m 11sthe patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 💚findbugs0m 36sthe patch passed
_ Other Tests _
+1 💚unit4m 24stez-runtime-library in the patch passed.
+1 💚asflicense0m 15sThe patch does not generate ASF License warnings.
35m 18s
SubsystemReport/Notes
DockerClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-169/5/artifact/out/Dockerfile
GITHUB PR#169
JIRA IssueTEZ-4357
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile
unameLinux 9b696cbacbb3 5.15.0-88-generic #98-Ubuntu SMP Mon Oct 2 15:18:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/tez.sh
git revisionmaster / d8dda5c
Default JavaPrivate Build-1.8.0_392-8u392-ga-1~22.04-b08
Multi-JDK versions/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_392-8u392-ga-1~22.04-b08
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-169/5/testReport/
Max. process+thread count2099 (vs. ulimit of 5500)
modulesC: tez-runtime-library U: tez-runtime-library
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-169/5/console
versionsgit=2.34.1 maven=3.6.3 findbugs=3.0.1
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@ayushtkn
ayushtkn merged commit cafa4b3 into apache:masterJan 25, 2024
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@abstractdog@tez-yetus@ayushtkn