Skip to content

TEZ-4430: Fix tez.task.launch.cmd-opts property not working - #228

Merged
abstractdog merged 1 commit into
apache:masterfrom
ganeshashree:TEZ-4430
Jul 4, 2022
Merged

TEZ-4430: Fix tez.task.launch.cmd-opts property not working#228
abstractdog merged 1 commit into
apache:masterfrom
ganeshashree:TEZ-4430

Conversation

@ganeshashree

Copy link
Copy Markdown
Contributor

Refer https://issues.apache.org/jira/browse/TEZ-4430 for details on this fix.

@tez-yetus

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec17m 12sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1 💚mvninstall16m 9smaster passed
+1 💚compile0m 46smaster passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu0.20.04.1
+1 💚compile0m 43smaster passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
+1 💚checkstyle1m 14smaster passed
+1 💚javadoc0m 55smaster passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu0.20.04.1
+1 💚javadoc0m 46smaster passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
+0 🆗spotbugs1m 36sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs1m 35smaster passed
_ Patch Compile Tests _
+1 💚mvninstall0m 22sthe patch passed
+1 💚compile0m 25sthe patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu0.20.04.1
+1 💚javac0m 25sthe patch passed
+1 💚compile0m 22sthe patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
+1 💚javac0m 22sthe patch passed
+1 💚checkstyle0m 13sthe patch passed
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚javadoc0m 25sthe patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu0.20.04.1
+1 💚javadoc0m 24sthe patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
+1 💚findbugs1m 2sthe patch passed
_ Other Tests _
+1 💚unit2m 12stez-api in the patch passed.
+1 💚asflicense0m 20sThe patch does not generate ASF License warnings.
46m 1s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-228/1/artifact/out/Dockerfile
GITHUB PR#228
JIRA IssueTEZ-4430
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile
unameLinux f8be36681706 4.15.0-175-generic #184-Ubuntu SMP Thu Mar 24 17:48:36 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/tez.sh
git revisionmaster / adcc313
Default JavaPrivate Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
Multi-JDK versions/usr/lib/jvm/java-11-openjdk-amd64:Private Build-11.0.15+10-Ubuntu-0ubuntu0.20.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-228/1/testReport/
Max. process+thread count464 (vs. ulimit of 5500)
modulesC: tez-api U: tez-api
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-228/1/console
versionsgit=2.25.1 maven=3.6.3 findbugs=3.0.1
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@abstractdog

abstractdog commented Jul 3, 2022

Copy link
Copy Markdown
Contributor

thanks @ganeshashree for reporting this one
I think as we're touching this part, we should delete the below method (which has no value, callers can use addLog4jSystemProperties directly, just addLog4jSystemProperties needs to have the null check):

 static void maybeAddDefaultLoggingJavaOpts(String logLevel, List<String> vargs) {
Objects.requireNonNull(vargs);
TezClientUtils.addLog4jSystemProperties(logLevel, vargs);
}

other than that, the attached unit test lines describe the problem really well in my opinion

@abstractdog
abstractdog self-requested a review July 4, 2022 08:29

@abstractdogabstractdog left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM +1
removing the useless method can be taken care of in followup (TEZ-4432)

@abstractdog
abstractdog merged commit 06fff5c into apache:masterJul 4, 2022
asfgit pushed a commit that referenced this pull request Jul 4, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@ganeshashree@tez-yetus@abstractdog