Skip to content

TEZ-4594. Tez shuffle handler should not shade and relocate javax packages - #385

Merged
jteagles merged 1 commit into
apache:masterfrom
jteagles:TEZ-4594
Jan 16, 2025
Merged

TEZ-4594. Tez shuffle handler should not shade and relocate javax packages#385
jteagles merged 1 commit into
apache:masterfrom
jteagles:TEZ-4594

Conversation

@jteagles

Copy link
Copy Markdown
Contributor

No description provided.

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec21m 39sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚@author0m 0sThe patch does not contain any @author tags.
-1 ❌test4tests0m 0sThe patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 💚mvninstall8m 28smaster passed
+1 💚compile0m 31smaster passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚compile0m 31smaster passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
+1 💚javadoc0m 54smaster passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚javadoc0m 23smaster passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
_ Patch Compile Tests _
+1 💚mvninstall0m 27sthe patch passed
+1 💚compile0m 16sthe patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚javac0m 16sthe patch passed
+1 💚compile0m 15sthe patch passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
+1 💚javac0m 15sthe patch passed
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 1sThe patch has no ill-formed XML file.
+1 💚javadoc0m 9sthe patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚javadoc0m 9sthe patch passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
_ Other Tests _
+1 💚unit2m 55stez-aux-services in the patch passed.
+1 💚asflicense0m 18sThe patch does not generate ASF License warnings.
37m 47s
SubsystemReport/Notes
DockerClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-385/1/artifact/out/Dockerfile
GITHUB PR#385
Optional Testsdupname asflicense javac javadoc unit xml compile
unameLinux 581041a1d4a7 5.15.0-126-generic #136-Ubuntu SMP Wed Nov 6 10:38:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/tez.sh
git revisionmaster / ca15119
Default JavaPrivate Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
Multi-JDK versions/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-385/1/testReport/
Max. process+thread count1552 (vs. ulimit of 5500)
modulesC: tez-plugins/tez-aux-services U: tez-plugins/tez-aux-services
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-385/1/console
versionsgit=2.34.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@abstractdog
abstractdog self-requested a review December 20, 2024 08:54
<exclude>javax.security.**</exclude>
<exclude>javax.net.**</exclude>
</excludes>
</relocation>

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can see the following jars are currently relocated.

  • org/apache/tez/shaded/javax/annotation/
  • org/apache/tez/shaded/javax/xml/bind/

I guess they come from Hadoop. So, "As javax is part of the jdk:" in the ticket might not be correct. Personally, I don't have any objections to exclude javax, though

+- org.apache.hadoop:hadoop-yarn-api:jar:3.3.6:provided
| +- javax.xml.bind:jaxb-api:jar:2.2.11:compile

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@okumin , thanks for the clarification
@abstractdog , @okumin is there any other change needed before +1?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm fine with this change +1

@jteagles
jteagles merged commit 871866e into apache:masterJan 16, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@jteagles@tez-yetus@abstractdog@okumin