Skip to content

TEZ-4633: Set Baseline to JDK 21 and cleanup obsolete JVM configurations - #506

Merged
abstractdog merged 3 commits into
apache:masterfrom
Aggarwal-Raghav:TEZ-4633
Jun 23, 2026
Merged

TEZ-4633: Set Baseline to JDK 21 and cleanup obsolete JVM configurations#506
abstractdog merged 3 commits into
apache:masterfrom
Aggarwal-Raghav:TEZ-4633

Conversation

@Aggarwal-Raghav

@Aggarwal-RaghavAggarwal-Raghav commented Jun 2, 2026•
edited
Loading

Copy link
Copy Markdown
Contributor
  • Get rid of deprecated JVM OPTS flags
  • Removed java8-16, java17 profiles and moved the version specific src directories in tez-javadoc-tools to standard directory

@tez-yetus

tez-yetus commented Jun 2, 2026

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec8m 56sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+0 🆗xmllint0m 0sxmllint was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 2 new or modified test files.
_ master Compile Tests _
+0 🆗mvndep0m 41sMaven dependency ordering for branch
+1 💚mvninstall4m 42smaster passed
+1 💚compile3m 56smaster passed
+1 💚checkstyle2m 18smaster passed
-1 ❌mvnsite0m 45s/branch-mvnsite-tez-api.txttez-api in master failed.
-1 ❌mvnsite1m 57s/branch-mvnsite-root.txtroot in master failed.
+1 💚javadoc2m 56smaster passed
+0 🆗spotbugs1m 20stez-api in master has 92 extant spotbugs warnings.
+0 🆗spotbugs0m 39stez-tools/tez-javadoc-tools in master has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 23sbranch/docs no spotbugs output file (spotbugsXml.xml)
+0 🆗spotbugs7m 24sroot in master has 1054 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 16sMaven dependency ordering for patch
+1 💚mvninstall4m 27sthe patch passed
+1 💚codespell2m 5sNo new issues.
+1 💚compile4m 36sthe patch passed
+1 💚javac4m 36sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 31stez-api: The patch generated 0 new + 80 unchanged - 3 fixed = 80 total (was 83)
-0 ⚠️checkstyle0m 27s/results-checkstyle-tez-tools_tez-javadoc-tools.txttez-tools/tez-javadoc-tools: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚checkstyle0m 20sThe patch passed checkstyle in docs
-0 ⚠️checkstyle1m 12s/results-checkstyle-root.txtroot: The patch generated 1 new + 80 unchanged - 3 fixed = 81 total (was 83)
-1 ❌markdownlint0m 5s/results-markdownlint.txtThe patch generated 1 new + 118 unchanged - 1 fixed = 119 total (was 119)
-1 ❌mvnsite0m 53s/patch-mvnsite-tez-api.txttez-api in the patch failed.
-1 ❌mvnsite1m 58s/patch-mvnsite-root.txtroot in the patch failed.
+1 💚javadoc2m 55sthe patch passed
+0 🆗spotbugs0m 22sdocs has no data from spotbugs
_ Other Tests _
+1 💚unit71m 27sroot in the patch passed.
+1 💚asflicense2m 16sThe patch does not generate ASF License warnings.
145m 43s
SubsystemReport/Notes
DockerClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/1/artifact/out/Dockerfile
Optional Testsdupname compile unit asflicense codespell detsecrets markdownlint mvnsite javac javadoc xmllint spotbugs checkstyle
unameLinux f93f32aa7d49 5.15.0-174-generic #184-Ubuntu SMP Fri Mar 13 18:41:50 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitytez-personality.sh
git revisionmaster / 330fdc8
Default JavaEclipse Adoptium-21.0.11+10-LTS
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/1/testReport/
Max. process+thread count1315 (vs. ulimit of 5500)
modulesC: tez-api tez-tools/tez-javadoc-tools docs . U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/1/console
versionsgit=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1 markdownlint=0.46.0
Powered byApache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@Aggarwal-Raghav

Aggarwal-Raghav commented Jun 3, 2026

Copy link
Copy Markdown
ContributorAuthor

The mvn site issues will be fixed when we move to Hadoop-3.5.0, for more info: #478

@abstractdog

abstractdog commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

The mvn site issues will be fixed when we move to Hadoop-3.5.0, for more info: #478
thanks, I hope we can get hadoop 3.5 upgrade in soon

@abstractdog

abstractdog commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

The mvn site issues will be fixed when we move to Hadoop-3.5.0, for more info: #478

hadoop 3.5.0 upgrade PR is merged, I hope this can move forward now! 🚀

@Aggarwal-Raghav

Aggarwal-Raghav commented Jun 17, 2026

Copy link
Copy Markdown
ContributorAuthor

The mvn site issues will be fixed when we move to Hadoop-3.5.0, for more info: #478

hadoop 3.5.0 upgrade PR is merged, I hope this can move forward now! 🚀

Yes, I'll start rebasing the PR shortly.

@tez-yetus

tez-yetus commented Jun 17, 2026

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec8m 26sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 1sNo case conflicting files found.
+0 🆗detsecrets0m 1sdetect-secrets was not available.
+0 🆗xmllint0m 0sxmllint was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 2 new or modified test files.
_ master Compile Tests _
+0 🆗mvndep0m 43sMaven dependency ordering for branch
+1 💚mvninstall4m 46smaster passed
+1 💚compile3m 56smaster passed
+1 💚checkstyle2m 16smaster passed
+1 💚mvnsite16m 0smaster passed
+1 💚javadoc2m 51smaster passed
+0 🆗spotbugs1m 22stez-api in master has 92 extant spotbugs warnings.
+0 🆗spotbugs0m 36stez-tools/tez-javadoc-tools in master has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 23sbranch/docs no spotbugs output file (spotbugsXml.xml)
+0 🆗spotbugs6m 54sroot in master has 1054 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 14sMaven dependency ordering for patch
+1 💚mvninstall4m 0sthe patch passed
+1 💚codespell1m 48sNo new issues.
+1 💚compile3m 58sthe patch passed
+1 💚javac3m 58sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 28stez-api: The patch generated 0 new + 80 unchanged - 3 fixed = 80 total (was 83)
-0 ⚠️checkstyle0m 22s/results-checkstyle-tez-tools_tez-javadoc-tools.txttez-tools/tez-javadoc-tools: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚checkstyle0m 20sThe patch passed checkstyle in docs
-0 ⚠️checkstyle1m 2s/results-checkstyle-root.txtroot: The patch generated 1 new + 80 unchanged - 3 fixed = 81 total (was 83)
-1 ❌markdownlint0m 5s/results-markdownlint.txtThe patch generated 1 new + 118 unchanged - 1 fixed = 119 total (was 119)
+1 💚mvnsite15m 57sthe patch passed
+1 💚javadoc2m 55sthe patch passed
+0 🆗spotbugs0m 23sdocs has no data from spotbugs
_ Other Tests _
+1 💚unit73m 35sroot in the patch passed.
+1 💚asflicense2m 7sThe patch does not generate ASF License warnings.
167m 57s
SubsystemReport/Notes
DockerClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/2/artifact/out/Dockerfile
Optional Testsdupname compile unit asflicense codespell detsecrets markdownlint mvnsite javac javadoc xmllint spotbugs checkstyle
unameLinux c51aa13ac681 5.15.0-174-generic #184-Ubuntu SMP Fri Mar 13 18:41:50 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitytez-personality.sh
git revisionmaster / 5766cda
Default JavaEclipse Adoptium-21.0.11+10-LTS
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/2/testReport/
Max. process+thread count2103 (vs. ulimit of 5500)
modulesC: tez-api tez-tools/tez-javadoc-tools docs . U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/2/console
versionsgit=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1 markdownlint=0.46.0
Powered byApache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@Aggarwal-Raghav

Aggarwal-Raghav commented Jun 17, 2026

Copy link
Copy Markdown
ContributorAuthor

Missed markdownlint, will fix after the review comments if any

@tez-yetus

tez-yetus commented Jun 22, 2026

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec10m 52sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+0 🆗xmllint0m 1sxmllint was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 2 new or modified test files.
_ master Compile Tests _
+0 🆗mvndep0m 40sMaven dependency ordering for branch
+1 💚mvninstall4m 48smaster passed
+1 💚compile3m 58smaster passed
+1 💚checkstyle2m 13smaster passed
+1 💚mvnsite15m 58smaster passed
+1 💚javadoc2m 57smaster passed
+0 🆗spotbugs1m 21stez-api in master has 92 extant spotbugs warnings.
+0 🆗spotbugs0m 38stez-tools/tez-javadoc-tools in master has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 23sbranch/docs no spotbugs output file (spotbugsXml.xml)
+0 🆗spotbugs6m 53sroot in master has 1054 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 14sMaven dependency ordering for patch
+1 💚mvninstall4m 4sthe patch passed
+1 💚codespell1m 47sNo new issues.
+1 💚compile3m 56sthe patch passed
+1 💚javac3m 56sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 29stez-api: The patch generated 0 new + 80 unchanged - 3 fixed = 80 total (was 83)
-0 ⚠️checkstyle0m 22s/results-checkstyle-tez-tools_tez-javadoc-tools.txttez-tools/tez-javadoc-tools: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚checkstyle0m 20sThe patch passed checkstyle in docs
-0 ⚠️checkstyle1m 1s/results-checkstyle-root.txtroot: The patch generated 1 new + 80 unchanged - 3 fixed = 81 total (was 83)
+1 💚markdownlint0m 3sThe patch generated 0 new + 0 unchanged - 119 fixed = 0 total (was 119)
+1 💚mvnsite15m 51sthe patch passed
+1 💚javadoc2m 52sthe patch passed
+0 🆗spotbugs0m 24sdocs has no data from spotbugs
_ Other Tests _
+1 💚unit69m 51sroot in the patch passed.
+1 💚asflicense2m 16sThe patch does not generate ASF License warnings.
166m 37s
SubsystemReport/Notes
DockerClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/3/artifact/out/Dockerfile
Optional Testsdupname compile unit asflicense codespell detsecrets markdownlint mvnsite javac javadoc xmllint spotbugs checkstyle
unameLinux 406cfa6c255b 5.15.0-174-generic #184-Ubuntu SMP Fri Mar 13 18:41:50 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitytez-personality.sh
git revisionmaster / 72a42de
Default JavaEclipse Adoptium-21.0.11+10-LTS
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/3/testReport/
Max. process+thread count1371 (vs. ulimit of 5500)
modulesC: tez-api tez-tools/tez-javadoc-tools docs . U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/3/console
versionsgit=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1 markdownlint=0.46.0
Powered byApache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

abstractdog
abstractdog reviewed Jun 22, 2026
View reviewed changes
Comment threadpom.xml
abstractdog
abstractdog reviewed Jun 22, 2026
View reviewed changes
Comment threaddocs/src/site/markdown/install.md
-->

<head><title>Install and Deployment Instructions</title></head>
# Install/Deploy Instructions for Tez

@abstractdogabstractdogJun 22, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for reformatting/cleaning this file
would you consider mentioning https://github.com/apache/tez/blob/master/dev-support/bin/tez_run_example.sh here, as it takes care of the same install steps in a convenient way?

@Aggarwal-RaghavAggarwal-RaghavJun 22, 2026

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, how about adding it here?

For older Tez versions, the compatibility is as follows:
- Tez 0.9.0 and higher: Apache Hadoop 2.7.0 or higher.
- Tez 0.8.3 and higher: Apache Hadoop 2.6.0 or higher.
- Tez 0.5.0 to 0.8.2: Apache Hadoop 2.2.0 or higher.
> **Note:** For a quick local setup, you can use the helper script[tez_run_example.sh](../../../../dev-support/bin/tez_run_example.sh)
which automates these installation, configuration, and deployment
steps to run a simple word count example in a pseudo-distributed
single-node cluster.
1. Deploy Apache Hadoop using version of 3.5.0 or higher.

@tez-yetus

tez-yetus commented Jun 22, 2026

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 29sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+0 🆗xmllint0m 0sxmllint was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 2 new or modified test files.
_ master Compile Tests _
+0 🆗mvndep0m 44sMaven dependency ordering for branch
+1 💚mvninstall4m 49smaster passed
+1 💚compile3m 57smaster passed
+1 💚checkstyle2m 19smaster passed
+1 💚mvnsite15m 58smaster passed
+1 💚javadoc2m 55smaster passed
+0 🆗spotbugs1m 21stez-api in master has 92 extant spotbugs warnings.
+0 🆗spotbugs0m 38stez-tools/tez-javadoc-tools in master has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 24sbranch/docs no spotbugs output file (spotbugsXml.xml)
+0 🆗spotbugs6m 47sroot in master has 1054 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 13sMaven dependency ordering for patch
+1 💚mvninstall4m 5sthe patch passed
+1 💚codespell1m 44sNo new issues.
+1 💚compile3m 57sthe patch passed
+1 💚javac3m 57sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 28stez-api: The patch generated 0 new + 80 unchanged - 3 fixed = 80 total (was 83)
-0 ⚠️checkstyle0m 23s/results-checkstyle-tez-tools_tez-javadoc-tools.txttez-tools/tez-javadoc-tools: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚checkstyle0m 19sThe patch passed checkstyle in docs
-0 ⚠️checkstyle1m 3s/results-checkstyle-root.txtroot: The patch generated 1 new + 80 unchanged - 3 fixed = 81 total (was 83)
+1 💚markdownlint0m 3sThe patch generated 0 new + 0 unchanged - 119 fixed = 0 total (was 119)
+1 💚mvnsite15m 46sthe patch passed
+1 💚javadoc2m 56sthe patch passed
+0 🆗spotbugs0m 22sdocs has no data from spotbugs
_ Other Tests _
+1 💚unit71m 35sroot in the patch passed.
+1 💚asflicense2m 14sThe patch does not generate ASF License warnings.
158m 2s
SubsystemReport/Notes
DockerClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/4/artifact/out/Dockerfile
Optional Testsdupname compile unit asflicense codespell detsecrets markdownlint mvnsite javac javadoc xmllint spotbugs checkstyle
unameLinux 60631849f267 5.15.0-174-generic #184-Ubuntu SMP Fri Mar 13 18:41:50 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitytez-personality.sh
git revisionmaster / f924848
Default JavaEclipse Adoptium-21.0.11+10-LTS
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/4/testReport/
Max. process+thread count1469 (vs. ulimit of 5500)
modulesC: tez-api tez-tools/tez-javadoc-tools docs . U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-506/4/console
versionsgit=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1 markdownlint=0.46.0
Powered byApache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@abstractdog
abstractdog self-requested a review June 23, 2026 07:04
abstractdog
abstractdog approved these changes Jun 23, 2026
View reviewed changes

@abstractdogabstractdog left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@abstractdog
abstractdog merged commit 7058de2 into apache:masterJun 23, 2026
4 checks passed
@Aggarwal-Raghav
Aggarwal-Raghav deleted the TEZ-4633 branch June 28, 2026 17:24
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@abstractdogabstractdogabstractdog approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@Aggarwal-Raghav@tez-yetus@abstractdog