TEZ-4713: Sync 3rd party dependency with Hadoop-3.5.0 by Aggarwal-Raghav · Pull Request #490 · apache/tez

Aggarwal-Raghav · 2026-04-27T09:27:46Z

Update BouncyCastle to 1.82
Update Guava to 33.4.8-jre
Update RoaringBitmap to 1.3.0
Add Jackson 2.18.6 and jackson-bom -- Already added in hadoop-3.5.0 TEZ-4688 TEZ-4648: Tez upgrade to Hadoop 3.5.0 and jersey 2.x #474
Add Reload4j 1.2.22
Remove jsr305 dependency version

Aggarwal-Raghav · 2026-04-27T09:28:05Z

 <!--dependency versions in alphabetical order-->
 <asynchttpclient.version>2.12.4</asynchttpclient.version>
- <bouncycastle.version>1.79</bouncycastle.version>
+ <bouncycastle.version>1.82</bouncycastle.version>


to be in sync with hadoop-3.5.0

Aggarwal-Raghav · 2026-04-27T09:28:09Z

 <plexus-velocity.version>2.3.0</plexus-velocity.version>
 <frontend-maven-plugin.version>1.15.0</frontend-maven-plugin.version>
- <guava.version>32.0.1-jre</guava.version>
+ <guava.version>33.4.8-jre</guava.version>


to be in sync with hadoop-3.5.0

Aggarwal-Raghav · 2026-04-27T09:28:19Z

+ <jackson.version>2.18.6</jackson.version>
 <jersey.version>1.19.4</jersey.version>
 <jettison.version>1.5.4</jettison.version>
- <jsr305.version>3.0.0</jsr305.version>


can't find any usage

Aggarwal-Raghav · 2026-04-27T09:29:44Z

 <protobuf.version>3.25.5</protobuf.version>
 <protoc-jar-maven-plugin.version>3.11.4</protoc-jar-maven-plugin.version>
 <protoc.path>${env.PROTOC_PATH}</protoc.path>
+ <reload4j.version>1.2.22</reload4j.version>


two version of reload4j was coming 1.2.22 and 1.2.19. Better to define our own version than relying on hadoop.
1.2.19 was coming from slf4j-reload4j dependency

yeah, looks like reload4j 1.2.22 appears in the tez-dist tez.tar.gz after this change, so this looks correct

Aggarwal-Raghav · 2026-04-27T09:30:01Z

+ <reload4j.version>1.2.22</reload4j.version>
 <restrict-imports.enforcer.version>3.0.0</restrict-imports.enforcer.version>
- <roaringbitmap.version>1.2.1</roaringbitmap.version>
+ <roaringbitmap.version>1.3.0</roaringbitmap.version>


proactively done for iceberg-1.10.x

Aggarwal-Raghav · 2026-04-27T09:31:38Z

+ </dependency>
+ <dependency>
+ <groupId>com.fasterxml.jackson</groupId>
+ <artifactId>jackson-bom</artifactId>


import.*jackson explicitly used in tez java file but it is relying on hadoop for jackson jars. IMO, this is not correct.
Also 2 version of jackson-core are coming in tez-dist/.../lib 2.14.3 and 2.12.7
+- org.apache.avro:avro:jar:1.11.4:compile [INFO] | \- com.fasterxml.jackson.core:jackson-core:jar:2.14.3:compile
INFO] | +- org.apache.hadoop:hadoop-yarn-common:jar:3.4.2:compile [INFO] | | +- com.sun.jersey:jersey-core:jar:1.19.4:compile [INFO] | | | \- javax.ws.rs:jsr311-api:jar:1.1.1:compile [INFO] | | +- com.google.inject.extensions:guice-servlet:jar:4.2.3:compile [INFO] | | +- com.google.inject:guice:jar:4.2.3:compile [INFO] | | | +- javax.inject:javax.inject:jar:1:compile [INFO] | | | \- aopalliance:aopalliance:jar:1.0:compile [INFO] | | +- com.sun.jersey.contribs:jersey-guice:jar:1.19.4:compile [INFO] | | +- com.fasterxml.jackson.core:jackson-core:jar:2.12.7:compile

tez-yetus · 2026-04-27T09:31:42Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 0s		Docker mode activated.
-1 ❌	docker	3m 20s		Docker failed to build run-specific yetus/tez:tp-7858}.

Subsystem	Report/Notes
GITHUB PR	#490
Console output	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/1/console
versions	git=2.34.1
Powered by	Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

Aggarwal-Raghav · 2026-04-27T10:52:44Z

CC @abstractdog , can you please help with CI privilege issue?

15:01:41 15:01:41 #2 [internal] load metadata for docker.io/yetus/tez:240665345
15:01:41 #2 ERROR: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed

abstractdog · 2026-05-18T07:01:53Z

CC @abstractdog , can you please help with CI privilege issue?

15:01:41 15:01:41 #2 [internal] load metadata for docker.io/yetus/tez:240665345
15:01:41 #2 ERROR: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed

sorry, I forgot about this: so considering the currently ongoing hadoop upgrade and your decent improvements in the precommit area, we can get back to this after those are resolved, if you're okay with it

Aggarwal-Raghav · 2026-05-18T16:54:59Z

CC @abstractdog , can you please help with CI privilege issue?
15:01:41 15:01:41 #2 [internal] load metadata for docker.io/yetus/tez:240665345
15:01:41 #2 ERROR: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed
sorry, I forgot about this: so considering the currently ongoing hadoop upgrade and your decent improvements in the precommit area, we can get back to this after those are resolved, if you're okay with it

yes, that's the plan. I'll rebase one hadoop3.5.0 is in. The CI failure is because of rebase.

tez-yetus · 2026-05-26T12:45:18Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	2m 0s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 1s		No case conflicting files found.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	xmllint	0m 0s		xmllint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ master Compile Tests _
+1 💚	mvninstall	3m 2s		master passed
+1 💚	compile	2m 28s		master passed
+1 💚	javadoc	0m 58s		master passed
			_ Patch Compile Tests _
+1 💚	mvninstall	2m 14s		the patch passed
+1 💚	codespell	0m 47s		No new issues.
+1 💚	compile	2m 30s		the patch passed
-1 ❌	javac	2m 30s	/results-compile-javac-root.txt	root generated 12 new + 742 unchanged - 0 fixed = 754 total (was 742)
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	javadoc	0m 56s		the patch passed
			_ Other Tests _
+1 💚	unit	57m 12s		root in the patch passed.
+1 💚	asflicense	0m 35s		The patch does not generate ASF License warnings.
		73m 36s

Subsystem	Report/Notes
Docker	ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/2/artifact/out/Dockerfile
Optional Tests	dupname compile unit asflicense javac javadoc codespell detsecrets xmllint
uname	Linux 5eb7580a8c38 5.15.0-173-generic #183-Ubuntu SMP Fri Mar 6 13:29:34 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	tez-personality.sh
git revision	master / `330fdc8`
Default Java	Eclipse Adoptium-21.0.11+10-LTS
Test Results	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/2/testReport/
Max. process+thread count	1448 (vs. ulimit of 5500)
modules	C: . U: .
Console output	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/2/console
versions	git=2.43.0 maven=3.9.15 codespell=2.4.1
Powered by	Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

tez-yetus · 2026-06-17T06:09:00Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	1m 58s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	detsecrets	0m 1s		detect-secrets was not available.
+0 🆗	xmllint	0m 1s		xmllint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ master Compile Tests _
+1 💚	mvninstall	3m 4s		master passed
+1 💚	compile	2m 35s		master passed
+1 💚	javadoc	0m 58s		master passed
			_ Patch Compile Tests _
-1 ❌	mvninstall	0m 4s	/patch-mvninstall-root.txt	root in the patch failed.
+1 💚	codespell	0m 27s		No new issues.
-1 ❌	compile	0m 4s	/patch-compile-root.txt	root in the patch failed.
-1 ❌	javac	0m 4s	/patch-compile-root.txt	root in the patch failed.
+1 💚	blanks	0m 0s		The patch has no blanks issues.
-1 ❌	javadoc	0m 5s	/patch-javadoc-root.txt	root in the patch failed.
			_ Other Tests _
-1 ❌	unit	0m 5s	/patch-unit-root.txt	root in the patch failed.
+0 🆗	asflicense	0m 4s		ASF License check generated no output?
		9m 57s

Subsystem	Report/Notes
Docker	ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/3/artifact/out/Dockerfile
Optional Tests	dupname compile unit asflicense javac javadoc codespell detsecrets xmllint
uname	Linux 00cdf78eccf7 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	tez-personality.sh
git revision	master / `5766cda`
Default Java	Eclipse Adoptium-21.0.11+10-LTS
Test Results	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/3/testReport/
Max. process+thread count	119 (vs. ulimit of 5500)
modules	C: . U: .
Console output	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/3/console
versions	git=2.43.0 maven=3.9.15 codespell=2.4.1
Powered by	Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

tez-yetus · 2026-06-17T07:28:38Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 7s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	xmllint	0m 0s		xmllint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ master Compile Tests _
+1 💚	mvninstall	3m 4s		master passed
+1 💚	compile	2m 32s		master passed
+1 💚	javadoc	0m 58s		master passed
			_ Patch Compile Tests _
+1 💚	mvninstall	2m 11s		the patch passed
+1 💚	codespell	0m 49s		No new issues.
+1 💚	compile	2m 32s		the patch passed
-1 ❌	javac	2m 32s	/results-compile-javac-root.txt	root generated 12 new + 707 unchanged - 0 fixed = 719 total (was 707)
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	javadoc	0m 51s		the patch passed
			_ Other Tests _
+1 💚	unit	60m 23s		root in the patch passed.
+1 💚	asflicense	0m 35s		The patch does not generate ASF License warnings.
		74m 52s

Subsystem	Report/Notes
Docker	ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/4/artifact/out/Dockerfile
Optional Tests	dupname compile unit asflicense javac javadoc codespell detsecrets xmllint
uname	Linux 50ed7a0819d2 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	tez-personality.sh
git revision	master / `5766cda`
Default Java	Eclipse Adoptium-21.0.11+10-LTS
Test Results	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/4/testReport/
Max. process+thread count	1558 (vs. ulimit of 5500)
modules	C: . U: .
Console output	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/4/console
versions	git=2.43.0 maven=3.9.15 codespell=2.4.1
Powered by	Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

Aggarwal-Raghav · 2026-06-17T08:09:31Z

fixed javac in #511

Aggarwal-Raghav · 2026-06-17T08:09:54Z

@abstractdog , this is ready for review.

Aggarwal-Raghav · 2026-06-22T11:48:24Z

fixed javac in #511

this is merged. Let me know if I need to rebase and re-trigger the CI ?

abstractdog

LGTM, feel free to rebase

abstractdog · 2026-06-22T14:03:15Z

 <protobuf.version>3.25.5</protobuf.version>
 <protoc-jar-maven-plugin.version>3.11.4</protoc-jar-maven-plugin.version>
 <protoc.path>${env.PROTOC_PATH}</protoc.path>
+ <reload4j.version>1.2.22</reload4j.version>


yeah, looks like reload4j 1.2.22 appears in the tez-dist tez.tar.gz after this change, so this looks correct

Aggarwal-Raghav · 2026-06-22T14:27:09Z

ok, rebasing this for clean javac yetus

- Update BouncyCastle to 1.82 - Update Guava to 33.4.8-jre - Update RoaringBitmap to 1.3.0 - Add Jackson 2.18.6 and jackson-bom - Add Reload4j 1.2.22 - Remove jsr305 dependency version

Aggarwal-Raghav · 2026-06-22T14:28:12Z

Thanks a lot for review @abstractdog 😀

tez-yetus · 2026-06-22T15:44:35Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	3m 11s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	xmllint	0m 0s		xmllint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ master Compile Tests _
+1 💚	mvninstall	3m 15s		master passed
+1 💚	compile	2m 31s		master passed
+1 💚	javadoc	1m 0s		master passed
			_ Patch Compile Tests _
+1 💚	mvninstall	2m 11s		the patch passed
+1 💚	codespell	0m 48s		No new issues.
+1 💚	compile	2m 29s		the patch passed
+1 💚	javac	2m 29s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	javadoc	0m 55s		the patch passed
			_ Other Tests _
+1 💚	unit	58m 43s		root in the patch passed.
+1 💚	asflicense	0m 35s		The patch does not generate ASF License warnings.
		76m 30s

Subsystem	Report/Notes
Docker	ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/5/artifact/out/Dockerfile
Optional Tests	dupname compile unit asflicense javac javadoc codespell detsecrets xmllint
uname	Linux cf46112098e5 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	tez-personality.sh
git revision	master / `81e0a24`
Default Java	Eclipse Adoptium-21.0.11+10-LTS
Test Results	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/5/testReport/
Max. process+thread count	1460 (vs. ulimit of 5500)
modules	C: . U: .
Console output	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-490/5/console
versions	git=2.43.0 maven=3.9.15 codespell=2.4.1
Powered by	Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

Aggarwal-Raghav commented Apr 27, 2026
View reviewed changes

Aggarwal-Raghav force-pushed the TEZ-4713 branch from 36cacb1 to 8b2ab20Compare May 26, 2026 11:31

Aggarwal-Raghav mentioned this pull request Jun 8, 2026
TEZ-4688 TEZ-4648: Tez upgrade to Hadoop 3.5.0 and jersey 2.x #474
Merged

Aggarwal-Raghav force-pushed the TEZ-4713 branch from 8b2ab20 to 0e27874Compare June 17, 2026 05:58

Aggarwal-Raghav force-pushed the TEZ-4713 branch from 0e27874 to a1b6986Compare June 17, 2026 06:13

abstractdog approved these changes Jun 22, 2026
View reviewed changes

TEZ-4713: Sync 3rd party dependency with Hadoop-3.5.0
f7811e1
- Update BouncyCastle to 1.82 - Update Guava to 33.4.8-jre - Update RoaringBitmap to 1.3.0 - Add Jackson 2.18.6 and jackson-bom - Add Reload4j 1.2.22 - Remove jsr305 dependency version

Aggarwal-Raghav force-pushed the TEZ-4713 branch from a1b6986 to f7811e1Compare June 22, 2026 14:27

abstractdog self-requested a review June 22, 2026 15:49

abstractdog approved these changes Jun 22, 2026
View reviewed changes

abstractdog merged commit f924848 into apache:masterJun 22, 2026
4 checks passed

Aggarwal-Raghav deleted the TEZ-4713 branch June 28, 2026 17:25

Uh oh!

Conversation

Aggarwal-Raghav commented Apr 27, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Aggarwal-RaghavApr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Aggarwal-RaghavApr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Aggarwal-RaghavApr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Aggarwal-RaghavApr 27, 2026

Choose a reason for hiding this comment

Uh oh!

abstractdogJun 22, 2026

Choose a reason for hiding this comment

Uh oh!

Aggarwal-RaghavApr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Aggarwal-RaghavApr 27, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

tez-yetus commented Apr 27, 2026

Uh oh!

Aggarwal-Raghav commented Apr 27, 2026

Uh oh!

abstractdog commented May 18, 2026

Uh oh!

Aggarwal-Raghav commented May 18, 2026

Uh oh!

tez-yetus commented May 26, 2026

Uh oh!

tez-yetus commented Jun 17, 2026

Uh oh!

tez-yetus commented Jun 17, 2026

Uh oh!

Aggarwal-Raghav commented Jun 17, 2026

Uh oh!

Aggarwal-Raghav commented Jun 17, 2026

Uh oh!

Aggarwal-Raghav commented Jun 22, 2026

Uh oh!

abstractdog left a comment

Choose a reason for hiding this comment

Uh oh!

abstractdogJun 22, 2026

Choose a reason for hiding this comment

Uh oh!

Aggarwal-Raghav commented Jun 22, 2026

Uh oh!

Aggarwal-Raghav commented Jun 22, 2026

Uh oh!

tez-yetus commented Jun 22, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Aggarwal-Raghav commented Apr 27, 2026•
edited
Loading

Aggarwal-RaghavApr 27, 2026•
edited
Loading