Skip to content

TEZ-4717: Modernize and Optimize Yetus Dockerfile build time and maintainability - #494

Merged
abstractdog merged 2 commits into
apache:masterfrom
Aggarwal-Raghav:TEZ-4717
May 10, 2026
Merged

TEZ-4717: Modernize and Optimize Yetus Dockerfile build time and maintainability#494
abstractdog merged 2 commits into
apache:masterfrom
Aggarwal-Raghav:TEZ-4717

Conversation

@Aggarwal-Raghav

@Aggarwal-RaghavAggarwal-Raghav commented May 2, 2026

Copy link
Copy Markdown
Contributor
  1. Speed up build times by moving standalone binary downloads (shellcheck, hadolint, buf, protoc) into concurrent, lightweight Alpine stages.
  2. Use eclipse-temurin:21-jdk-noble to natively support both arm64 (Macs) and amd64 architectures, Dockerimage was not building on mac.
  3. Centralized Dependency versions and updated shellcheck and hadolint version to 0.11.0 and 2.14.0 respectively
  4. Deleted the unused golang-go compiler.
  5. Fixed all hadolint warnings by modernizing ENV syntax.

Taking around 2 min to build
Screenshot 2026-05-03 at 12 33 31 AM

@tez-yetus

Copy link
Copy Markdown

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-494/1/console in case of problems.

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec3m 28sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+0 🆗shelldocs0m 0sShelldocs was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ master Compile Tests _
_ Patch Compile Tests _
-1 ❌codespell0m 4s/results-codespell.txtThe patch generated 1 new + 2 unchanged - 0 fixed = 3 total (was 2)
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚hadolint0m 1sThe patch generated 0 new + 0 unchanged - 2 fixed = 0 total (was 2)
+1 💚shellcheck0m 0sNo new issues.
_ Other Tests _
+1 💚asflicense0m 19sThe patch does not generate ASF License warnings.
4m 11s
SubsystemReport/Notes
DockerClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-494/1/artifact/out/Dockerfile
GITHUB PR#494
Optional Testsdupname asflicense codespell detsecrets hadolint shellcheck shelldocs
unameLinux 75c8202e0021 5.15.0-141-generic #151-Ubuntu SMP Sun May 18 21:35:19 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-home/workspace/tez-multibranch_PR-494/src/.yetus/personality.sh
git revisionmaster / 14f46d6
Max. process+thread count55 (vs. ulimit of 5500)
modulesC: . U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-494/1/console
versionsgit=2.43.0 maven=3.9.15 hadolint=2.14.0 codespell=2.4.1 shellcheck=0.11.0
Powered byApache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@abstractdog

Copy link
Copy Markdown
Contributor

very nice @Aggarwal-Raghav , thanks for taking care of this: can you address that nit pointed out by codespell?
https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-494/1/artifact/out/results-codespell.txt

@tez-yetus

Copy link
Copy Markdown

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-494/2/console in case of problems.

@tez-yetus

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec2m 4sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+0 🆗shelldocs0m 0sShelldocs was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ master Compile Tests _
_ Patch Compile Tests _
+1 💚codespell0m 5sNo new issues.
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚hadolint0m 1sThe patch generated 0 new + 0 unchanged - 2 fixed = 0 total (was 2)
+1 💚shellcheck0m 0sNo new issues.
_ Other Tests _
+1 💚asflicense0m 20sThe patch does not generate ASF License warnings.
2m 50s
SubsystemReport/Notes
DockerClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-494/2/artifact/out/Dockerfile
GITHUB PR#494
Optional Testsdupname asflicense codespell detsecrets hadolint shellcheck shelldocs
unameLinux aad6c09357ae 5.15.0-177-generic #187-Ubuntu SMP Sat Apr 11 22:54:33 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-home/workspace/tez-multibranch_PR-494/src/.yetus/personality.sh
git revisionmaster / 37ae94a
Max. process+thread count58 (vs. ulimit of 5500)
modulesC: . U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-494/2/console
versionsgit=2.43.0 maven=3.9.15 hadolint=2.14.0 codespell=2.4.1 shellcheck=0.11.0
Powered byApache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@abstractdog
abstractdog self-requested a review May 10, 2026 10:31

@abstractdogabstractdog left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@abstractdog
abstractdog merged commit c9459fe into apache:masterMay 10, 2026
4 checks passed
@Aggarwal-Raghav
Aggarwal-Raghav deleted the TEZ-4717 branch June 28, 2026 17:25
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Aggarwal-Raghav@tez-yetus@abstractdog