Skip to content

[SPARK-55115][INFRA] Install both Java 8 and Java 17 in release Docker image - #53891

Closed
cloud-fan wants to merge 1 commit into
apache:masterfrom
cloud-fan:update-release-dockerfile-multi-java
Closed

[SPARK-55115][INFRA] Install both Java 8 and Java 17 in release Docker image#53891
cloud-fan wants to merge 1 commit into
apache:masterfrom
cloud-fan:update-release-dockerfile-multi-java

Conversation

@cloud-fan

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

This updates the release manager Docker image to include both Java 8 and Java 17, enabling builds for all active Spark branches:

  • Spark < 4.0: requires Java 8
  • Spark >= 4.0: requires Java 17

Changes:

  • Add openjdk-8-jdk-headless alongside existing Java 17
  • Set up architecture-aware Java paths in /etc/profile.d/java.sh (works on both amd64 and arm64)
  • Export JAVA8_HOME, JAVA17_HOME, and JAVA_HOME environment variables

Why are the changes needed?

To support releasing all active Spark versions (3.5, 4.0, 4.1, 4.2) from a single Docker image. The release scripts will automatically select the appropriate Java version based on the Spark version being released.

Does this PR introduce any user-facing change?

No. This only affects the release infrastructure.

How was this patch tested?

Manual testing by building the Docker image and verifying both Java versions are installed.

Was this patch authored or co-authored using generative AI tooling?

Yes. cursor 2.3.41

This updates the release manager Docker image to include both Java 8 and Java 17, enabling builds for all active Spark branches:
- Spark < 4.0: requires Java 8
- Spark >= 4.0: requires Java 17
The release scripts will automatically select the appropriate Java version based on the Spark version being released.
Changes:
- Add openjdk-8-jdk-headless alongside existing Java 17
- Set up architecture-aware Java paths in /etc/profile.d/java.sh
- Export JAVA8_HOME, JAVA17_HOME, and JAVA_HOME environment variables
@github-actions

Copy link
Copy Markdown

JIRA Issue Information

=== Improvement SPARK-55115 ===
Summary: Use master branch's Dockerfile for release builds
Assignee: None
Status: Open
Affected: ["4.2.0"]


This comment was automatically generated by GitHub Actions

@cloud-fan
cloud-fan marked this pull request as draft January 21, 2026 18:35
@cloud-fan

Copy link
Copy Markdown
ContributorAuthor

This only fixes java version but not python version, switching to #53905

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@cloud-fan@HyukjinKwon