Skip to content

[SPARK-53471] Correct entrypoint.sh for Openshift - #90

Open
Reamer wants to merge 1 commit into
apache:masterfrom
Reamer:entrypoint_openshift
Open

[SPARK-53471] Correct entrypoint.sh for Openshift#90
Reamer wants to merge 1 commit into
apache:masterfrom
Reamer:entrypoint_openshift

Conversation

@Reamer

Copy link
Copy Markdown

What changes were proposed in this pull request?

This change performs string interpolation during the creation of the temporary file.

Why are the changes needed?

Start problems due to incorrect evaluation of the content.

Exception in thread "main" java.lang.IllegalArgumentException: basedir must be absolute: -anonymous uid}/.ivy2/local
at org.apache.ivy.util.Checks.checkAbsolute(Checks.java:48)
at org.apache.ivy.plugins.repository.file.FileRepository.setBaseDir(FileRepository.java:137)
at org.apache.ivy.plugins.repository.file.FileRepository.<init>(FileRepository.java:44)
at org.apache.spark.deploy.SparkSubmitUtils$.createRepoResolvers(SparkSubmit.scala:1269)
at org.apache.spark.deploy.SparkSubmitUtils$.buildIvySettings(SparkSubmit.scala:1376)
at org.apache.spark.util.DependencyUtils$.resolveMavenDependencies(DependencyUtils.scala:182)
at org.apache.spark.deploy.SparkSubmit.prepareSubmitEnvironment(SparkSubmit.scala:334)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:964)
at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:176)
at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:174)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:217)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1120)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1129)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

Does this PR introduce any user-facing change?

No

How was this patch tested?

On my Openshift 4.17 platform

@Reamer

Copy link
Copy Markdown
Author

ping @Yikun and @pan3793

@Reamer
Reamerforce-pushed the entrypoint_openshift branch from a87e0b3 to 084bf6bCompareAugust 21, 2026 12:52
@Reamer

Copy link
Copy Markdown
Author

Over time, a few entrypoint.sh files have been added. I've updated the MR and hope for a quick review.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@Reamer