Skip to content

[SPARK-11880][Windows][Spark Submit] bin/load-spark-env.cmd loads spark-env.cmd from wrong directory - #9863

Closed
toddwan wants to merge 1 commit into
apache:masterfrom
toddwan:master
Closed

[SPARK-11880][Windows][Spark Submit] bin/load-spark-env.cmd loads spark-env.cmd from wrong directory#9863
toddwan wants to merge 1 commit into
apache:masterfrom
toddwan:master

Conversation

@toddwan

Copy link
Copy Markdown
Contributor
  • On windows the bin/load-spark-env.cmd tries to load spark-env.cmd from %~dp0..\..\conf, where ~dp0 points to bin and conf is only one level up.
  • Updated bin/load-spark-env.cmd to load spark-env.cmd from %~dp0..\conf, instead of %~dp0..\..\conf

@srowen

Copy link
Copy Markdown
Member

LGTM though how did this ever work then?

@SparkQA

Copy link
Copy Markdown

Test build #2092 has finished for PR 9863 at commit 094e3e3.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@toddwan
toddwanforce-pushed the master branch 2 times, most recently from c72c9ac to 094e3e3CompareNovember 21, 2015 16:46
@toddwan

Copy link
Copy Markdown
ContributorAuthor

I guess users on Windows platform seldom touch spark-env.cmd, and have lots of workarounds if they ran into this issue.

@andrewor14

Copy link
Copy Markdown
Contributor

Thanks, merging into master 1.6.

asfgit pushed a commit that referenced this pull request Nov 25, 2015
…rk-env.cmd from wrong directory
* On windows the `bin/load-spark-env.cmd` tries to load `spark-env.cmd` from `%~dp0..\..\conf`, where `~dp0` points to `bin` and `conf` is only one level up.
* Updated `bin/load-spark-env.cmd` to load `spark-env.cmd` from `%~dp0..\conf`, instead of `%~dp0..\..\conf`
Author: wangt <wangtao.upc@gmail.com>
Closes#9863 from toddwan/master.
(cherry picked from commit 9f3e59a)
Signed-off-by: Andrew Or <andrew@databricks.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@toddwan@srowen@SparkQA@andrewor14@wangt