Skip to content

Update example to work locally - #21731

Closed
ets wants to merge 1 commit into
apache:masterfrom
ets:patch-1
Closed

Update example to work locally#21731
ets wants to merge 1 commit into
apache:masterfrom
ets:patch-1

Conversation

@ets

@etsets commented Jul 8, 2018

Copy link
Copy Markdown

Without setting Master to "local" the example throws a SparkException "A master URL must be set in your configuration"

What changes were proposed in this pull request?

explicitly set SparkConf master to "local"

How was this patch tested?

Running the main method using Spark 2.3.1 without the change produces an exception. With the change, the main method executes without error.

Please review http://spark.apache.org/contributing.html before opening a pull request.

With setting Master to "local" the example throws a SparkException "A master URL must be set in your configuration"
@AmplabJenkins

Copy link
Copy Markdown

Can one of the admins verify this patch?

@jerryshao

Copy link
Copy Markdown
Contributor

This seems not a necessary fix. master can be configured via spark-submit argument --master, not a best practice to set it in code.

@HyukjinKwon

Copy link
Copy Markdown
Member

ping @ets, mind closing this?

@HyukjinKwonHyukjinKwon mentioned this pull request Jul 16, 2018
@ets
ets deleted the patch-1 branch July 19, 2018 14:05
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 22, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@ets@AmplabJenkins@jerryshao@HyukjinKwon