Skip to content

[SPARK-32160][CORE][PYSPARK][3.0][FOLLOWUP] Change the config name to switch allow/disallow SparkContext in executors. - #29341

Closed
ueshin wants to merge 1 commit into
apache:branch-3.0from
ueshin:issues/SPARK-32160/3.0/change_config_name
Closed

[SPARK-32160][CORE][PYSPARK][3.0][FOLLOWUP] Change the config name to switch allow/disallow SparkContext in executors.#29341
ueshin wants to merge 1 commit into
apache:branch-3.0from
ueshin:issues/SPARK-32160/3.0/change_config_name

Conversation

@ueshin

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This is a follow-up of #29294.
This PR changes the config name to switch allow/disallow SparkContext in executors as per the comment #29278 (review).

Why are the changes needed?

The config name spark.executor.allowSparkContext is more reasonable.

Does this PR introduce any user-facing change?

Yes, the config name is changed.

How was this patch tested?

Updated tests.

@dongjoon-hyundongjoon-hyun left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, @ueshin !

@SparkQA

Copy link
Copy Markdown

Test build #127004 has finished for PR 29341 at commit 133e7f1.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon

Copy link
Copy Markdown
Member

Merged to branch-3.0.

HyukjinKwon pushed a commit that referenced this pull request Aug 4, 2020
… switch allow/disallow SparkContext in executors
### What changes were proposed in this pull request?
This is a follow-up of #29294.
This PR changes the config name to switch allow/disallow `SparkContext` in executors as per the comment #29278 (review).
### Why are the changes needed?
The config name `spark.executor.allowSparkContext` is more reasonable.
### Does this PR introduce _any_ user-facing change?
Yes, the config name is changed.
### How was this patch tested?
Updated tests.
Closes#29341 from ueshin/issues/SPARK-32160/3.0/change_config_name.
Authored-by: Takuya UESHIN <ueshin@databricks.com>
Signed-off-by: HyukjinKwon <gurwls223@apache.org>
@ueshin
ueshin deleted the issues/SPARK-32160/3.0/change_config_name branch August 3, 2026 22:59
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@ueshin@SparkQA@HyukjinKwon@cloud-fan@dongjoon-hyun