Skip to content

[SPARK-20848][SQL][Follow-up] Shutdown the pool after reading parquet files - #18100

Closed
viirya wants to merge 1 commit into
apache:masterfrom
viirya:SPARK-20848-followup
Closed

[SPARK-20848][SQL][Follow-up] Shutdown the pool after reading parquet files#18100
viirya wants to merge 1 commit into
apache:masterfrom
viirya:SPARK-20848-followup

Conversation

@viirya

@viiryaviirya commented May 24, 2017

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This is a follow-up to #18073. Taking a safer approach to shutdown the pool to prevent possible issue. Also using ThreadUtils.newForkJoinPool instead to set a better thread name.

How was this patch tested?

Manually test.

Please review http://spark.apache.org/contributing.html before opening a pull request.

@viirya

Copy link
Copy Markdown
MemberAuthor

cc @cloud-fan@zsxwing@gatorsmile Please take a look. Thanks

@viirya

Copy link
Copy Markdown
MemberAuthor

also cc @srowen

@gatorsmilegatorsmile left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM pending Jenkins

@cloud-fan

Copy link
Copy Markdown
Contributor

LGTM

@SparkQA

Copy link
Copy Markdown

Test build #77314 has finished for PR 18100 at commit f60b0b4.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

asfgit pushed a commit that referenced this pull request May 25, 2017
… files
## What changes were proposed in this pull request?
This is a follow-up to #18073. Taking a safer approach to shutdown the pool to prevent possible issue. Also using `ThreadUtils.newForkJoinPool` instead to set a better thread name.
## How was this patch tested?
Manually test.
Please review http://spark.apache.org/contributing.html before opening a pull request.
Author: Liang-Chi Hsieh <viirya@gmail.com>
Closes#18100 from viirya/SPARK-20848-followup.
(cherry picked from commit 6b68d61)
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
asfgit pushed a commit that referenced this pull request May 25, 2017
… files
## What changes were proposed in this pull request?
This is a follow-up to #18073. Taking a safer approach to shutdown the pool to prevent possible issue. Also using `ThreadUtils.newForkJoinPool` instead to set a better thread name.
## How was this patch tested?
Manually test.
Please review http://spark.apache.org/contributing.html before opening a pull request.
Author: Liang-Chi Hsieh <viirya@gmail.com>
Closes#18100 from viirya/SPARK-20848-followup.
(cherry picked from commit 6b68d61)
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
@cloud-fan

Copy link
Copy Markdown
Contributor

thanks, merging to master/2.2/2.1!

jzhuge pushed a commit to jzhuge/spark that referenced this pull request Aug 20, 2018
… files
This is a follow-up to apache#18073. Taking a safer approach to shutdown the pool to prevent possible issue. Also using `ThreadUtils.newForkJoinPool` instead to set a better thread name.
Manually test.
Please review http://spark.apache.org/contributing.html before opening a pull request.
Author: Liang-Chi Hsieh <viirya@gmail.com>
Closesapache#18100 from viirya/SPARK-20848-followup.
(cherry picked from commit 6b68d61)
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
@viirya
viirya deleted the SPARK-20848-followup branch December 27, 2023 18:20
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@viirya@cloud-fan@SparkQA@gatorsmile