Skip to content

[SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable - #25272

Closed
HyukjinKwon wants to merge 1 commit into
apache:masterfrom
HyukjinKwon:SPARK-28441
Closed

[SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable#25272
HyukjinKwon wants to merge 1 commit into
apache:masterfrom
HyukjinKwon:SPARK-28441

Conversation

@HyukjinKwon

@HyukjinKwonHyukjinKwon commented Jul 27, 2019

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

We should add assume(shouldTestPythonUDFs). Maybe it's not a biggie in general but it can matter in other venders' testing base. For instance, if somebody launches a test in a minimal docker image, it might make the tests failed suddenly.

This skipping stuff isn't completely new in our test base. See TestUtils.testCommandAvailable for instance.

How was this patch tested?

Manually tested.

@HyukjinKwonHyukjinKwon changed the title [SPARK-28441][SQL][TESTS] Skip Python tests if python executable and pyspark library are unavailable[SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailableJul 27, 2019
@HyukjinKwon

Copy link
Copy Markdown
MemberAuthor

cc @viirya and @cloud-fan

@viirya

Copy link
Copy Markdown
Member

Thanks for adding that.

@HyukjinKwon

Copy link
Copy Markdown
MemberAuthor

Related tests passed.

Merged to master.

@SparkQA

Copy link
Copy Markdown

Test build #108244 has finished for PR 25272 at commit 1f546f8.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon
HyukjinKwon deleted the SPARK-28441 branch March 3, 2020 01:19
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@HyukjinKwon@viirya@SparkQA@dongjoon-hyun