Skip to content

[SPARK-21946][TEST]: fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite - #19159

Closed
kiszk wants to merge 1 commit into
apache:masterfrom
kiszk:SPARK-21946
Closed

[SPARK-21946][TEST]: fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite#19159
kiszk wants to merge 1 commit into
apache:masterfrom
kiszk:SPARK-21946

Conversation

@kiszk

@kiszkkiszk commented Sep 8, 2017

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR fixes flaky test InMemoryCatalogedDDLSuite "alter table: rename cached table".
Since this test validates distributed DataFrame, the result should be checked by using checkAnswer. The original version used df.collect().Seq method that does not guaranty an order of each element of the result.

How was this patch tested?

Use existing test case

@kiszkkiszk changed the title [TEST]: fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite[SPARK-21946][TEST]: fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuiteSep 8, 2017
@gatorsmile

Copy link
Copy Markdown
Member

LGTM pending Jenkins.

@dongjoon-hyundongjoon-hyun left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM, too.
Thank you for picking up this, @kiszk .

@SparkQA

Copy link
Copy Markdown

Test build #81539 has finished for PR 19159 at commit 7a47891.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun

Copy link
Copy Markdown
Member

Retest this please.

@SparkQA

Copy link
Copy Markdown

Test build #81543 has finished for PR 19159 at commit 7a47891.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@gatorsmile

Copy link
Copy Markdown
Member

Thanks! Merged to master/2.2

asfgit pushed a commit that referenced this pull request Sep 8, 2017
…" in InMemoryCatalogedDDLSuite
## What changes were proposed in this pull request?
This PR fixes flaky test `InMemoryCatalogedDDLSuite "alter table: rename cached table"`.
Since this test validates distributed DataFrame, the result should be checked by using `checkAnswer`. The original version used `df.collect().Seq` method that does not guaranty an order of each element of the result.
## How was this patch tested?
Use existing test case
Author: Kazuaki Ishizaki <ishizaki@jp.ibm.com>
Closes#19159 from kiszk/SPARK-21946.
(cherry picked from commit 8a4f228)
Signed-off-by: gatorsmile <gatorsmile@gmail.com>
@asfgitasfgit closed this in 8a4f228Sep 8, 2017
MatthewRBruce pushed a commit to Shopify/spark that referenced this pull request Jul 31, 2018
…" in InMemoryCatalogedDDLSuite
## What changes were proposed in this pull request?
This PR fixes flaky test `InMemoryCatalogedDDLSuite "alter table: rename cached table"`.
Since this test validates distributed DataFrame, the result should be checked by using `checkAnswer`. The original version used `df.collect().Seq` method that does not guaranty an order of each element of the result.
## How was this patch tested?
Use existing test case
Author: Kazuaki Ishizaki <ishizaki@jp.ibm.com>
Closesapache#19159 from kiszk/SPARK-21946.
(cherry picked from commit 8a4f228)
Signed-off-by: gatorsmile <gatorsmile@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@kiszk@gatorsmile@SparkQA@dongjoon-hyun