Skip to content

[SPARK-18617][Tests]Fix flaky test: StreamingContextSuite.SPARK-18560 Receiver data should be deserialized properly - #16105

Closed
zsxwing wants to merge 1 commit into
apache:masterfrom
zsxwing:SPARK-18617-2
Closed

[SPARK-18617][Tests]Fix flaky test: StreamingContextSuite.SPARK-18560 Receiver data should be deserialized properly#16105
zsxwing wants to merge 1 commit into
apache:masterfrom
zsxwing:SPARK-18617-2

Conversation

@zsxwing

@zsxwingzsxwing commented Dec 1, 2016

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

Avoid to create multiple threads to stop StreamingContext. Otherwise, the latch added in #16091 can be passed too early.

How was this patch tested?

Jenkins

@SparkQA

Copy link
Copy Markdown

Test build #69495 has finished for PR 16105 at commit 31ad69b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@zsxwing

Copy link
Copy Markdown
MemberAuthor

cc @rxin

@rxin

rxin commented Dec 1, 2016

Copy link
Copy Markdown
Contributor

LGTM

@zsxwing

Copy link
Copy Markdown
MemberAuthor

Thanks. Merging to master, 2.1 and 2.0.

@zsxwingzsxwing changed the title [SPARK-18617][Tests]Fix flaky test: StreamingContextSuite.SPARK-18560 Receiver data shoul…[SPARK-18617][Tests]Fix flaky test: StreamingContextSuite.SPARK-18560 Receiver data StreamingContextSuite.SPARK-18560 Receiver data should be deserialized properlyDec 1, 2016
@zsxwingzsxwing changed the title [SPARK-18617][Tests]Fix flaky test: StreamingContextSuite.SPARK-18560 Receiver data StreamingContextSuite.SPARK-18560 Receiver data should be deserialized properly[SPARK-18617][Tests]Fix flaky test: StreamingContextSuite.SPARK-18560 Receiver data should be deserialized properlyDec 1, 2016
asfgit pushed a commit that referenced this pull request Dec 1, 2016
…te. Receiver data should be deserialized properly
## What changes were proposed in this pull request?
Avoid to create multiple threads to stop StreamingContext. Otherwise, the latch added in #16091 can be passed too early.
## How was this patch tested?
Jenkins
Author: Shixiong Zhu <shixiong@databricks.com>
Closes#16105 from zsxwing/SPARK-18617-2.
(cherry picked from commit 086b0c8)
Signed-off-by: Shixiong Zhu <shixiong@databricks.com>
asfgit pushed a commit that referenced this pull request Dec 1, 2016
…te. Receiver data should be deserialized properly
## What changes were proposed in this pull request?
Avoid to create multiple threads to stop StreamingContext. Otherwise, the latch added in #16091 can be passed too early.
## How was this patch tested?
Jenkins
Author: Shixiong Zhu <shixiong@databricks.com>
Closes#16105 from zsxwing/SPARK-18617-2.
(cherry picked from commit 086b0c8)
Signed-off-by: Shixiong Zhu <shixiong@databricks.com>
@asfgitasfgit closed this in 086b0c8Dec 1, 2016
@zsxwing
zsxwing deleted the SPARK-18617-2 branch December 1, 2016 22:25
robert3005 pushed a commit to palantir/spark that referenced this pull request Dec 2, 2016
…te. Receiver data should be deserialized properly
## What changes were proposed in this pull request?
Avoid to create multiple threads to stop StreamingContext. Otherwise, the latch added in apache#16091 can be passed too early.
## How was this patch tested?
Jenkins
Author: Shixiong Zhu <shixiong@databricks.com>
Closesapache#16105 from zsxwing/SPARK-18617-2.
uzadude pushed a commit to uzadude/spark that referenced this pull request Jan 27, 2017
…te. Receiver data should be deserialized properly
## What changes were proposed in this pull request?
Avoid to create multiple threads to stop StreamingContext. Otherwise, the latch added in apache#16091 can be passed too early.
## How was this patch tested?
Jenkins
Author: Shixiong Zhu <shixiong@databricks.com>
Closesapache#16105 from zsxwing/SPARK-18617-2.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@zsxwing@SparkQA@rxin