Skip to content

[SPARK-16961] [Follow-up] [SparkR] More robust test case for spark.gaussianMixture. - #14730

Closed
yanboliang wants to merge 1 commit into
apache:masterfrom
yanboliang:spark-16961-followup
Closed

[SPARK-16961] [Follow-up] [SparkR] More robust test case for spark.gaussianMixture.#14730
yanboliang wants to merge 1 commit into
apache:masterfrom
yanboliang:spark-16961-followup

Conversation

@yanboliang

@yanboliangyanboliang commented Aug 20, 2016

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

#14551 fixed off-by-one bug in randomizeInPlace and some test failure caused by this fix.

But for SparkR spark.gaussianMixture test case, the fix is inappropriate. It only changed the output result of native R which should be compared by SparkR, however, it did not change the R code in annotation which is used for reproducing the result in native R. It will confuse users who can not reproduce the same result in native R. This PR sends a more robust test case which can produce same result between SparkR and native R.

How was this patch tested?

Unit test update.

@SparkQA

Copy link
Copy Markdown

Test build #64136 has finished for PR 14730 at commit 6cba174.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@srowen

Copy link
Copy Markdown
Member

OK sounds good, thank you @yanboliang . It passed the PR builder but I see why this is a better test.

@felixcheung

Copy link
Copy Markdown
Member

LGTM

@yanboliang

Copy link
Copy Markdown
ContributorAuthor

Merged into master. Thanks for review.

@yanboliang
yanboliang deleted the spark-16961-followup branch August 21, 2016 09:27
@srowen

Copy link
Copy Markdown
Member

I was going to merge back to 2.0 but it looks like this file doesn't exist in 2.0? just double checking I didn't miss something.

@yanboliang

Copy link
Copy Markdown
ContributorAuthor

Yes, the spark.gaussianMixture was added after 2.0. Thanks!

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@yanboliang@SparkQA@srowen@felixcheung