Skip to content

[SPARK-25764][ML][EXAMPLES] Update BisectingKMeans example to use ClusteringEvaluator - #22763

Closed
mgaido91 wants to merge 1 commit into
apache:masterfrom
mgaido91:SPARK-25764
Closed

[SPARK-25764][ML][EXAMPLES] Update BisectingKMeans example to use ClusteringEvaluator#22763
mgaido91 wants to merge 1 commit into
apache:masterfrom
mgaido91:SPARK-25764

Conversation

@mgaido91

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

The PR updates the examples for BisectingKMeans so that they don't use the deprecated method computeCost (see SPARK-25758).

How was this patch tested?

running examples

@mgaido91

Copy link
Copy Markdown
ContributorAuthor

@SparkQA

Copy link
Copy Markdown

Test build #97527 has finished for PR 22763 at commit 9def7e8.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@WeichenXu123

Copy link
Copy Markdown
Contributor

LGTM. thanks!

@dongjoon-hyun

dongjoon-hyun commented Oct 18, 2018

Copy link
Copy Markdown
Member

Can we use a more positive title, @mgaido91 ?

- Update BisectingKMeans example not to use deprecated computeCost method
+ Update BisectingKMeans example to use ClusteringEvaluator

@mgaido91mgaido91 changed the title [SPARK-25764][ML][EXAMPLES] Update BisectingKMeans example not to use deprecated computeCost method[SPARK-25764][ML][EXAMPLES] Update BisectingKMeans example to use ClusteringEvaluatorOct 18, 2018
@mgaido91

Copy link
Copy Markdown
ContributorAuthor

done @dongjoon-hyun , thanks.

@dongjoon-hyundongjoon-hyun left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM.

@cloud-fan

Copy link
Copy Markdown
Contributor

thanks, merging to master/2.4!

asfgit pushed a commit that referenced this pull request Oct 19, 2018
…steringEvaluator
## What changes were proposed in this pull request?
The PR updates the examples for `BisectingKMeans` so that they don't use the deprecated method `computeCost` (see SPARK-25758).
## How was this patch tested?
running examples
Closes#22763 from mgaido91/SPARK-25764.
Authored-by: Marco Gaido <marcogaido91@gmail.com>
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
(cherry picked from commit d0ecff2)
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
@cloud-fan

cloud-fan commented Oct 20, 2018

Copy link
Copy Markdown
Contributor

This has been reverted from master/2.4, since #22756 was reverted

@dongjoon-hyun

Copy link
Copy Markdown
Member

Ur, @mengxr and @gatorsmile seems to determine to revert #22756 on branch-2.4 only.

@mgaido91

Copy link
Copy Markdown
ContributorAuthor

Actually I don't see at all the need to revert this. Even without deprecating computeCost, using it for evaluating a model is a very poor approach. We should anyway advice the users to a better approach which is available, ie. using the ClusteringEvaluator to evaluate their models.

@cloud-fan

Copy link
Copy Markdown
Contributor

ah i see. @mgaido91 can you resubmit it and update the description? The method is not deprecated now.

@mgaido91

Copy link
Copy Markdown
ContributorAuthor

sure, thanks @cloud-fan

jackylee-ch pushed a commit to jackylee-ch/spark that referenced this pull request Feb 18, 2019
…steringEvaluator
## What changes were proposed in this pull request?
The PR updates the examples for `BisectingKMeans` so that they don't use the deprecated method `computeCost` (see SPARK-25758).
## How was this patch tested?
running examples
Closesapache#22763 from mgaido91/SPARK-25764.
Authored-by: Marco Gaido <marcogaido91@gmail.com>
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@mgaido91@SparkQA@WeichenXu123@dongjoon-hyun@cloud-fan