Skip to content

[SPARK-6791] [ML] Add read/write for CrossValidator and Evaluators - #9848

Closed
jkbradley wants to merge 4 commits into
apache:masterfrom
jkbradley:cv-io
Closed

[SPARK-6791] [ML] Add read/write for CrossValidator and Evaluators#9848
jkbradley wants to merge 4 commits into
apache:masterfrom
jkbradley:cv-io

Conversation

@jkbradley

Copy link
Copy Markdown
Member

I believe this works for general estimators within CrossValidator, including compound estimators. (See the complex unit test.)

Added read/write for all 3 Evaluators as well.

CC: @mengxr@yanboliang

@SparkQA

Copy link
Copy Markdown

Test build #46369 has finished for PR 9848 at commit c11dfb3.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@jkbradleyjkbradley changed the title [WIP] [SPARK-6791] [ML] Add read/write for CrossValidator and Evaluators[SPARK-6791] [ML] Add read/write for CrossValidator and EvaluatorsNov 20, 2015
@jkbradley

Copy link
Copy Markdown
MemberAuthor

@mengxr@yanboliang Ready for review!

@SparkQA

Copy link
Copy Markdown

Test build #46394 has finished for PR 9848 at commit 1a29f23.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):\n * class CrossValidatorModelWriter(instance: CrossValidatorModel) extends MLWriter\n

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor: organize imports

@yanboliang

Copy link
Copy Markdown
Contributor

LGTM for me.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shall we add checks for OneVSRest and other meta-algorithms? It is okay to create a JIRA and leave a TODO here.

@mengxr

Copy link
Copy Markdown
Contributor

Made one pass.

…her metadata. Cleanups to CrossValidator save/load based on code review. Refactoring to eliminate some duplicate code.
@jkbradley

Copy link
Copy Markdown
MemberAuthor

OK, I believe that addressed everything. This includes a little refactoring to make sure callers to the default metadata save/load methods are using them correctly (and it eliminates some duplicate code).

@SparkQA

Copy link
Copy Markdown

Test build #46464 has finished for PR 9848 at commit ff54784.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):\n * class CrossValidatorModelWriter(instance: CrossValidatorModel) extends MLWriter\n

asfgit pushed a commit that referenced this pull request Nov 23, 2015
I believe this works for general estimators within CrossValidator, including compound estimators. (See the complex unit test.)
Added read/write for all 3 Evaluators as well.
CC: mengxr yanboliang
Author: Joseph K. Bradley <joseph@databricks.com>
Closes#9848 from jkbradley/cv-io.
(cherry picked from commit a6fda0b)
Signed-off-by: Xiangrui Meng <meng@databricks.com>
@mengxr

Copy link
Copy Markdown
Contributor

LGTM. Merged into master and branch-1.6. Thanks!

@jkbradley
jkbradley deleted the cv-io branch November 23, 2015 18:10
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@jkbradley@SparkQA@yanboliang@mengxr