Skip to content

New example for evalutions - #688

Merged
mfeurer merged 10 commits into
developfrom
eval_example
May 13, 2019
Merged

New example for evalutions#688
mfeurer merged 10 commits into
developfrom
eval_example

Conversation

@Neeratyoy

Copy link
Copy Markdown
Contributor

What does this PR implement/fix? Explain your changes.

Adds a new example to fetch evaluations.

How should this PR be tested?

The examples/ folder has a new file named fetch_evaluations_tutorial.py.

Any other comments?

Currently, the example shows the following:

  • Fetch a task's evaluations
  • Create a CDF of predictive accuracy for all runs obtained
  • Create box plots to compare the predictive accuracy of the top 10 flows

Would like to have feedback on more additions to the example or plot enhancements.

Thanks.

@NeeratyoyNeeratyoy assigned Neeratyoy and mfeurer and unassigned Neeratyoy and mfeurerMay 6, 2019
@Neeratyoy
Neeratyoy requested a review from mfeurerMay 6, 2019 15:43
@codecov-io

codecov-io commented May 9, 2019

Copy link
Copy Markdown

Codecov Report

Merging #688 into develop will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@ Coverage Diff @@## develop #688 +/- ##
========================================
Coverage 90.35% 90.35% ========================================
Files 36 36 Lines 3785 3785 ========================================
Hits 3420 3420 Misses 365 365
Impacted FilesCoverage Δ
openml/datasets/functions.py95.66% <ø> (ø)⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7129cf0...98fecdd. Read the comment docs.

@mfeurer
mfeurer merged commit eec86a9 into developMay 13, 2019
@mfeurer
mfeurer deleted the eval_example branch November 12, 2019 10:09
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Neeratyoy@codecov-io@mfeurer