Skip to content

[ENH] V1 → V2 API Migration - evaluations - #1606

Merged
PGijsbers merged 247 commits into
openml:mainfrom
EmanAbdelhaleem:evaluations-mig
Mar 24, 2026
Merged

[ENH] V1 → V2 API Migration - evaluations#1606
PGijsbers merged 247 commits into
openml:mainfrom
EmanAbdelhaleem:evaluations-mig

Conversation

@EmanAbdelhaleem

@EmanAbdelhaleemEmanAbdelhaleem commented Jan 7, 2026

Copy link
Copy Markdown
Contributor

Fixes#1623
Depends on #1576
Related to #1575

Details

This PR implements Evaluations resource, and refactor its existing functions

fkiraly
fkiraly previously requested changes Jan 7, 2026

@fkiralyfkiraly left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks like circular imports

@geetu040geetu040 mentioned this pull request Jan 9, 2026
18 tasks
@EmanAbdelhaleem

Copy link
Copy Markdown
ContributorAuthor

@geetu040 We have circular imports here cuz of importing OpenMLEvaluation

Error message:

 File "D:\Work\ESoC\Developing\openML\openml-python\scripts\reproduce_issues.py", line 1, in <module>
import openml
File "D:\Work\ESoC\Developing\openML\openml-python\openml\__init__.py", line 21, in <module>
from . import (
File "D:\Work\ESoC\Developing\openML\openml-python\openml\evaluations\__init__.py", line 3, in <module>
from .evaluation import OpenMLEvaluation
File "D:\Work\ESoC\Developing\openML\openml-python\openml\evaluations\evaluation.py", line 7, in <module>
import openml.runs
File "D:\Work\ESoC\Developing\openML\openml-python\openml\runs\__init__.py", line 3, in <module>
from .functions import (
File "D:\Work\ESoC\Developing\openML\openml-python\openml\runs\functions.py", line 32, in <module>
from openml.tasks import (
File "D:\Work\ESoC\Developing\openML\openml-python\openml\tasks\__init__.py", line 3, in <module>
from .functions import (
File "D:\Work\ESoC\Developing\openML\openml-python\openml\tasks\functions.py", line 15, in <module>
from openml._api import api_context
File "D:\Work\ESoC\Developing\openML\openml-python\openml\_api\__init__.py", line 1, in <module>
from openml._api.runtime.core import APIContext
File "D:\Work\ESoC\Developing\openML\openml-python\openml\_api\runtime\core.py", line 10, in <module>
from openml._api.resources import (
File "D:\Work\ESoC\Developing\openML\openml-python\openml\_api\resources\__init__.py", line 2, in <module>
from openml._api.resources.evaluations import EvaluationsV1, EvaluationsV2
File "D:\Work\ESoC\Developing\openML\openml-python\openml\_api\resources\evaluations.py", line 8, in <module> from openml.evaluations.evaluation import OpenMLEvaluation
ImportError: cannot import name 'OpenMLEvaluation' from partially initialized module 'openml.evaluations.evaluation' (most likely due to a circular import) (D:\Work\ESoC\Developing\openML\openml-python\openml\evaluations\evaluation.py)```

@geetu040geetu040 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please update the listing functionality with the suggested approach in #1575 (comment). And also sync this PR with my base PR.

@geetu040geetu040 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

update with #1576 (comment)

@geetu040geetu040 self-assigned this Mar 23, 2026

@geetu040geetu040 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@EmanAbdelhaleem Thanks for the PR. Nicely done!
I have updated the PR to sync with latest changes in base PR.

@PGijsbers please review/merge.

@PGijsbersPGijsbers left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@PGijsbers
PGijsbers merged commit 8ff14eb into openml:mainMar 24, 2026
27 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[ENH] V1 → V2 API Migration - evaluations

8 participants

@EmanAbdelhaleem@geetu040@codecov-commenter@fkiraly@PGijsbers@Omswastik-11@satvshr@SimonBlanke