Feat/progress

[PGijsbers]

• Adds a progress bar to MinIO downloads
• When download_all_files=True, only download the files which do not yet exist in cache. Overwriting is no longer necessary, as it was a crutch that was built before force_refresh_cache was added to the get_dataset method. This means we now can also avoid re-downloading image datasets over and over again.

WIP:

• add/update test for cache behavior
• update release notes

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 62.96296% with 10 lines in your changes missing coverage. Please review.

Project coverage is 84.28%. Comparing base (b4d038f) to head (dcbdb78).

Files with missing lines	Patch %	Lines
openml/utils.py	40.00%	9 Missing ⚠️
openml/config.py	87.50%	1 Missing ⚠️

Additional details and impacted files

@@ Coverage Diff @@## develop #1335 +/- ##
===========================================
+ Coverage 84.25% 84.28% +0.03% 
===========================================
Files 38 38 Lines 5270 5293 +23 ===========================================
+ Hits 4440 4461 +21 - Misses 830 832 +2 

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[eddiebergman]

Should this explicitly cast to bool somewhere? I found this line in the parsing of the Config which seems to suggest it needs explicit handling to convert to booleans.

openml-python/openml/config.py

Lines 336 to 340 in 8d03243

	ifisinstance(config["FAKE_SECTION"]["avoid_duplicate_runs"], str):
	config["FAKE_SECTION"]["avoid_duplicate_runs"] =config["FAKE_SECTION"].getboolean(
	"avoid_duplicate_runs"
	) # type: ignore
	returndict(config.items("FAKE_SECTION")) # type: ignore

[PGijsbers]

Yikes, can't believe I missed that. Thanks.
It turns out that this didn't work either. Setting avoid_duplicate_runs would actually give me a TypeError (wasn't allowed to set a boolean value to the Config object), so I rewrote this and added a regression test.

[eddiebergman]

Did a brief look at configparser and get_boolean() for common methods of specifying True/False in raw text. Covered my concerns, never knew about it, seems super useful!

[PGijsbers]

Honestly if we did it again I would probably just use toml files, which are typed.

[PGijsbers]

@eddiebergman the review request is still open. It needs explicit approval.

[eddiebergman]

Ahh sorry, thought it was just a thing of getting some feedback, not explicit approval, my bad