This specifically concerns the info print outs during download and loading:
Example in Download routine:
| print(f"Downloaded '{file_url}' to '{file_name}'") |
Example in cd.load() rountine:
| print(f"Importing raw data ...", file=sys.stderr) |
Those could be moved to logging routine for easier and more robust handling. See for example:
| logger=logging.getLogger(__name__) |
| ifargs.LOGLEVEL=='info': |
| loglevel=logging.INFO |
| elifargs.LOGLEVEL=='debug': |
| loglevel=logging.DEBUG |
| else: |
| loglevel=logging.WARNING |
| |
| logging.basicConfig( |
| format="{asctime} - {levelname} - {message}", |
| style="{", |
| datefmt="%Y-%m-%d %H:%M", |
| level=loglevel |
| ) |
| logger.info("importing datasets...") |
This specifically concerns the info print outs during download and loading:
Example in Download routine:
coderdata/coderdata/download/downloader.py
Line 104 in 8fadc34
Example in
cd.load()rountine:coderdata/coderdata/dataset/dataset.py
Line 433 in 8fadc34
Those could be moved to
loggingroutine for easier and more robust handling. See for example:coderdata/scripts/prepare_data_for_improve.py
Line 14 in 0c724de
coderdata/scripts/prepare_data_for_improve.py
Lines 99 to 111 in 0c724de
coderdata/scripts/prepare_data_for_improve.py
Line 130 in 0c724de