Refine rl component bundle

[Huoran Li (lihuoran)]

Description

• Refine rl_component_bundle. Use a more straightforward & easier way to organize. In this new version, we do not need easyrl anymore.
• Update related examples.
• Fix bugs in distributed training. Add config YAML file for distributed training in CIM scenario.
• Add rl_formulation.ipynb as an example.

Linked issue(s)/Pull request(s)

• issue_number

Type of Change

• Non-breaking bug fix
• Breaking bug fix
• New feature
• Test
• Doc update
• Docker update

Related Component

• Simulation toolkit
• RL toolkit
• Distributed toolkit

Has Been Tested

• OS:
  • Windows
  • Mac OS
  • Linux
• Python version:
  • 3.7
  • 3.8
  • 3.9
• Key information snapshot(s):

Needs Follow Up Actions

• New release package
• New docker image

Checklist

• Add/update the related comments
• Add/update the related tests
• Add/update the related documentations
• Update the dependent downstream modules usage

[codecov]

Codecov Report

Merging #549 (1167fdc) into v0.3 (9fd91ff) will not change coverage.
The diff coverage is 100.00%.

@@ Coverage Diff @@## v0.3 #549 +/- ##
=======================================
Coverage 79.30% 79.30% =======================================
Files 86 86 Lines 5464 5464 =======================================
Hits 4333 4333 Misses 1131 1131 

Flag	Coverage Δ
unittests	79.30% <100.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
maro/simulator/abs_core.py	82.89% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.