Uh oh!
There was an error while loading. Please reload this page.
Add outcome-aware dataset fragments - #547
Draft
yuecideng wants to merge 1 commit into
Draft
Conversation
Add stable per-segment outcomes and dense provenance annotations, persist accepted segments as independent LeRobot episodes, and constrain online sampling by acceptance and continuity. Checkpoint capture and resume remain intentionally deferred.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This PR adds stable per-segment outcome and provenance annotations to demonstration execution and lets collectors persist eligible program segments as independent LeRobot episodes.
The change preserves successful work from partially failed expert programs without conflating segment quality with episode termination. The storage design follows the current LeRobot Dataset v3 episode/task model, while using EmbodiChain-owned names such as
segment_acceptedinstead of overloading policy/evaluation fields such asnext.success.Key changes:
DemoExecutionCfgwithcontinuousandsegment_fragmentspersistence modes;Checkpoint capture, restore, and resume are intentionally deferred until an authoritative restore port exists. This PR records
continuity_idfor forward compatibility, with current executions remaining in continuity region zero.Design: segment outcome and resume plan
LeRobot references: Datasets v3 overview, current dataset API
Dependencies: None. The existing LeRobot version constraint is unchanged.
Issue: None.
Type of change
Screenshots
Not applicable; this change has no visual UI.
Validation
black .— 748 files unchangedpython docs/scripts/check_api_docs.py— 1427/1427 exports documentedpython -m pytest -q tests/gym/envs tests/data_pipeline tests/lab/scripts/test_run_env.py tests/gym/utils/test_gym_utils.py -m "not requires_sim and not gpu" --disable-warnings --maxfail=20— 680 passed, 1 skipped, 22 deselectedpython -m pytest -q tests/docs --confcutdir=tests/docs --disable-warnings— 20 passedgit diff --check— passedThe full simulator/GPU suite was not run locally; those markers were excluded from the proportional affected-area test run.
Checklist
black .command to format the code base.python docs/scripts/check_api_docs.py).