Skip to content

Add G2 DreamZero training and evaluation support - #1

Open
CoffeeDrivenCoder wants to merge 2 commits into
mainfrom
G2-DreamZero
Open

Add G2 DreamZero training and evaluation support#1
CoffeeDrivenCoder wants to merge 2 commits into
mainfrom
G2-DreamZero

Conversation

@CoffeeDrivenCoder

Copy link
Copy Markdown
Owner

研发内容

本 PR 增加 G2 场景下 DreamZero 的训练、推理、数据处理和评估支持。

  • 增加 G2 DreamZero 数据配置,包括 relative / absolute action 配置、action horizon、normalization 和 embodiment tag。
  • 扩展 DreamZero action head,支持 action-only training、motion mask、action loss 权重控制、endpoint/x0/start consistency loss,以及 video-to-action consistency。
  • 增加 G2 action adapter 保存与加载逻辑,支持从 DreamZero-AgiBot base checkpoint 加载共享权重,再严格加载 G2 action adapter。
  • 增加 LoRA checkpoint 加载约束,避免 LoRA delta 加载到错误 base model。
  • 增加 G2 / AgiBot checkpoint 评估、server rollout、open-loop、action sensitivity 和 action timeline 汇总工具。
  • 增加 G2 数据转换、repartition、active-hold window 构建、action adapter dataset 准备和 action 分布统计工具。

验证

  • git diff --cached --check
  • staged Python 文件 python -m py_compile

问题记录

  • HTTPS push 缺少 GitHub 凭据,已切换 origin 为 SSH 并成功推送。
  • 当前 PR 对应 commit:312b813f81ed1d012efe0c39316c6595e59b2df1

待办项

  • 补充完整训练结果和评估结果。
  • 根据 review 意见确认 action loss 权重、motion mask threshold 和 adapter checkpoint 加载约束。
  • 整理本地未提交的备份/重复文件。

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@CoffeeDrivenCoder