[Feature] Support Evaluation in VL-LN Bench by 0309hws · Pull Request #193 · InternRobotics/InternNav

0309hws · 2025-12-11T15:40:49Z

📊 Extended Evaluation Support

Support IION evaluation
Support Object evaluation

…nd agent created

update folder structure

* update vln yaml; fix import agent * update habitat, using evaluator and config; env and agent is WIP * add distributed_base evaluator * Habitat env applied, distributed evaluator applied; clean evaluator and agent created * fix observation issues * update new register name; tiny fix on style * latest tested * delete temp agent; rename default evaluator for habitat * update slurm bash * update readme * fix init dist print * fix eval config; fix local rank to rank * update init distributed mode if condition * update dist for dlc * fix bug in evaluator * [test] dialog+object * [Feature] Add testing code for VLLN * [Feature] Add testing code for VLLN * [Feature] Add testing code for VLLN * fix bugs; refactor env * update code, merge dev; fix bug * add raise flag in agent * update a readme for vlln * fix bug in dialog evaluator * add back save video * fix video save path * [FIX] vlln bugs * [FIX] modify the annotations and some small bugs * [FIX] change some annotations * update folder structure * [FIX] delete files * [FIX] docstrings * [FIX] fix docstrings * [FIX] fix docstrings * [FIX] fix docstrings * [FIX] numpy version * [FIX] fix docstrings. * [FIX] fix docstrings. --------- Co-authored-by: wangyukai <kewa990809@gmail.com> Co-authored-by: 0309hws <huangwensi@pjlab.org.cn>

kew6688and others added 21 commits November 3, 2025 08:11

update vln yaml; fix import agent
0112c69

update habitat, using evaluator and config; env and agent is WIP
05ea2a3

add distributed_base evaluator
9902401

Habitat env applied, distributed evaluator applied; clean evaluator a…
0d00014
…nd agent created

fix observation issues
7e25e72

update new register name; tiny fix on style
2b0eb8b

latest tested
b414ba3

delete temp agent; rename default evaluator for habitat
99adf73

update slurm bash
75b38a7

merge to main
dcf7ee5

update readme
08bb9c3

fix init dist print
cde84b3

fix eval config; fix local rank to rank
c89723d

update init distributed mode if condition
7836276

update dist for dlc
dac13e1

fix bug in evaluator
d8734c7

[test] dialog+object
fb21071

merge dev
4ecb613

[Feature] Add testing code for VLLN
cd00d1e

[Feature] Add testing code for VLLN
ee69a31

[Feature] Add testing code for VLLN
1d5a16a

Tai-Wang requested review from kew6688 and yuqiang-yang December 14, 2025 08:34

kew6688 added 5 commits December 16, 2025 06:57

fix bugs; refactor env
8607b2d

Merge branch 'dev' into code_review
7aa020d

update code, merge dev; fix bug
c1e59fb

add raise flag in agent
7058317

update a readme for vlln
f6955a1

yuqiang-yang requested changes Dec 16, 2025
View reviewed changes

kew6688 reviewed Dec 17, 2025
View reviewed changes

Comment threadscripts/eval/configs/instance_dialog.yaml Outdated

Tai-Wang reviewed Dec 22, 2025
View reviewed changes

Comment threadinternnav/habitat_extensions/vlln/utils/dialog_dataset.py Outdated

Tai-Wang reviewed Dec 22, 2025
View reviewed changes

Comment threadinternnav/habitat_extensions/vlln/utils/dialog_episodes.py Outdated

kew6688and others added 3 commits December 22, 2025 06:01

update folder structure
a7b15eb

Merge pull request#2from kew6688/fix_habitat_extensions
895710d
update folder structure

[FIX] delete files
8445356

kew6688 approved these changes Dec 23, 2025
View reviewed changes

[FIX] docstrings
0c589aa