Uh oh!
There was an error while loading. Please reload this page.
Updated Cosmos3 client to work with vllm-omni server - #26
Open
MaciejBalaNV wants to merge 2 commits into
Open
Conversation
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Signed-off-by: Maciej Bala <mbala@nvidia.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This PR adds a support for a RoboLab client in vllm-omni. We achieve this by:
MsgPackWebSocketTransportthat handles metadata handshake and auth.remote-uriandremote-token- first one is important for choosing the endpoint, second one is important for auth.Additionally, did some refactoring of the DreamZero model to avoid duplication of the MsgPack code.
On vllm-omni side this PR also needs to be merged: vllm-project/vllm-omni#6460
PR type
policies/<name>/) — requires a paper/project reference and prior contact with the maintainers (see CONTRIBUTING.md)Checklist
git commit -s) — see DCOApache-2.0, NVIDIA copyright — copy from any existing file)THIRD_PARTY_NOTICES.md.usd, meshes, textures, images) are tracked with git-LFSuv run pytest tests/passes locallydocs/robots.md)Asset attribution