feat(inference): allow setting custom inference timeout - #672

Merged

johntmyers merged 4 commits into

NVIDIA:mainfrom

pentschev:inference-timeout

Mar 30, 2026

Commits on Mar 30, 2026

feat(inference): add timeout
pentschev
authored and
johntmyers
committed
d4808f9
feat(inference): fix dynamic timeout change
pentschev
authored and
johntmyers
committed
f3ccc94
feat(inference): update docs
pentschev
authored and
johntmyers
committed
a5d92aa
feat(inference): fix formatting
pentschev
authored and
johntmyers
committed
45c7844