A flexible Python front-end inference SDK based on TensorRT
classificationconvolutional-neural-networksobject-detectionsemantic-segmentationtensorrtscene-text-recognitionpython-frontinference-sdk
-
Updated
Apr 30, 2021 - Python
A flexible Python front-end inference SDK based on TensorRT
Onde Inference Swift SDK
UniRT — on-device LLM/VLM/embedding inference SDK. Prebuilt wheels and native libraries (Python/Android/iOS), no toolchain needed, plus an OpenAI-compatible server with tool calling, constrained output, embeddings and rerank. Source: SesameH/Edge-AI.
Computer vision project using a deployed YOLOv11 model fine-tuned with Roboflow to detect the result of a Tic Tac Toe board from a live camera and display it to a third-party feed (OBS Studio, Zoom, etc.)
To associate your repository with the inference-sdk topic, visit your repo's landing page and select "manage topics."