devtech

Here is 1 public repository matching this topic...

FlosMume / CUDA-AI-Inference-Starter

A minimal, high-performance starter kit for running AI model inference on NVIDIA GPUs using CUDA. Includes environment setup, sample kernels, and guidance for integrating ONNX/TensorRT pipelines for fast, optimized inference on modern GPU hardware.

benchmarking deep-learning cuda nvidia high-performance-computing fp16 int8 inference-engine onnx tensor-rt devtech model-optimization gpu-inference ai-deployment adge-ai

Updated Nov 2, 2025
Cuda

Improve this page

Add a description, image, and links to the devtech topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the devtech topic, visit your repo's landing page and select "manage topics."

Learn more