Flint

Flint is a RustScript-native AI inference framework with host functions for Torch, llama.cpp, stable-diffusion.cpp, GGML, tokenization, and safetensors.

Quick start

cargo install rs-flint

Documentation

• Flint reference
• Runtime guides
• Runtime implementation guide