llama-cpp-rs

Rust bindings for llama.cpp. Minimal, close to raw bindings, kept up to date with upstream.

Quick start

git clone --recursive https://github.com/intentee/llama-cpp-bindings
cd llama-cpp-bindings
cargo build --release

Add --features cuda for GPU acceleration.

Name		Name	Last commit message	Last commit date
.claude		.claude
.github		.github
llama-cpp-bindings-build		llama-cpp-bindings-build
llama-cpp-bindings-sys		llama-cpp-bindings-sys
llama-cpp-bindings-tests		llama-cpp-bindings-tests
llama-cpp-bindings-types		llama-cpp-bindings-types
llama-cpp-bindings		llama-cpp-bindings
llama-cpp-error-recorder		llama-cpp-error-recorder
llama-cpp-ffi-status		llama-cpp-ffi-status
llama-cpp-gbnf		llama-cpp-gbnf
llama-cpp-log-decoder		llama-cpp-log-decoder
llama-cpp-test-harness-macros		llama-cpp-test-harness-macros
llama-cpp-test-harness		llama-cpp-test-harness
llama-cpp-wrapper-sources		llama-cpp-wrapper-sources
.clang-tidy		.clang-tidy
.editorconfig		.editorconfig
.gitignore		.gitignore
.gitmodules		.gitmodules
AGENTS.md		AGENTS.md
CLAUDE.md		CLAUDE.md
Cargo.lock		Cargo.lock
Cargo.toml		Cargo.toml
LICENSE		LICENSE
Makefile		Makefile
README.md		README.md
package-lock.json		package-lock.json
package.json		package.json
requirements-lint.txt		requirements-lint.txt
rust-toolchain.toml		rust-toolchain.toml
rustfmt.toml		rustfmt.toml
shell.nix		shell.nix