The Privacy Firewall for LLMs
-
Updated
Aug 11, 2025 - Python
The Privacy Firewall for LLMs
Multi-model LLM serving for NVIDIA DGX Spark with vLLM, web UI, and tool calling
Verify claims using AI agents that debate using scraped evidence and local language models.
AI tool to help users research using local LLMs and automated web search.
Private Retrieval-Augmented Generation (RAG) runtime enabling offline document intelligence using local embeddings and Ollama-hosted LLMs.
Bot for IRC and Discord with LocalLLM and LLM support
Sovereign AI Infrastructure: A Hardened-by-Design approach to private LLM deployment. Engineered for Fiscal Efficiency and zero-trust security.
Production-grade private LLM platform with local and NVIDIA inference, vLLM, Kubernetes, observability, and secure multi-user access.
Enterprise Document Q&A Chatbot powered by local RAG and Llama 3.3 (Groq). Fast, private, and free PDF search without external embedding APIs or vector databases.
To associate your repository with the private-llm topic, visit your repo's landing page and select "manage topics."