🚀 Rax CLI - Next-Gen Offline AI

Fast, secure, and context-aware offline AI assistant powered by Llama 3.2.

Features

• 🤖 Claude Code-style Interface - Just type and chat, no need to prefix every message
• 💾 Persistent Chat History - All conversations auto-saved locally
• 📁 Project Context - Automatically includes relevant files from your project
• 🎨 Interactive TUI - Beautiful full-screen chat interface
• 🔒 100% Offline - No data leaves your machine
• 🧠 CPU Optimized - Runs on CPU with Llama-3.2-1B (~650MB model)

Installation

Option 1: Official apt Repository (Recommended for Ubuntu/Debian)

# Add the repository key
curl -fsSL https://raxcore-dev.github.io/rax-offline-cli/repo.key | \
sudo gpg --dearmor -o /usr/share/keyrings/rax-archive-keyring.gpg
# Add the repositoryecho"deb [signed-by=/usr/share/keyrings/rax-archive-keyring.gpg] https://raxcore-dev.github.io/rax-offline-cli/ /"| \
sudo tee /etc/apt/sources.list.d/rax.list
# Update and install
sudo apt update
sudo apt install rax

Option 2: Download .deb Package

# Download the latest release
wget https://github.com/Raxcore-dev/rax-offline-cli/releases/latest/download/rax_0.1.0_amd64.deb
# Install
sudo apt install ./rax_0.1.0_amd64.deb

Option 3: Official Installer Script

# Download and run the installer
curl -fsSL https://raw.githubusercontent.com/Raxcore-dev/rax-offline-cli/main/install-official.sh | bash

Option 4: Build from Source

# Clone the repository
git clone https://github.com/rax-cli/rax-cli.git
cd rax-cli
# Build
cargo build --release
# Run
./target/release/rax
# Or install system-wide
./install.sh

Quick Start

After installation, just run:

rax

The first run will:

1. Show a welcome screen
2. Download the AI model (~650 MB, one-time)
3. Start the interactive chat

Usage

Basic Chat

rax # Start interactive chat
rax "What is Rust?"# Quick single question
rax -c "Fix this code"# Include project context
rax -i # Full TUI mode

Interactive Commands

/help # Show commands
/clear # Clear chat history
/list # List saved conversations
/save # Save current chat
/quit # Exit

CLI Options

rax -i # Full TUI mode
rax -c "Question"# Include project context
rax --list-chats # List all conversations
rax --resume 3 # Resume conversation #3
rax --delete-chat 2 # Delete conversation #2
rax --status # Show install status
rax --uninstall # Remove model & data
rax --export chat.md # Export chat to Markdown

Examples

Chat about code

❯ What does this Rust code do?
🤖 This code implements a thread-safe counter using Arc and Mutex...

Get help with errors

❯ I'm getting a borrow checker error
🤖 The borrow checker is complaining because you're trying to...

Project context

# Automatically includes relevant files
rax -c "How can I improve this architecture?"

Data Storage

All data stored locally in ~/.local/share/RaxCli/:

• model.gguf - The Llama model (downloaded once)
• chat_history.json - All conversations
• config.json - Settings
• context_cache.json - Cached project files

Uninstall

# Remove package (keeps chat history)
sudo apt remove rax
# Remove completely (including chat history)
sudo apt purge rax
# Or manually
rm -rf ~/.local/share/RaxCli

Requirements

For apt Installation

• Ubuntu 20.04+ or Debian 11+
• curl or wget

For Source Installation

• Rust 1.70+
• build-essential, libssl-dev, pkg-config
• ~700MB disk space for model
• 4GB+ RAM recommended

Keyboard Shortcuts

Key	Action
Enter	Send message
Ctrl+C	Exit
Esc	Exit (TUI mode)
↑/↓	Scroll history (TUI)

Troubleshooting

Model download fails

# Retry by running rax again
rax

Check installation status

rax --status

Re-download model

rax --update-model

Permission denied

# Make sure the binary is executable
chmod +x ~/.local/bin/rax

Development

Build

cargo build --release

Test

cargo test

Build .deb package

./build-deb.sh

Update apt Repository

./update-repo.sh

CI/CD

The project uses GitHub Actions for:

• CI: Build and test on every push/PR
• Release: Create GitHub releases with artifacts
• Deploy: Automatically deploy apt repository to GitHub Pages

Project Structure

rax-cli/
├── src/
│ └── main.rs # Main application code
├── .github/
│ └── workflows/
│ ├── ci.yml # Continuous integration
│ ├── release.yml # Release automation
│ └── deploy-repo.yml # apt repository deployment
├── repo/
│ └── ... # apt repository structure
├── build-deb.sh # Debian package builder
├── install-official.sh # Official installer script
└── README.md # This file

License

MIT License - see LICENSE for details.

Credits

Built with:

• llama-cpp-2 - Rust bindings for llama.cpp
• Llama 3.2 - Meta's efficient LLM
• indicatif - Progress bar library
• crossterm - Terminal manipulation
• clap - Command line argument parser

Contributing

1. Fork the repository
2. Create a feature branch (git checkout -b feature/amazing-feature)
3. Commit your changes (git commit -m 'Add amazing feature')
4. Push to the branch (git push origin feature/amazing-feature)
5. Open a Pull Request

Support

• Issues: GitHub Issues
• Discussions: GitHub Discussions
• Documentation: Wiki