Callia - Real Time Voice Assistant

Callia is a modular real-time voice assistant that is attuned to your every word! It listens on the microphone, detects when you're speaking, transcribes your speech, and synthesizes a spoken response. The following is an illustration of the pipeline -

🛠️ Installation

Please proceed with the following steps:

1. Clone the repository

   git clone https://github.com/XynoCrest/CalliaAI

   cd CalliaAI

2. Create and activate a virtual environment (example using anaconda)

   conda create -p venv python=3.10

   conda activate venv/

3. Install Dependencies

   pip install -r requirements.txt

4. Install MPV

   • Download and Install MPV
   • Add the folder containing mpv.exe to your PATH environment variable.
   • MPV is required to play the stream output audio.

🔑 API Keys

Please insert your API keys in key_retriever.py

defget_elevenlabs_key():
# List of ElevenLabs Keyskeys= [] <-Addyourkeyasalistitem

• At least one GROQ and one ElevenLabs API Key is required!

• To stop git from tracking changes to your key_retriever.py, execute -

   git update-index --assume-unchanged key_retriever.py

▶️ Running Callia

Once you have installed everything perfectly, simply run -

pythonmain.py

You can finally start taking to Callia! Once input is detected the pipeline will:

1. Transcribe your speech
2. Generate a spoken response
3. Play it back to you! Pretty neat huh?

📁 Project Structure

Here's what each file in this repository is for:

Callia/
├── main.py # Entry point
├── config.py # Configuration
├── vad.py # Voice Activity Detection
├── vad_utils.py # VAD model utilities
├── vad_model.jit # TorchScript compiled AI model
├── transcriber.py # Speech-to-text handler
├── inference.py # Generates Text-to-Text Response
├── synthesis.py # TTS using ElevenLabs
├── key_retriever.py # Your API key(s) retriever
├── requirements.txt # Dependencies
├── .gitignore # Tells git what to ignore
└── README.md # You're reading this