Aylin is an open-source platform for building and deploying real-time AI voice agents. Users can create voice assistants by configuring instructions, LLM, TTS, and STT providers — no code required.
Built on LiveKit Agents, Aylin handles the infrastructure so you can focus on building your agent's behavior.
aylin/
├── apps/
│ ├── backend/ # Node.js + Express REST API & LiveKit token server
│ ├── frontend/ # React + TypeScript dashboard UI
│ └── agent/ # Python LiveKit agent worker
└── azure-deploy/ # Kubernetes manifests & deployment scripts for AKS
The three apps run independently and communicate over HTTP/WebSocket:
Browser ──► Frontend (Vite, :5173 dev / :80 prod)
│
▼
Backend (:3000) ──► PostgreSQL
│ │
▼ │
LiveKit Cloud (agent reads
│ config from DB)
▼
Agent Worker (Python)
- Create, edit, and delete voice agents with a web UI
- Configure per-agent instructions, voice, and model settings
- TTS providers: OpenAI, Cartesia
- STT providers: OpenAI, AssemblyAI
- LLM providers: OpenAI
- LiveKit real-time audio integration
- Google OAuth login
- Google Calendar and Sheets integration
- Phone call support via LiveKit SIP including inbound and outbound calls
- Telephony integration with Twilio and trunk providers like Telnyx
- Azure Kubernetes deployment scripts included
| Requirement | Version | Notes |
|---|---|---|
| Node.js | 18+ | For backend & frontend |
| Python | 3.9+ | For the agent worker |
| PostgreSQL | 14+ | Local or hosted |
| LiveKit | Any | LiveKit Cloud (free tier available) |
API keys you'll need:
- LiveKit — API key & secret (required)
- OpenAI — API key (required for LLM/TTS/STT)
- Cartesia — API key (optional, for Cartesia TTS)
- AssemblyAI — API key (optional, for AssemblyAI STT)
- Google OAuth credentials (optional, for Google login)
cd apps/backend
npm install
cp .env.example .env
# Fill in your LiveKit credentials and database URL in .env
npm run devThe backend starts at http://localhost:3000.
cd apps/frontend
npm install
cp .env.example .env
# .env.example works as-is for local development
npm run devThe frontend starts at http://localhost:5173.
cd apps/agent
python -m venv venv
source venv/bin/activate # Windows: venv\Scripts\activate
pip install -r requirements.txt
cp .env.example .env
# Fill in your LiveKit and AI provider API keys in .env
python agent.py devGo to http://localhost:5173, sign in, and create your first agent from the Agents page. Test it live in the Playground.
| Variable | Required | Description |
|---|---|---|
LIVEKIT_URL | Yes | LiveKit server WebSocket URL |
LIVEKIT_API_KEY | Yes | LiveKit API key |
LIVEKIT_API_SECRET | Yes | LiveKit API secret |
DATABASE_URL | Yes | PostgreSQL connection string |
JWT_SECRET | Yes | Secret for signing JWT tokens |
SESSION_SECRET | Yes | Secret for session cookies |
GOOGLE_CLIENT_ID | No | Google OAuth client ID |
GOOGLE_CLIENT_SECRET | No | Google OAuth client secret |
LIVEKIT_SIP_ENDPOINT | No | LiveKit SIP URI for phone call support |
| Variable | Required | Description |
|---|---|---|
LIVEKIT_URL | Yes | LiveKit server WebSocket URL |
LIVEKIT_API_KEY | Yes | LiveKit API key |
LIVEKIT_API_SECRET | Yes | LiveKit API secret |
OPENAI_API_KEY | No | OpenAI API key |
CARTESIA_API_KEY | No | Cartesia TTS API key |
ASSEMBLYAI_API_KEY | No | AssemblyAI STT API key |
| Variable | Required | Description |
|---|---|---|
VITE_API_URL | Yes | Backend API base URL (default: http://localhost:3000/api) |
Backend: Node.js, Express, TypeScript, PostgreSQL, LiveKit Server SDK
Frontend: React 18, TypeScript, Vite, React Router, i18next, LiveKit Components
Agent: Python 3.9+, LiveKit Agents SDK, OpenAI, Cartesia, AssemblyAI
Kubernetes manifests and deployment scripts for Azure AKS are in azure-deploy/.
A GitHub Actions workflow is included for CI/CD to Azure Container Registry + AKS.
Contributions are welcome. Please open an issue to discuss what you'd like to change before submitting a pull request.
- Fork the repository
- Create a feature branch (
git checkout -b feature/my-feature) - Commit your changes
- Open a pull request