letschat-server

This is a server that allows you to leverage the message api of ollama with any of the models available. You can link this up to a frontend. For the purposes of authentication, authorization, and data access, we are using Supabase.

Prerequisites

• Node.js (v18 or higher recommended)
• npm (comes with Node.js)
• Ollama
• Supabase

A working frontend is a Next.js app, which can be found here. You supabase credetials for the frontend will be used to authenticate the server.

We generate database schema in the supbase dashboard, see this for more information.

Setup

1. Gain access to common library:

   • Ask administrator for access to letschat-types library
   • add ssh key from letschat-types to your ssh-agent

   # Start SSH agent if neededeval"$(ssh-agent -s)"# Add your GitHub SSH key
   ssh-add ~/.ssh/id_rsa # or whatever key you use for GitHub

2. Install dependencies:

   npm i

3. Configure environment variables:

   cp .env.example .env

   Edit .env and set your configuration:

   • NODE_ENV - Set to production for production deployment (default: development)
   • DEFAULT_MODEL - The default model to use (not required)
   • PORT - Server port (default: 3000)
   • OLLAMA_HOST - Only needed for Docker deployment. URL for Ollama host (default: http://localhost:11434)
   • FRONTEND_DOMAIN - Only needed for Docker deployment. Frontend domain (default: http://localhost:3000)
   • SUPABASE_URL - Supabase URL for authentication (default: undefined)
   • SUPABASE_PUBLISHABLE_KEY - Supabase publishable key for authentication (default: undefined)

Running the Service

Development Mode

Run the server in development mode with hot reload:

npm run dev

Docker Deployment

Build the Docker image:

docker build --ssh default=$SSH_AUTH_SOCK --secret id=dotenv,src=.env -t letschat-server .

Run the container:

docker run -p 3000:3000 letschat-server

The server will start on http://localhost:5050.