This application combines tldraw (a collaborative drawing tool) with AI services to generate product concepts from sketches. It features real-time collaboration and multi-modal AI generation (image, 3D, video).
- Frontend: React + TypeScript + tldraw + Three.js
- Backend: FastAPI + WebSocket for real-time collaboration
- AI Services:
- Google Gemini (prompt generation)
- Fal.ai (image, 3D model, video generation)
- Collaborative sketching with real-time sync
- AI-powered generation:
- Concept images from sketches
- 3D models from generated images
- Animated videos from images
- Cost tracking for API usage
- Real-time presence indicators
Install dependencies:
npm install # Frontend poetry install # Backend
Set environment variables:
- GOOGLE_API_KEY
- FAL_KEY
Run development server:
npm run dev # Frontend python main.py # Backend