Documentation
VoxGraph is an open-source starter kit for building real-time voice assistants. You run the Python server, connect a client (included mic script or your own app), and extend the pipeline with your prompts, tools, and UI.
This guide covers setup, the WebSocket protocol, configuration, memory, and how to customize the codebase for production experiments.
VoxGraph is an open-source project by Surya Raj. Backend: voxgraph.
Start here
- Introduction — What VoxGraph is and who it's for
- Quick start — Running locally in 5 minutes
- Architecture — Pipeline and components
- Build log — bugs & fixes — 51 backend issues and solutions
Integrate
- WebSocket API — Audio protocol and events
- Configuration — Environment variables
- Memory — Semantic facts and episodic turns
- Live mic client — Continuous voice sessions
Extend
- LLM providers — Gemini vs Ollama
- TTS providers — Deepgram Aura and ElevenLabs
- Customize — Intents, prompts, and your code