Open source · self-hostable
Best open-source voice agents
The open-source voice agents in the index — self-hostable, inspectable, and free to run. Ranked by real maintained adoption (GitHub stars and recent commit activity), never by sponsorship. Open source buys you control, privacy, and no vendor lock-in; the trade-off is that you host and maintain it yourself. Right now it's led by Pipecat (16k stars), with LiveKit Agents and xiaozhi-esp32-server close behind. Rankings shift as projects gain stars and ship commits.
PipecatFrameworkCompose voice and multimodal agents with Python processing pipelines.Open sourcePython · BSD-2-ClauseVerified · Active 16kGitHub starsLiveKit AgentsFrameworkBuild voice and multimodal agents that participate in LiveKit rooms.Open sourcePython · Apache-2.0Verified · Active 14kGitHub starsxiaozhi-esp32-serverInfrastructureBackend service for xiaozhi-esp32 -- helps you quickly build an ESP32 device control server.Open sourceJavaScript · MITVerified · Active 11kGitHub starsten-vadSDK / libraryVoice Activity Detector (VAD): low-latency, high-performance and lightweightOpen sourceCVerified 2.3kGitHub starsbailingAgentA GPT-4o-like voice conversation robot built from ASR+LLM+TTS, integrating strong models like DeepSeek R1 and openClaw -- a genuine personal voice assistant with latency as low as 800ms.Open sourcePython · MITVerified 1.8kGitHub starsCyberVersePlatformSelf hosted, real-time digital human agent platform. Build voice-first AI agents with WebRTC, persona memory, tools, RAG, and optional digital-human video.Open sourcePython · GPL-3.0Verified · Active 1.7kGitHub starsWallyAgentRun open models on your own machine, or hosted when the job outgrows it.Open sourceC++ · MITVerified · Active 1.6kGitHub starsPatterSDK / libraryOpen-source voice-AI SDK. The Vapi/Retell alternative for builders who want to own the stack.Open sourcePython · MITVerified · Active 1.1kGitHub starsrustpbxInfrastructureA PBX written by rustOpen sourceRust · MITVerified · Active 812GitHub starsechokit_serverPlatformOpen Source Voice Agent PlatformOpen sourceRust · GPL-3.0Verified 591GitHub starsStarmoonFrameworkConversational AI device and software framework; upstream is deprecated.Open sourceTypeScript · GPL-3.0Verified 549GitHub starsJARVISAgentYour own personal voice assistant: Voice to Text to LLM to Speech, displayed in a web interfaceOpen sourcePython · GPL-3.0Verified 528GitHub stars
Make your product part of the discovery.Explore advertising 
ai-avatar-systemAgentAI Avatar / digital human platform — upload a photo, clone a voice, talk to any face in real time with lip-sync video. Open-source, self-hosted. Claude · Whisper · Chatterbox · MuseTalk.Open sourcePython · MITVerified · Active 507GitHub starsDeepgram Python SDKSDK / libraryPython client library for Deepgram APIs; hosted service usage is separate.Open sourcePython · MITVerified · Active 468GitHub starsxybridSDK / libraryBuild apps powered by on-device AIOpen sourceRust · Apache-2.0Verified · Active 460GitHub starsbolnaAgentEnd-to-end platform for building voice first multimodal agentsOpen sourcePython · MITVerified 433GitHub starssutandoAgentMy AI Stand. Realtime by day, rewriting itself by night. Summon my AI superpower.Open sourcePython · MITVerified · Active 397GitHub starsagent-second-brainAgentAn always-on second brain you talk to. Voice notes in Telegram → typed, linked knowledge in your Obsidian vault. Runs 24/7 on the Claude subscription you already have.Open sourcePython · MITVerified 388GitHub starsLLMVoXSDK / libraryLLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLMOpen sourcePythonVerified 312GitHub starsDeepgram JavaScript SDKSDK / libraryJavaScript client library for Deepgram APIs; hosted service usage is separate.Open sourceTypeScript · MITVerified · Active 274GitHub starsM.I.L.E.SAgentM.I.L.E.S, a GPT-4-Turbo voice assistant, self-adapts its prompts and AI model, can play any Spotify song, adjusts system and Spotify volume, performs calculations, browses the web and internet,Open sourcePython · MITVerified 236GitHub starsgdansk-aiAgentFull stack voice chatbotOpen sourceTypeScript · GPL-2.0Verified 199GitHub starsactive-callAgentA SIP/WebRTC voice agentOpen sourceRustVerified · Active 190GitHub starsaxiom-voice-agentAgentRun a <400ms latency Voice Agent on just 4GB VRAM. Fully offline, no API keys required. Optimized for GTX 1650 and edge robotics with zero-copy inference. (Apache 2.0)Open sourcePython · Apache-2.0Verified 147GitHub starsBentoVoiceAgentAgentBuild Phone Calling Voice Agent fully powered by open source models.Open sourcePythonVerified 132GitHub starsAI-Voice-AgentAgentSelf-hosted AI voice agentOpen sourcePython · MITVerified · Active 41GitHub stars
Frequently asked
- What are the best open-source voice agents?
- The projects listed below, ranked by maintained adoption — GitHub stars plus recent activity — so you see what's genuinely used and still maintained, not abandoned.
- Are open-source voice agents free?
- The software is free to run and self-host. You still pay for the infrastructure you run it on and any model or API usage it makes.
- Open-source or commercial voice agents — which should I choose?
- Pick open source for control, privacy, and no lock-in when you're happy to host and maintain it; pick a commercial product for a managed, supported experience. You can compare both in the full voice agents category.