Skip to content
Agent Search Engine.

System class · No. 06

Voice Agents

AI agents that hold real-time voice conversations for calls, support, and assistants.

33 records · independent index · how we rank

Voice agents hold real-time spoken conversations — answering and placing phone calls, running support lines, and powering assistants — by stitching speech-to-text, an LLM, and text-to-speech together under tight latency budgets. The differentiators are conversational latency and naturalness, telephony and SIP integration, and how gracefully the agent handles the hard parts of real calls: interruptions, silence, background noise, and a clean hand-off to a human when it's out of depth. Sub-second response time is what separates a natural conversation from an awkward one, so scrutinize end-to-end latency, not just the quality of the underlying model. Evaluate the available voices, how well the system handles barge-in when a caller talks over it, and how it manages turn-taking and context across a long call.

Integration surface matters too: check telephony providers, warm transfer to human agents, function calling into your back-end systems, and analytics on call outcomes. Most platforms price per minute of conversation, bundling speech, model, and telephony costs, sometimes with a monthly platform fee on top — so model your real call volume before comparing headline rates. Test with your own scripts, accents, and edge cases rather than the vendor's demo, because voice quality degrades fastest exactly where real callers live: noisy lines, fast talkers, and unexpected questions.

Building one yourself? Choose and evaluate a voice agent stack →

Commercial products

Alphabetical — stars don't measure commercial adoption

Open-source index

→ See the best open-source voice agents, ranked

By language: Python voice agents

Rank by
PipecatFrameworkCompose voice and multimodal agents with Python processing pipelines.Open sourcePython · BSD-2-ClauseVerified · Active 16kGitHub starsLiveKit AgentsFrameworkBuild voice and multimodal agents that participate in LiveKit rooms.Open sourcePython · Apache-2.0Verified · Active 14kGitHub starsxiaozhi-esp32-serverInfrastructureBackend service for xiaozhi-esp32 -- helps you quickly build an ESP32 device control server.Open sourceJavaScript · MITVerified · Active 11kGitHub starsten-vadSDK / libraryVoice Activity Detector (VAD): low-latency, high-performance and lightweightOpen sourceCVerified 2.3kGitHub starsbailingAgentA GPT-4o-like voice conversation robot built from ASR+LLM+TTS, integrating strong models like DeepSeek R1 and openClaw -- a genuine personal voice assistant with latency as low as 800ms.Open sourcePython · MITVerified 1.8kGitHub starsCyberVersePlatformSelf hosted, real-time digital human agent platform. Build voice-first AI agents with WebRTC, persona memory, tools, RAG, and optional digital-human video.Open sourcePython · GPL-3.0Verified · Active 1.7kGitHub starsWallyAgentRun open models on your own machine, or hosted when the job outgrows it.Open sourceC++ · MITVerified · Active 1.6kGitHub starsPatterSDK / libraryOpen-source voice-AI SDK. The Vapi/Retell alternative for builders who want to own the stack.Open sourcePython · MITVerified · Active 1.1kGitHub starsrustpbxInfrastructureA PBX written by rustOpen sourceRust · MITVerified · Active 812GitHub starsechokit_serverPlatformOpen Source Voice Agent PlatformOpen sourceRust · GPL-3.0Verified 591GitHub starsStarmoonFrameworkConversational AI device and software framework; upstream is deprecated.Open sourceTypeScript · GPL-3.0Verified 549GitHub starsJARVISAgentYour own personal voice assistant: Voice to Text to LLM to Speech, displayed in a web interfaceOpen sourcePython · GPL-3.0Verified 528GitHub stars
For agent buildersMake your product part of the discovery.Explore advertising
ai-avatar-systemAgentAI Avatar / digital human platform — upload a photo, clone a voice, talk to any face in real time with lip-sync video. Open-source, self-hosted. Claude · Whisper · Chatterbox · MuseTalk.Open sourcePython · MITVerified · Active 507GitHub starsDeepgram Python SDKSDK / libraryPython client library for Deepgram APIs; hosted service usage is separate.Open sourcePython · MITVerified · Active 468GitHub starsxybridSDK / libraryBuild apps powered by on-device AIOpen sourceRust · Apache-2.0Verified · Active 460GitHub starsbolnaAgentEnd-to-end platform for building voice first multimodal agentsOpen sourcePython · MITVerified 433GitHub starssutandoAgentMy AI Stand. Realtime by day, rewriting itself by night. Summon my AI superpower.Open sourcePython · MITVerified · Active 397GitHub starsagent-second-brainAgentAn always-on second brain you talk to. Voice notes in Telegram → typed, linked knowledge in your Obsidian vault. Runs 24/7 on the Claude subscription you already have.Open sourcePython · MITVerified 388GitHub starsLLMVoXSDK / libraryLLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLMOpen sourcePythonVerified 312GitHub starsDeepgram JavaScript SDKSDK / libraryJavaScript client library for Deepgram APIs; hosted service usage is separate.Open sourceTypeScript · MITVerified · Active 274GitHub starsM.I.L.E.SAgentM.I.L.E.S, a GPT-4-Turbo voice assistant, self-adapts its prompts and AI model, can play any Spotify song, adjusts system and Spotify volume, performs calculations, browses the web and internet,Open sourcePython · MITVerified 236GitHub starsgdansk-aiAgentFull stack voice chatbotOpen sourceTypeScript · GPL-2.0Verified 199GitHub starsactive-callAgentA SIP/WebRTC voice agentOpen sourceRustVerified · Active 190GitHub starsaxiom-voice-agentAgentRun a <400ms latency Voice Agent on just 4GB VRAM. Fully offline, no API keys required. Optimized for GTX 1650 and edge robotics with zero-copy inference. (Apache 2.0)Open sourcePython · Apache-2.0Verified 147GitHub starsBentoVoiceAgentAgentBuild Phone Calling Voice Agent fully powered by open source models.Open sourcePythonVerified 132GitHub starsAI-Voice-AgentAgentSelf-hosted AI voice agentOpen sourcePython · MITVerified · Active 41GitHub stars

Frequently asked

What is a voice AI agent?
A voice agent conducts natural, real-time voice conversations — answering and making calls, handling support, or acting as an assistant — by combining speech recognition, an LLM, and voice synthesis.
How do I choose a voice agent platform?
Prioritize conversational latency and naturalness, telephony/SIP integration, interruption handling, and how easily it hands off to a human. Test with your real call scripts.
How much do voice agents cost?
Typically per-minute usage pricing that bundles speech, model, and telephony costs; some platforms add a monthly fee.