AI Voices for Voice Agents
Voice agents live or die on the pause before a reply. Synthesis starts in about 200 milliseconds and runs at 3.3 times real time, which leaves the budget where it usually belongs: your model.

VOICES FOR THIS USE CASE
Where the latency actually goes
Synthesis starts in roughly 200 milliseconds and runs at 3.3 times real time, so a five second reply renders in about a second and a half. That is usually the smallest part of a turn. Speech recognition and your language model typically account for more, which is worth measuring before optimising the voice layer.
Choosing a voice for sustained conversation
Nine voices carry the Voice Agent tag and 195 the broader conversational tag. For agents the useful filter is not tone but language: Hindi and English sit in the same family, so one voice can serve a caller who moves between them. Tamil, Telugu and the other Indic languages each need a voice recommended for that language.
Interrupting cleanly
Barge-in is handled in your orchestration rather than here, but generation speed decides whether it feels natural. Because audio begins in about 200 milliseconds, cutting a reply short and starting a new one does not register as a gap. A slower engine turns every interruption into an awkward pause.
Streaming transports
Three options exist. Synchronous HTTP waits for the complete clip and is wrong for live turns. SSE streams audio back as it renders. WebSocket suits sessions where text arrives incrementally from a language model and you want playback to begin before the sentence is finished. Most agent builds use WebSocket.
SPECIFICATION
Sample rate
44.1 kHz native, resampled to 8 kHz for telephony
Latency
~200 ms to first byte (p50, warm region)
Output formats
ulaw, alaw, PCM 16-bit, WAV, MP3
Streaming transports
WebSocket, HTTP chunked transfer
Speed range
0.5× – 2.0×, set per request
Explore Voice Similar to
AI Voices for Voice Agents
FAQs









