The latency budget for a voice agent
A caller notices silence at about 800ms. Transcription, inference and speech all have to fit inside that, and most of the budget is already spent before the model runs.
Voice
1 post.
1 post.
A caller notices silence at about 800ms. Transcription, inference and speech all have to fit inside that, and most of the budget is already spent before the model runs.