Scale AI launches Voice Showdown, the first real-world benchmark for voice AI — and the results are humbling for some top models
via scale.com
Short excerpt below. Read at the original source.
Voice AI is moving faster than the tools we use to measure it. Every major AI lab — OpenAI, Google DeepMind, Anthropic, xAI — is racing to ship voice models capable of natural, real-time conversation. But the benchmarks used to evaluate those models are largely still running on synthetic speech, English-only prompts, and scripted test […]