语音助手何时能像电影《Her》那样自然对话?Gradium AICEO Neil Zeghidour深度剖析:1.级联系统架构延迟难以突破200ms人类响应阈值 2. 半双工模型无法处理重叠对话,全双工Moshi迈出关键一步3. 副语言信号(语气/停顿/情绪)理解才是真正瓶颈 4.TTS成本高昂制约规模化落地。适合关注语音交互、多模态大模型的开发者与研究者参考。
----------
原视频标题:Voice AI: when is the "Her" moment? — Neil Zeghidour, Gradium AI
原视频作者:AI Engineer
原视频链接:https://www.youtube.com/watch?v=P_RI1kCkRbo
原视频发布时间:2026-05-09 23:00:06
原视频简介:The "Her" moment has been promised so many times it's become a joke. Every new demo, every smooth-sounding voice agent gets called it. Neil Zeghidour, CEO of Gradium AI and one of the researchers behind Moshi — the first full-duplex voice model — uses this talk to be honest about where the gap actually is and why it keeps not closing.
The core tension: cascaded systems (speech-to-text, LLM, text-to-speech) are practical and getting smarter, but they're architecturally incapable of feeling like a real conversation. Latency from tool calls alone can be 500ms to 4 seconds — while humans process and respond in around 200ms total. Speech-to-speech models solve some of that but trade it for a different problem: they're still half-duplex, meaning they're either listening or talking but never both, which makes backchanneling impossible and the interaction feel robotic in a different way. Moshi showed that full-duplex is solvable. What it didn't solve was making the model useful. And cost is a wall hiding behind the latency problem — TTS at scale is expensive enough that some teams burn through their fundraising before they can grow a user base.
The most underrated thread in the talk is paralinguistic understanding: voice carries tone, hesitation, discomfort, and cultural signals that get entirely stripped out the moment you transcribe to text. Getting to Her means building models that don't just produce natural-sounding speech but actually understand what the voice is carrying — and that's a science problem, not a prompt engineering one.
Speak...