AWS工程师Sandhya Subramani演示如何用开源框架Strands Agents为树莓派四足机器人Scout赋予自然语言交互能力。
1. 核心架构:Agent层负责“做什么”(意图理解与工具编排),预训练Policy负责“怎么做”(运动控制)
2. 多智能体协同:同时运行环境感知、Telegram对话及语音三个Agent,实现复杂指令响应
3. 落地价值:将固定任务机器人转化为通用语控终端,并作为数据采集平台反哺模型迭代
----------
原视频标题:Tell the Robot What You Want — Sandhya Subramani, AWS
原视频作者:AI Engineer
原视频链接:https://www.youtube.com/watch?v=S6aSoQ6_u5A
原视频发布时间:2026-08-30 02:30:17
原视频简介:Sandhya Subramani asks her rover how many people it can see, a question nobody ever trained it to answer. It thinks for a second, checks its front camera, and reports two, one near the speaker monitor and one further right. Scout is a small four legged robot running a Raspberry Pi, reaching the internet over a SIM card and a 4G connection, and its whole personality comes from an agent layer sitting above the movement policies it already had. The demo goes exactly as live robot demos go. It falls over, gets coaxed upright, announces a signature performance and then just turns its headlights off.
The idea underneath is neat and portable. If you give an agent software tools, you can also hand it a hardware tool and let it choose which preset policy to fire, which turns a robot trained for a fixed task list into something you can address in plain language. She wires it up in about five lines using an open source AWS framework that already covers 40 or so robots. Scout actually runs three agents at once, one thinking about the environment, one talking to her over Telegram, and a voice agent she disabled so it would stop interrupting her on stage. Her framing is that the agent decides what to do while the trained policy decides how, and the robot doubles as a rig for collecting the next round of training data.
Speaker info:
- https://www.linkedin.com/in/sandhyasubramani/
Timestamps:
0:00 - Meet Scout, running on a Raspberry Pi over 4G
1:27 - Answering a question nobody trained it for
3:46 - Giving an agent a hardware...