AI Daybook
오늘의 지면
논문Physical AI

REA, 비동기 뇌-소뇌 제어로 실시간 로봇 제어 가능한 에구화 에이전트 런타임

REA: A Routed Embodied Agent Runtime for Asynchronous Brain-Cerebellum Control

매체
Hugging Face
게시
중요도
4/5
화제 지수
14

한국어 요약

재단 모델의 고수준 추론과 VLA 같은 고속 정책을 비동기로 조율하는 Routed Embodied Agent(REA) 런타임을 제안했다. LIBERO-Pro 3000개 테스트에서 95.9% 성공률을 달성하며 제어 스텝 25%, 제어 시간 17% 감소 및 Unitree G1 휴머노이드로의 전이 학습 성공을 보였다.

원문 발췌 · English

Foundation models are becoming remarkably reliable at high-level reasoning, yet they remain too slow and costly to serve as fine-grained controllers. Conversely, fast policies like VLAs and whole-body controllers offer more efficient reflexes, but struggle to generalize. While pairing a deliberative brain (foundation models) with a reactive cerebellum (fast policies) seems natural for embodied systems, two obstacles remain: methods are built and scored on incompatible stacks, and their asynchronous coordination is difficult. For example, an agent that calls the VLA in the agentic loop can stall the fast execution, while a VLA that calls the agent on errors tends to re-trigger fallbacks repeatedly or completely miss silent failures. To address this, we propose REA (Routed Embodied Agent), a unified runtime where a deliberative System 2, an embodied router System 1 and reactive System 0 policies cooperate under a single golden rule - no running policy waits on the brain. Instead of querying the brain at each failure, REA employs a route memory that stores each policy's measured success ahead of time, a boundary-triggered judge gate that consults the brain on policy execution, and a shared-budget escalation ladder for bounded recovery. Evaluated on 3,000 test episodes across 60 LIBERO-Pro tasks, REA reaches 95.9% success and beats the best single-agent baseline in its own policy pool (94.7%) while reducing control steps by 25% and control time by 17%. In a separate 100-episode RoboTwin 2.0 study, REA achieves 84% success with VLA policies and 86% with VLA+code, compared with 80% for the strongest single VLA baseline MEDex. These results demonstrate learned and programmatic policies operating within the same runtime. REA also transfers to BEHAVIOR-1K and a real Unitree G1 humanoid, achieving the highest observed success among the compared methods.

#vla#embodied agent#로봇 제어#런타임
전체 보기 →