GPT-6-Astra, 다중 로봇 벤치마크에서 통합 성능 달성
Has GPT-6-Astra Achieved Embodied Intelligence?
- 매체
- arXiv
- 게시
- 중요도
- 3/5
- 화제 지수
- 6
한국어 요약
GPT-6-Astra가 조작, 네비게이션, 손가락 제어 등 12개 벤치마크에서 문맥 내 학습으로 이전 수준의 성능을 보여줬다. 고수준 추론기와 저수준 제어기의 협력이 효과적이지만 비용이 크고, 실제 배치에서는 시연 데이터 수집 비용과 물리 제약 문제가 남아 있다. 로봇 지능의 실질적 단계에는 도달하지 못했다고 평가했다.
원문 발췌 · English
GPT-6-Astra demonstrates a level of competence in robotic manipulation and navigation that challenges the conventional paradigm of building specialized models for individual tasks and embodiments. In this report, we ask not only how capable GPT-6-Astra is, but what its capabilities imply for the field. First, we probe the limits of standalone GPT-6-Astra. We conduct a large-scale evaluation across 12 representative benchmarks spanning tabletop manipulation, humanoids, mobile platforms, and dexterous hands. Under a unified protocol that allows in-context learning (ICL) from training-set demonstrations and substantially increases the number of execution steps, GPT-6-Astra achieves unprecedented performance (Fig. 1). Future research may focus on improving 1) the generality of ICL 2) cost and execution time, 3) physical-state verification, 4) recovery from irreversible failures, and 5) long-horizon preservation of progress. Second, we study the agentic harness for embodied control. We identify that close-loop coordination between a high-level "System 2" reasoner (i.e., GPT-6-Astra) and a low-level "System 1" controller (e.g., π0.5) is costly but effective. Third, we examine GPT-6-Astra on real-world deployment. Our experiments on 8 robot configurations reveal substantial gaps: 1) robot demonstrations required for ICL are expensive to collect, and 2) it is implausible to trade longer execution for higher success rates with physical constraints. Fourth, we envision the next generation of embodied benchmarks. We develop a prototype that 1) derives tasks from real-world needs, 2) provides no in-domain demonstrations, and 3) judges agents on a world clock that keeps running while they deliberate. Taken together, our results suggest that GPT-6-Astra has largely crossed the threshold of embodied competence, but not yet that of practical embodied intelligence.