PyRUA-DataFarm, 코딩 에이전트로 로봇 학습 데이터 생성
PyRUA-DataFarm: LLM Agent as a Cost-Efficient Teleoperator for Real-Ready Robot Data
- 매체
- Hugging Face
- 게시
- 중요도
- 2/5
- 화제 지수
- 14
한국어 요약
코딩 에이전트가 텔레오퍼레이션 대신 로봇 데이터를 생성하는 시스템을 제안했다. 에이전트가 데이터 요청과 한 번의 캘리브레이션 에피소드를 받아 시뮬레이션에서 장면·전문가 컨트롤러·성공 판정기를 작성하고, 영상 모델이 실제 이미지 기반 렌더링으로 실제 로봇에 직접 적용 가능한 라벨링 데이터를 생성한다. 다섯 가지 실제 로봇 과제에서 이 방식으로 학습한 정책이 같은 수의 텔레오퍼레이션 에피소드로 학습한 정책과 동등한 성능(100회 시험 중 93대 84 성공)을 보였으며, 보이지 않은 환경에서 더 우수했다.
원문 발췌 · English
Teleoperation remains the default way to collect robot demonstrations, but every episode costs robot and operator time, and every new task starts from scratch. We ask whether a coding agent can take over the teleoperator's job. In our DataFarm, the agent receives a data request and one calibration episode of the robot in the target scene and rebuilds the task in simulation: it writes the scene, an expert controller, and a success judge. The simulator supplies exact actions, and a video model conditioned on real images renders each rollout as photographic video, generating all camera views together consistently. The output is real-ready data: synchronized camera views labelled with the robot's actions, on which a policy can be trained directly and deployed on the real robot. Independent judges certify the expert and every rendered episode before admission. On five real-robot tasks, policies trained only on farm data match policies trained on as many teleoperated episodes (93 vs. 84 successes in 100 trials), and under an unseen tablecloth and coloured light they keep 87 successes where the teleoperation-trained policies fall to 46. Adapting a task is fully automatic and costs \21 of API usage on average, paid once per task, plus 5 for a render contract; every further episode costs \0.80 on average for simulation, rendering, and review, with no robot or operator. One hour of three-view data for a task costs 107 on average, these costs included, slightly below a quote of \117 for teleoperation in China and below 290 in labour alone in North America.