PyRUA-DataFarm: LLM Agent as a Cost-Efficient Teleoperator for Real-Ready Robot Data

Summary

A study proposes DataFarm, where a coding agent replaces human teleoperation by rebuilding robot tasks in simulation—writing the scene, expert controller, and success judge—then rendering photographic videos via a video model. On five real-robot tasks, policies trained only on farm data matched teleoperation-trained policies (93 vs. 84 successes in 100 trials) and showed better robustness (87 vs. 46 successes under unseen conditions). Adapting a task costs $21 in API usage on average plus $5 for a render contract, with each episode costing $0.80; one hour of three-view data costs $107 on average, below teleoperation quotes of $117 in China and $290 in North American labor.

This is a reviewed summary. Read the complete article at the original source.

Why it matters by industry

• Artificial intelligence

  For AI and robotics practitioners, this work quantifies a cost-efficient alternative to teleoperation data collection, showing comparable or better policy performance with lower cost and automatic task adaptation.