NVIDIA 推出基于 Cosmos 的实时交互式世界模拟框架
arXiv cs.LG (Machine Learning) RSS Feed · NVIDIA, :, Anis Ahmad, Jon Allen, Malik Aqeel Anwar, Jesse Archer, Maciej Bala, Piotr Barejko, Aarti Basant, Dan Blick, Taras Bolzhelarskyi, Henry Che, Jin Chen, Yukang Chen, Tae Eun Choe, Yuzhu Dong, Nat Duca, Liang Feng, Francesco Ferroni, Xiao Fu, Mohit Gambhir, Vivek Goel, Rony Goldenthal, Aryaman Gupta, Ali Hassani, Nathan Hayes-Roth, Yong He, Michael Honke, Shengyu Huang, Wei Huang, DeLesley Hutchins, Suneel Indupuru, Pooya Jannaty, Jingyi Jin, Janmesh Kalra, Ashna Khetan, Xin Kong, Aleksandr Korovko, Hui Kuang, Zhengfei Kuang, George Kurian, Jean-Francois Lafleche, Jayjun Lee, Justin Leung, William Lew, Xiang Li, Zhaoshuo Li, Chen-Hsuan Lin, Ming-Yu Liu, Xiangyu Lu, Yuhang Lu, Martin Ding Ma, Qianli Ma, Aditya Mahajan, Miguel Martin, Janarbek Matai, Jonathan McCaffrey, Qing Miao, Ashkan Mirzaei, Mustafa Munir, Sangmin Oh, David Pankratz, Trung Pham, Marilyn Reeb, Gavriel State, Jiaxiang Tang, Shitao Tang, Yue Tang, Tolou Tavakkoli, Alexander Temirov, Hweimi Tsou, Sergei Vasilev, Thomas Volk, Andrew Z. Wang, Hao Wang, Shijie Wang, Zhonghao Wang, David Wehr, Shumian Xin, Mengyao Xu, Yao Xu, Shuai Yang, Sophia Zalewski, Pengcuo Zeren, Cindy Zha, Jing Zhang, Yuliya Zhautouskaya, Kaiwen Zheng, Andrew Zhu, Rick Zhuang · Readzer 发布时间
摘要
新框架将 Cosmos 世界基础模型适配于 Physical AI 中的实时交互式世界模拟，使用户和具身智能体能够与动态虚拟环境交互。它支持预测动作的视觉结果以及从外部模拟器状态生成观测，并在相机导航、机器人操作、可控视频传输和多视角自动驾驶模拟中进行了演示。代码和模型检查点已在 GitHub 和 Hugging Face 上提供。
这里提供经过审核的摘要。完整内容请前往原文阅读。
各行业推荐理由
- 科技与数字产业
该框架为 Physical AI 训练和评估提供了开发交互式虚拟环境的共享基础，在机器人和自动驾驶领域具有实际应用，直接关联软件和数字基础设施行业。