arXiv · cs.AI · Deng-Ke Wu, Yifan Jin, Yida Yang, Lei Qian, Zhaoye Zhou, Hongru Zhang, Kai Ye, Shuyuan Hu, Yiran Mao, Zewei Ye, Bo Zhao · 4 小时前模型评分44
RoboScope Kit：面向具身智能评测的统一快速可扩展接口
RoboScope Kit: Unified Interfaces for Fast and Scalable Embodied-AI Evaluation
导读
RoboScope Kit 用统一接口封装模型与基准，解决机器人策略评测中各基准评测器、观测格式和动作约定不一致且速度慢的问题。
分类置信度
中 · 待人工复核
- 只有单一媒体来源，需要人工复核。
来源级别：媒体与个人
事件类型：研究发布
证据摘录
- “RoboScope Kit wraps each model once in a Python class called a Policy, and each benchmark once in an adapter around the benchmark's own evaluator, so the benchmark's rules and scoring stay unchanged.”
- “Adapters cover six benchmark families.”
- “On LIBERO-Long with a StarVLA checkpoint on one 48 GiB RTX 4090, the concurrency search selects twelve simulator workers sharing three Policy replicas, which evaluate 500 episodes 4.45$\times$ faster than the official StarVLA evaluation with equivalent success rates, 2.78$\times$ faster than RLinf, and 1.52$\times$ faster than vla-eval at its tuned configuration.”
- “On RoboTwin Easy, four GPUs with chunk-boundary observation complete the 500 episodes in 14.4 minutes, 25.04$\times$ faster than the single-GPU baseline, with identical success outcomes and terminal steps.”
来源：arXiv · cs.AI · arxiv.org