arXiv · cs.AI · Songlin Jiang, Zhiyu Li, Terry Kong, Yu Yao, Youngeun Kwon, Bernard Nguyen, Ashwath Aithal, Mario Di Francesco · 9 小时前模型评分43
NeMo-DCR:面向万亿参数智能体强化学习的位精确增量压缩重载
NeMo-DCR: Bit-Exact Delta-Compressed Refit for Scalable Agentic RL at Trillion-Parameter Scale
导读
NVIDIA 提出 NeMo-DCR(Delta-Compressed Refit,增量压缩重载),只传输每步变化的权重却让接收端得到与全量重载完全一致的比特,真实更新下比 AReaL-DTE 快 7 倍。
分类置信度
中 · 待人工复核
- 只有单一媒体来源,需要人工复核。
来源级别:媒体与个人
事件类型:研究发布
证据摘录
- “We present NeMo-DCR (Delta-Compressed Refit), which sends only changes yet gives receivers the bits of a dense refit.”
- “The code is open-sourced in NVIDIA NeMo RL PR #2444 at this https URL”
来源:arXiv · cs.AI · arxiv.org