arXiv · cs.AI · Yuancheng Wei, Haojie Zhang, Linli Yao, Lei Li, Jiali Chen, Tao Huang, Yiting Lu, Duojun Huang, Xin Li, Zhao Zhong · 8 小时前模型评分31
DiffCap-Bench:面向图像差异描述的综合高难度鲁棒基准
DiffCap-Bench: A Comprehensive, Challenging, Robust Benchmark for Image Difference Captioning
导读
研究者提出图像差异描述基准 DiffCap-Bench,覆盖十类差异,并配套基于人工核验差异清单的大语言模型评审(大语言模型(LLM,Large Language Model)-as-a-Judge)协议,替代 BLEU、METEOR 等词重叠指标。
分类置信度
中 · 待人工复核
- 只有单一媒体来源,需要人工复核。
来源级别:媒体与个人
事件类型:研究发布
证据摘录
- “To address these gaps, we introduce DiffCap-Bench, a comprehensive IDC benchmark covering ten distinct difference categories to ensure diversity and compositional complexity.”
- “The benchmark and code will be made publicly available to support further research.”
来源:arXiv · cs.AI · arxiv.org