arXiv · cs.AI · Jiatong Shi, Jionghao Han, Yichen Lu, Santiago Pascual, Pengfei Wu, Chenye Cui, Shinji Watanabe, Chao Weng, Cong Zhou · 9 小时前模型评分46
Speech-DRAME：面向语音角色扮演的人类对齐评测基准框架
Speech-DRAME: A Framework for Human-Aligned Benchmarks in Speech Role-Play
导读
Speech-DRAME 框架包含双语人工标注基准 Speech-DRAME-EvalBench 和微调的音频语言评测器 DRAME-Eval，用于评估语音角色扮演中的韵律、情感表达与角色贴合度。
分类置信度
中 · 待人工复核
- 存在未解决的相邻类别：ai-tooling，需要人工复核。
- 只有单一媒体来源，需要人工复核。
来源级别：媒体与个人
事件类型：研究发布
证据摘录
- “We introduce Speech-DRAME, a framework comprising Speech-DRAME-EvalBench, a bilingual, human-annotated benchmark with contrastive role-, context-, and delivery-mismatch conditions, and DRAME-Eval, a fine-tuned audio-language evaluator.”
- “The benchmark supports two complementary protocols: top-down archetype evaluation and bottom-up realism evaluation, with predominantly synthesized benchmark-distribution data and a held-out stress test consisting entirely of authentic human acting.”
来源：arXiv · cs.AI · arxiv.org