跳到正文
arXiv · cs.AI · Bharath Sivaram Narasimhan, Karthik R. Narasimhan · 4 小时前模型评分46

τ-Rec-Books:面向智能体推荐系统需求引导的披露控制基准

$\tau$-Rec-Books: A Disclosure-Controlled Benchmark for Requirement Elicitation in Agentic Recommender Systems

导读

研究者发布 τ-Rec-Books 基准,固定用户请求、只改变需求披露时机(一次性给出、被问才说、部分永不透露),用 2 万本书目生成 450 个任务评测 人工智能(AI,Artificial Intelligence) 智能体的需求引导能力。

分类置信度

中 · 待人工复核

  • 只有单一媒体来源,需要人工复核。

来源级别:媒体与个人

事件类型:研究发布

证据摘录

  • “To evaluate the ability of AI agents at this elicitation process, we introduce $\tau$-Rec-Books, a benchmark that holds each user request fixed while varying only when the user reveals their requirements: all at the start (volunteer), one at the start and the rest when asked (mixed), or some never (hidden).”
  • “We generate 450 tasks over a catalog of 20,000 books from Wikidata, develop a rule-based simulated user to answer the agent, and score recommendations against catalog metadata without an LLM judge.”
  • “We release the catalog pipeline, task generator, simulated user, validators, reference agents, and all agent traces at this https URL .”

来源:arXiv · cs.AI · arxiv.org