跳到正文
arXiv · cs.AI · Peichun Hua, Yunming Xiao · 11 小时前模型评分39

Matryoshka Hash Representations(MHR):面向模型感知紧凑语义检索的哈希表示

Matryoshka Hash Representations for Model-Aware Compact Semantic Retrieval

导读

研究者提出 Matryoshka Hash Representations(MHR),一种两阶段方法:先学习较长的二进制码,再冻结模型并训练零初始化的残差码适配器,使短前缀可直接搜索。

生成六维分析
分类置信度

中 · 待人工复核

  • 存在未解决的相邻类别:ai-tooling,需要人工复核。
  • 只有单一媒体来源,需要人工复核。

来源级别:媒体与个人

事件类型:研究发布

证据摘录

  • “We introduce Matryoshka Hash Representations (MHR), a two-stage procedure that separates full-width training from prefix organization.”
  • “Documents are stored at one bit per coordinate, queries keep continuous logits as in PQ, and search runs on FAISS FastScan.”
  • “Trained on MS MARCO and zero-shot transferred to seven BEIR datasets, one MHR code reaches 0.502 NDCG@10 at 16 bytes and 0.556 at 32 bytes, against 0.404 and 0.524 for the best compact baselines”

来源:arXiv · cs.AI · arxiv.org