跳到正文
arXiv · cs.AI · Chenyu Yi, Jiawen Zong, Sami Hormi, Bingquan Shen, Xudong Jiang, Alex Chichung Kot · 5 小时前模型评分41

用文字而非像素:针对大型视觉语言模型的自然文本不可学习样本

The Pen is Mightier than the Pixel: Natural Textual Unlearnable Example for Large Vision Language Models

导读

研究者提出自然文本不可学习样本(NTUE,Natural Textual Unlearnable Examples),这是首次针对大型视觉语言模型(LVLMs,Large Vision Language Models)探索不可学习样本,通过微调图像标签在感兴趣身份与另一目标间建立捷径来误导模型,且不引入事实错误、不影响可读性。

分类置信度

中 · 待人工复核

  • 只有单一媒体来源,需要人工复核。

来源级别:媒体与个人

事件类型:研究发布

证据摘录

  • “We propose a novel text-based perturbation method, Natural Textual Unlearnable Examples (NTUE), which can effectively mislead LVLMs by subtly manipulating the image label, establishing a shortcut between an identity of interest and a separate target, without introducing factual misinformation or affecting readability.”
  • “Our findings show that NTUE achieves a high success rate with a poison rate as low as 5%, underscoring its potential as a practical and robust solution for protecting multimodal data in the era of LVLMs.”

来源:arXiv · cs.AI · arxiv.org