计算机应用 ›› 2011, Vol. 31 ›› Issue (09): 2518-2521.DOI: 10.3724/SP.J.1087.2011.02518

• 图形图像技术 • 上一篇    下一篇

考虑视觉焦点权重和词相关性的图像标注方法

陈祉宏,冯志勇,贾宇   

  1. 天津大学 计算机科学与技术学院,天津 300072
  • 收稿日期:2011-03-14 修回日期:2011-05-17 发布日期:2011-09-01 出版日期:2011-09-01
  • 通讯作者: 陈祉宏
  • 作者简介:陈祉宏(1985-),男,福建三明人,硕士研究生,主要研究方向:图像语义分类、图像检索;
    冯志勇(1965-),男,天津人,教授,博士,CCF会员,主要研究方向:分布式人工智能、知识工程;
    贾宇(1985-),男,内蒙古包头人,硕士研究生,主要研究方向:图像语义分类、图像检索。
  • 基金资助:
    天津市科技支撑计划项目(08ZCKFGX00700)

Image annotation in reference to visual attention weight and word correlation

CHEN Zhi-hong,FENG Zhi-yong,JIA Yu   

  1. School of Computer Science and Technology, Tianjin University, Tianjin 300072, China
  • Received:2011-03-14 Revised:2011-05-17 Online:2011-09-01 Published:2011-09-01
  • Contact: CHEN Zhi-hong

摘要: 为了弥补图像底层特征到高层语义之间的语义鸿沟,提出一种基于视觉焦点权重模型和词相关性的图像标注方法。由于人们对图像的认识过程中,对焦点区域有比较多的关注,因此可以通过视觉焦点权重模型计算图像各区域的视觉焦点权重来提取图像的焦点区域。同时焦点区域的标注词和其他区域的标注词在逻辑上是相关的,因此通过WordNet根据词汇相关性确定图像的最终标注向量。实验结果表明,通过该方法能提高图像自动语义标注的准确率。

关键词: 语义鸿沟, 视觉焦点, WordNet, 词相关性, 图像标注

Abstract: In order to overcome the semantic gap between low-level features and high-level semantic concept of image, an image annotation approach based on visual attention weight and word correlation was proposed. In the process of understanding an image, people pay more attention to focus region. Focus region of an image can be extracted by computing visual attention weight of image regions. The annotation word of focus region is relevant to the annotation word of other image regions, so we can choose proper annotation vector by word correlation. The experimental results show that the new method can improve the precision of image annotation.

Key words: semantic gap, visual attention, WordNet, word correlation, image annotation

中图分类号: