Journal of Computer Applications ›› 2021, Vol. 41 ›› Issue (1): 150-156.DOI: 10.11772/j.issn.1001-9081.2020061147

Special Issue: 第八届中国数据挖掘会议(CCDM 2020)

• China Conference on Data Mining 2020 (CCDM 2020) • Previous Articles     Next Articles

Group scanpath generation based on fixation regions of interest clustering and transferring

LIU Nanbo, XIAO Fen, ZHANG Wenlei, LI Wangxin, WENG Zun   

  1. Key Laboratory of Intelligent Computing and Information Processing, Ministry of Education(Xiangtan University), Xiangtan Hunan 411105, China
  • Received:2020-05-31 Revised:2020-08-13 Online:2021-01-10 Published:2020-11-12
  • Supported by:
    This work is partially supported by the Natural Science Foundation of Hunan Province (2018JJ2405), the Innovation Platform Open Fund of Hunan Provincial Education Department (18K034).

基于注视兴趣区域聚类和转移的群体扫视路径生成

刘楠博, 肖芬, 张文雷, 李旺鑫, 翁尊   

  1. 智能计算与信息处理教育部重点实验室(湘潭大学), 湖南 湘潭 411105
  • 通讯作者: 肖芬
  • 作者简介:刘楠博(1994-),男,河南洛阳人,硕士研究生,CCF会员,主要研究方向:眼动数据挖掘、显著性检测、深度神经网络;肖芬(1981-),女,湖南益阳人,教授,博士,CCF会员,主要研究方向:计算机视觉、人工智能、深度学习、智能计算;张文雷(1996-),男,湖南常德人,硕士研究生,CCF会员,主要研究方向:视频数据处理、显著性检测、深度神经网络;李旺鑫(1994-),男,山西太原人,硕士研究生,CCF会员,主要研究方向:图像去模糊、显著性检测、深度神经网络;翁尊(1996-),女,湖南岳阳人,硕士研究生,CCF会员,主要研究方向:图像分割、显著目标检测、深度神经网络。
  • 基金资助:
    湖南省自然科学基金资助项目(2018JJ2405);湖南省教育厅创新平台开放基金资助项目(18K034)。

Abstract: For redundancy chaos, and the lack of representation of group observers' scanpath data in natural scenes, by mining the potential characteristics of individual scanpaths, a method for group scanpath generation based on fixation Regions of Interest (ROI) spatial temporal clustering and transferring was proposed. Firstly, multiple observers' scanpaths under the same stimulus sample were analyzed, and multiple fixation regions of interest were generated by utilizing affinity propagation clustering algorithm to cluster the fixation points. Then, the statistics and analysis of the information related to fixation intensity such as the number of observers, fixation frequency and lasting time were carried out and the regions of interest were filtered. Afterwards, the subregions of interest with different types were extracted via defining fixation behaviors in the regions of interest. Finally, the transformation mode of regions and subregions of interest was proposed on the basis of fixation priority, so as to generate the group scanpath in natural scenes. The group scanpath generation experiments were conducted on two public datasets MIT1003 and OSIE. The results show that compared with the state-of-the-art methods, such as eMine, Scanpath Trend Analysis (STA), Sequential Pattern Mining Algorithm (SPAM), Candidate-constrained Dynamic time warping Barycenter Averaging method (CDBA) and Heuristic, the proposed method has the group scanpath generated of higher entirety similarity indexes with ScanMatch (w/o duration) reached 0.426 and 0.467 respectively, and ScanMatch (w/duration) reached 0.404 and 0.439 respectively. It can be seen that the scanpath generated by the proposed method has high overall similarity to the real scanpath, and has a certain function of representation.

Key words: natural scene, scanpath, group scanpath, fixation Region Of Interest (ROI), fixation behavior

摘要: 为解决自然场景下群体观察者扫视路径数据冗余繁乱、缺乏表征的问题,通过挖掘个体路径的潜在特性,提出了一种基于注视兴趣区域(ROI)时空聚类和转移的群体扫视路径生成方法。首先,分析同一刺激样本下多名观察者的扫视路径,利用亲和力传播聚类算法来聚类注视点以生成多个注视兴趣区域;其次,统计分析兴趣区域的观察者数量、注视频率以及注视时长等与注视强度相关的信息并筛选兴趣区域;然后,通过定义兴趣区域中的注视行为提取不同类型的兴趣子区域;最后,提出了基于注视优先度的兴趣区域和兴趣子区域转移模式,从而生成自然场景下的群体扫视路径。在MIT1003和OSIE公共数据集上进行群体扫视路径生成实验,结果表明,与目前先进的eMine、扫视路径趋势分析(STA)、序列模式挖掘算法(SPAM)、基于候选约束的动态时间规整质心平均方法(CDBA)和Heuristic方法相比,所提方法生成的群体扫视路径获得了较高的整体相似度,ScanMatch (w/o duration)分别可达0.426和0.467,ScanMatch(w/duration)分别可达0.404和0.439。可见该所生成的扫视路径与真实扫视路径的整体相似度较高,具有一定表征作用。

关键词: 自然场景, 扫视路径, 群体扫视路径, 注视兴趣区域, 注视行为

CLC Number: