计算机应用 ›› 2012, Vol. 32 ›› Issue (11): 3014-3017.

• 人工智能 • 上一篇    下一篇

基于概率超图的视频事件语义检测

任梅,詹永照,潘道远,孙佳瑶   

  1. 江苏大学 计算机科学与通信工程学院,江苏 镇江 212013
  • 收稿日期:2012-05-04 修回日期:2012-06-27 发布日期:2012-11-12 出版日期:2012-11-01
  • 通讯作者: 任梅
  • 作者简介:任梅(1987-),女,山东菏泽人,硕士研究生,主要研究方向:多媒体技术; 詹永照(1962-),男,福建尤溪人,教授,博士生导师,主要研究方向:模式识别、多媒体技术;潘道远(1982-),男,湖南常德人,博士研究生,主要研究方向:模式识别、震动分析与控制。
  • 基金资助:
    国家自然科学基金资助项目(61071087)

Semantic detection of video events based on probabilistic hypergraph

REN Mei,ZHAN Yong-zhao,PAN Dao-yuan,SUN Jia-yao   

  1. School of Computer Science and Telecommunication Engineering, Jiangsu University, Zhenjiang Jiangsu 212013, China
  • Received:2012-05-04 Revised:2012-06-27 Online:2012-11-12 Published:2012-11-01
  • Contact: REN Mei

摘要: 视频事件类别的归属具有模糊性和不确定性,将超图的点边射入矩阵拓展成概率形式的软超图进行关联关系分析和语义分析,将会更有利于提高多事件检索检测的精准率和召回率。提出基于概率超图模型的视频事件语义检测算法(PHVESD)。 该方法首先将颜色、灰度共生矩阵、Tchebichef矩、局部二值模式(LBP)等四种底层视觉特征进行融合; 然后定义视频段的亲密度函数并利用亲密度的信息构建概率超图模型,其中每条超边对应一种事件语义;采用随机游走过程来预测视频段属于每条超边的概率;最后结合阈值采用条件概率模型对视频段进行事件语义分类。将该方法用于交通突发事件多语义检测中并与其他的识别算法相比较,实验结果表明,与基于超图模型的多标签随机游走算法(MLRW)相比,PHVESD的算法使多语义事件检测的准确率提高了10%,召回率提高了8%。

关键词: 概率超图模型, 随机游走模型, 特征提取, 多语义视频事件检测

Abstract: The categorization of video events is blur and uncertain. Expanding the hypergraphs pointset matrix into the probabilistic form of soft hypergraph, and analyzing the correlation of events and semantic, the precision and recall rate of the multievent retrieval system will be improved. This paper proposed a video event semantic detection algorithm based on probabilistic hypergraph model (PHVESD). Firstly, the method integrated the lowlevel visual features, color,graylevel cooccurrence matrix, Tchebichef moment and Local Binary Pattern (LBP); then defined the intimacy function of video segmentation and used the intimacy information construct probabilistic hypergraph model, in which each hyperedge corresponded to an event semantics; adopted Markov random walk model to predict the probability of video segment belonging to each hyperedge; finally, classified the unknown video event with MAP. The authors used this method on traffic emergent multisemantic events detection and compared the proposed method to another. The experimental results show that, compared to Multi Label Random Walk (MLRW) algorithm based on the hypergraph model, the proposed method makes the multisemantic event detection precision improve by 10%, the recall rate increase by 8%.

Key words: probabilistic hypergraph model, random walk model, feature extraction, video event multisemantic detection

中图分类号: