基于运动显著图的人群异常行为检测

doi:10.11772/j.issn.1001-9081.2017092340

计算机应用 ›› 2018, Vol. 38 ›› Issue (4): 1164-1169.DOI: 10.11772/j.issn.1001-9081.2017092340

• 虚拟现实与多媒体计算 • 上一篇下一篇

基于运动显著图的人群异常行为检测

胡学敏¹, 易重辉¹, 陈钦¹, 陈茜¹, 陈龙²

1. 湖北大学计算机与信息工程学院, 武汉 430062;
2. 中山大学数据科学与计算机学院, 广州 510275

收稿日期:2017-09-28 修回日期:2017-10-24 出版日期:2018-04-10 发布日期:2018-04-09
通讯作者: 胡学敏
作者简介:胡学敏(1985-),男,湖南岳阳人,讲师,博士,主要研究方向:图像处理、计算机视觉;易重辉(1995-),男,湖北荆州人,主要研究方向:智能视频检测;陈钦(1995-),男,湖北黄冈人,主要研究方向:深度学习;陈茜(1996-),女,湖北黄陂人,主要研究方向:图像处理;陈龙(1985-),男,湖北襄阳人,副教授,博士,主要研究方向:计算机视觉、自动驾驶。
基金资助:
湖北省教育厅科研计划青年人才项目（Q20171012）。

Abnormal crowd behavior detection based on motion saliency map

HU Xuemin¹, YI Chonghui¹, CHEN Qin¹, CHEN Xi¹, CHEN Long²

1. School of Computer Science and Information Engineering, Hubei University, Wuhan Hubei 430062, China;
2. School of Data and Computer Science, Sun Yat-sen University, Guangzhou Guangdong 510275, China

Received:2017-09-28 Revised:2017-10-24 Online:2018-04-10 Published:2018-04-09
Supported by:
This work is partially supported by the Youth Talent Project of Scientific Research Plan of Hubei Provincial Education Department.

摘要/Abstract

摘要： 针对公共场所中人群监控准确性和实时性低的问题，提出一种基于运动显著图的人群异常行为检测方法。该方法首先利用Lucas-Kanade法计算稀疏特征点的光流场，并对光流场进行时间和空间上的滤波处理，然后计算特征点的运动方向、速度和加速度。为了准确描述人群行为，将人群的速度幅值、运动方向变化量和加速度幅值分别映射为图像的R、G、B三个通道，并以此合成代表人群运动特征的运动显著图。最后，设计和训练面向人群运动显著图的卷积神经网络模型，并利用该模型检测人群中是否存在异常行为。实验结果表明，该方法能够有效、实时地检测人群异常行为，在UMN和PETS2009数据集的检测率均达到了97.9%以上。

关键词: 人群异常行为检测, 光流法, 运动显著图, 卷积神经网络, 视频监控

Abstract: To deal with the crowd supervision issue of low accuracy and poor real-time performance in public places, an abnormal crowd behavior detection approach based on motion saliency map was proposed. Firstly, the Lucas-Kanade method was used to calculate the optical flow field of the sparse feature points, then the movement direction, velocity and acceleration of feature points were computed after filtering the optical flow field both in time and space. In order to precisely describe the crowd behavior, the amplitude of velocity, the direction change, and the amplitude of acceleration were mapped to three image channels corresponding to R, G, and B, respectively, and the motion saliency map for describing the characteristics of crowd movement was fused by this way. Finally, a convolution neural network model was designed and trained for the motion saliency map of crowd movement, and the trained model was used to detect abnormal crowd behaviors. The experimental results show that the proposed approach can effectively detect abnormal crowd behaviors in real time, and the detection rate in the datasets of UMN and PETS2009 are more than 97.9%.

Key words: abnormal crowd behavior detection, optical flow method, motion saliency map, Convolution Neural Network (CNN), video supervision

中图分类号:

TP391.4

胡学敏, 易重辉, 陈钦, 陈茜, 陈龙. 基于运动显著图的人群异常行为检测[J]. 计算机应用, 2018, 38(4): 1164-1169.

HU Xuemin, YI Chonghui, CHEN Qin, CHEN Xi, CHEN Long. Abnormal crowd behavior detection based on motion saliency map[J]. Journal of Computer Applications, 2018, 38(4): 1164-1169.

参考文献

[1] LI T, CHANG H, WANG M, et al. Crowded scene analysis:a survey[J]. IEEE Transactions on Circuits & Systems for Video Technology, 2015, 25(3):367-386.
[2] SOLERA F, CALDERARA S, CUCCHIARA R. Socially constrained structural learning for groups detection in crowd[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(5):995-1008.
[3] BISWAS S, BABU R V. Anomaly detection via short local trajectories[J]. Neurocomputing, 2017, 242:63-72.
[4] DALAL N, TRIGGS B, SCHMID C. Human detection using oriented histograms of flow and appearance[C]//Proceedings of the 9th European Conference on Computer Vision. Berlin:Springer, 2006:428-441.
[5] WANG T, CHEN J, SNOUSSI H. Online detection of abnormal events in video streams[J]. Journal of Electrical and Computer Engineering, 2013, 2013:Article No. 20.
[6] WANG T, SNOUSSI H. Detection of abnormal events via optical flow feature analysis[J]. Sensors, 2015, 15(4):7156-7171.
[7] WANG T, SNOUSSI H. Detection of abnormal visual events via global optical flow orientation histogram[J]. IEEE Transactions on Information Forensics & Security, 2014, 9(6):988-998.
[8] 陈丽, 陈静. 基于支持向量机和k-近邻分类器的多特征融合方法[J]. 计算机应用, 2009, 29(3):833-835.(CHEN L, CHEN J. Multi-feature fusion method based on support vector machine and k-nearest neighbor classifier[J]. Journal of Computer Applications, 2009, 29(3):833-835.)
[9] MEHRAN R, OYAMA A, SHAH M. Abnormal crowd behavior detection using social force model[C]//CVPR 2009:Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2009:935-942.
[10] ZHANG Y, QIN L, JI R, et al. Social attribute-aware force model:exploiting richness of interaction for abnormal crowd detection[J]. IEEE Transactions on Circuits & Systems for Video Technology, 2015, 25(7):1231-1245.
[11] ZHANG Y, QIN L, YAO H, et al. Abnormal crowd behavior detection based on social attribute-aware force model[C]//Proceedings of the 201219th IEEE International Conference on Image Processing. Piscataway, NJ:IEEE, 2012:2689-2692.
[12] ZHOU B, TANG X, WANG X. Learning collective crowd behaviors with dynamic pedestrian-agents[J]. International Journal of Computer Vision, 2015, 111(1):50-68.
[13] 张文达, 许悦雷, 倪嘉成, 等. 基于多尺度分块卷积神经网络的图像目标识别算法[J]. 计算机应用, 2016, 36(4):1033-1038.(ZHANG W D, XU Y L, NI J C, et al. Image target recognition method based on multi-scale block convolutional neural network[J]. Journal of Computer Applications, 2016, 36(4):1033-1038.)
[14] SAINATH T N, MOHAMED A R, KINGSBURY B, et al. Deep convolutional neural networks for LVCSR[C]//Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway, NJ:IEEE, 2013:8614-8618.
[15] LEVI G, HASSNCER T. Age and gender classification using convolutional neural networks[C]//Proceedings of the 2015 IEEE Workshop on Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2015:34-42.
[16] HORN B K P, SCHUNCK B G. Determining optical flow[J]. Artificial Intelligence, 1981, 17(1/2/3):185-203.
[17] 熊饶饶, 胡学敏, 陈龙. 利用综合光流直方图的人群异常行为检测[J].计算机工程, 2017,43(10):228-233.(XIONG R R, HU X M, CHEN L. Abnormal crowd behavior detection via synthesized optical flow histogram[J]. Computer Engineering, 2017,43(10):228-233.)
[18] 李彦冬, 郝宗波, 雷航. 卷积神经网络研究综述[J]. 计算机应用, 2016, 36(9):2508-2515.(LI Y D, HAO Z B, LEI H. Survey of convolutional neural network[J]. Journal of Computer Applications, 2016, 36(9):2508-2515.)
[19] CUN Y L, BOSER B, DENKER J S, et al. Handwritten digit recognition with a back-propagation network[C]//NIPS 1989:Proceedings of the 2nd International Conference on Neural Information Processing Systems. Cambridge, MA:MIT Press, 1990:396-404.
[20] NAIR V, HINTON G E. Rectified linear units improve restricted Boltzmann machines[C]//ICML 2010:Proceedings of the 27th International Conference on Machine Learning.[S.l.]:Omnipress, 2010:807-814.

基于运动显著图的人群异常行为检测

Abnormal crowd behavior detection based on motion saliency map

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	王贺兵, 张春梅. 基于非对称卷积-压缩激发-次代残差网络的人脸关键点检测[J]. 计算机应用, 2021, 41(9): 2741-2747.
[2]	宋中山, 梁家锐, 郑禄, 刘振宇, 帖军. 基于双向门控尺度特征融合的遥感场景分类[J]. 计算机应用, 2021, 41(9): 2726-2735.
[3]	李康康, 张静. 基于注意力机制的多层次编码和解码的图像描述模型[J]. 计算机应用, 2021, 41(9): 2504-2509.
[4]	张永斌, 常文欣, 孙连山, 张航. 基于字典的域名生成算法生成域名的检测方法[J]. 计算机应用, 2021, 41(9): 2609-2614.
[5]	赵宏, 孔东一. 图像特征注意力与自适应注意力融合的图像内容中文描述[J]. 计算机应用, 2021, 41(9): 2496-2503.
[6]	徐江浪, 李林燕, 万新军, 胡伏原. 结合目标检测的室内场景识别方法[J]. 计算机应用, 2021, 41(9): 2720-2725.
[7]	牟长宁, 王海鹏, 周丕宇, 侯鑫行. 基于图卷积神经网络的串联质谱从头测序[J]. 计算机应用, 2021, 41(9): 2773-2779.
[8]	曹玉红, 徐海, 刘荪傲, 王紫霄, 李宏亮. 基于深度学习的医学影像分割研究综述[J]. 计算机应用, 2021, 41(8): 2273-2287.
[9]	秦斌斌, 彭良康, 卢向明, 钱江波. 司机分心驾驶检测研究进展[J]. 计算机应用, 2021, 41(8): 2330-2337.
[10]	黄程程, 董霄霄, 李钊. 基于二维Winograd算法的深流水线5×5卷积方法[J]. 计算机应用, 2021, 41(8): 2258-2264.
[11]	曾祥银, 郑伯川, 刘丹. 基于深度卷积神经网络和聚类的左右轨道线检测[J]. 计算机应用, 2021, 41(8): 2324-2329.
[12]	高钦泉, 黄炳城, 刘文哲, 童同. 基于改进CenterNet的竹条表面缺陷检测方法[J]. 计算机应用, 2021, 41(7): 1933-1938.
[13]	谭道强, 曾诚, 乔金霞, 张俊. 基于混合注意力模型的阴影检测方法[J]. 计算机应用, 2021, 41(7): 2076-2081.
[14]	吴则举, 焦翠娟, 陈亮. 基于改进Faster R-CNN的轮胎缺陷检测方法[J]. 计算机应用, 2021, 41(7): 1939-1946.
[15]	杨粟, 欧阳智, 杜逆索. 基于相关度距离的无监督并行哈希图像检索[J]. 计算机应用, 2021, 41(7): 1902-1907.