Abnormal crowd behavior detection based on motion saliency map

doi:10.11772/j.issn.1001-9081.2017092340

Journal of Computer Applications ›› 2018, Vol. 38 ›› Issue (4): 1164-1169.DOI: 10.11772/j.issn.1001-9081.2017092340

Previous Articles Next Articles

Abnormal crowd behavior detection based on motion saliency map

HU Xuemin¹, YI Chonghui¹, CHEN Qin¹, CHEN Xi¹, CHEN Long²

1. School of Computer Science and Information Engineering, Hubei University, Wuhan Hubei 430062, China;
2. School of Data and Computer Science, Sun Yat-sen University, Guangzhou Guangdong 510275, China

Received:2017-09-28 Revised:2017-10-24 Online:2018-04-10 Published:2018-04-09
Supported by:
This work is partially supported by the Youth Talent Project of Scientific Research Plan of Hubei Provincial Education Department.

基于运动显著图的人群异常行为检测

胡学敏¹, 易重辉¹, 陈钦¹, 陈茜¹, 陈龙²

1. 湖北大学计算机与信息工程学院, 武汉 430062;
2. 中山大学数据科学与计算机学院, 广州 510275

通讯作者: 胡学敏
作者简介:胡学敏(1985-),男,湖南岳阳人,讲师,博士,主要研究方向:图像处理、计算机视觉;易重辉(1995-),男,湖北荆州人,主要研究方向:智能视频检测;陈钦(1995-),男,湖北黄冈人,主要研究方向:深度学习;陈茜(1996-),女,湖北黄陂人,主要研究方向:图像处理;陈龙(1985-),男,湖北襄阳人,副教授,博士,主要研究方向:计算机视觉、自动驾驶。
基金资助:
湖北省教育厅科研计划青年人才项目（Q20171012）。

Abstract

Abstract: To deal with the crowd supervision issue of low accuracy and poor real-time performance in public places, an abnormal crowd behavior detection approach based on motion saliency map was proposed. Firstly, the Lucas-Kanade method was used to calculate the optical flow field of the sparse feature points, then the movement direction, velocity and acceleration of feature points were computed after filtering the optical flow field both in time and space. In order to precisely describe the crowd behavior, the amplitude of velocity, the direction change, and the amplitude of acceleration were mapped to three image channels corresponding to R, G, and B, respectively, and the motion saliency map for describing the characteristics of crowd movement was fused by this way. Finally, a convolution neural network model was designed and trained for the motion saliency map of crowd movement, and the trained model was used to detect abnormal crowd behaviors. The experimental results show that the proposed approach can effectively detect abnormal crowd behaviors in real time, and the detection rate in the datasets of UMN and PETS2009 are more than 97.9%.

Key words: abnormal crowd behavior detection, optical flow method, motion saliency map, Convolution Neural Network (CNN), video supervision

摘要： 针对公共场所中人群监控准确性和实时性低的问题，提出一种基于运动显著图的人群异常行为检测方法。该方法首先利用Lucas-Kanade法计算稀疏特征点的光流场，并对光流场进行时间和空间上的滤波处理，然后计算特征点的运动方向、速度和加速度。为了准确描述人群行为，将人群的速度幅值、运动方向变化量和加速度幅值分别映射为图像的R、G、B三个通道，并以此合成代表人群运动特征的运动显著图。最后，设计和训练面向人群运动显著图的卷积神经网络模型，并利用该模型检测人群中是否存在异常行为。实验结果表明，该方法能够有效、实时地检测人群异常行为，在UMN和PETS2009数据集的检测率均达到了97.9%以上。

关键词: 人群异常行为检测, 光流法, 运动显著图, 卷积神经网络, 视频监控

CLC Number:

TP391.4

HU Xuemin, YI Chonghui, CHEN Qin, CHEN Xi, CHEN Long. Abnormal crowd behavior detection based on motion saliency map[J]. Journal of Computer Applications, 2018, 38(4): 1164-1169.

胡学敏, 易重辉, 陈钦, 陈茜, 陈龙. 基于运动显著图的人群异常行为检测[J]. 计算机应用, 2018, 38(4): 1164-1169.

References

[1] LI T, CHANG H, WANG M, et al. Crowded scene analysis:a survey[J]. IEEE Transactions on Circuits & Systems for Video Technology, 2015, 25(3):367-386.
[2] SOLERA F, CALDERARA S, CUCCHIARA R. Socially constrained structural learning for groups detection in crowd[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(5):995-1008.
[3] BISWAS S, BABU R V. Anomaly detection via short local trajectories[J]. Neurocomputing, 2017, 242:63-72.
[4] DALAL N, TRIGGS B, SCHMID C. Human detection using oriented histograms of flow and appearance[C]//Proceedings of the 9th European Conference on Computer Vision. Berlin:Springer, 2006:428-441.
[5] WANG T, CHEN J, SNOUSSI H. Online detection of abnormal events in video streams[J]. Journal of Electrical and Computer Engineering, 2013, 2013:Article No. 20.
[6] WANG T, SNOUSSI H. Detection of abnormal events via optical flow feature analysis[J]. Sensors, 2015, 15(4):7156-7171.
[7] WANG T, SNOUSSI H. Detection of abnormal visual events via global optical flow orientation histogram[J]. IEEE Transactions on Information Forensics & Security, 2014, 9(6):988-998.
[8] 陈丽, 陈静. 基于支持向量机和k-近邻分类器的多特征融合方法[J]. 计算机应用, 2009, 29(3):833-835.(CHEN L, CHEN J. Multi-feature fusion method based on support vector machine and k-nearest neighbor classifier[J]. Journal of Computer Applications, 2009, 29(3):833-835.)
[9] MEHRAN R, OYAMA A, SHAH M. Abnormal crowd behavior detection using social force model[C]//CVPR 2009:Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2009:935-942.
[10] ZHANG Y, QIN L, JI R, et al. Social attribute-aware force model:exploiting richness of interaction for abnormal crowd detection[J]. IEEE Transactions on Circuits & Systems for Video Technology, 2015, 25(7):1231-1245.
[11] ZHANG Y, QIN L, YAO H, et al. Abnormal crowd behavior detection based on social attribute-aware force model[C]//Proceedings of the 201219th IEEE International Conference on Image Processing. Piscataway, NJ:IEEE, 2012:2689-2692.
[12] ZHOU B, TANG X, WANG X. Learning collective crowd behaviors with dynamic pedestrian-agents[J]. International Journal of Computer Vision, 2015, 111(1):50-68.
[13] 张文达, 许悦雷, 倪嘉成, 等. 基于多尺度分块卷积神经网络的图像目标识别算法[J]. 计算机应用, 2016, 36(4):1033-1038.(ZHANG W D, XU Y L, NI J C, et al. Image target recognition method based on multi-scale block convolutional neural network[J]. Journal of Computer Applications, 2016, 36(4):1033-1038.)
[14] SAINATH T N, MOHAMED A R, KINGSBURY B, et al. Deep convolutional neural networks for LVCSR[C]//Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway, NJ:IEEE, 2013:8614-8618.
[15] LEVI G, HASSNCER T. Age and gender classification using convolutional neural networks[C]//Proceedings of the 2015 IEEE Workshop on Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2015:34-42.
[16] HORN B K P, SCHUNCK B G. Determining optical flow[J]. Artificial Intelligence, 1981, 17(1/2/3):185-203.
[17] 熊饶饶, 胡学敏, 陈龙. 利用综合光流直方图的人群异常行为检测[J].计算机工程, 2017,43(10):228-233.(XIONG R R, HU X M, CHEN L. Abnormal crowd behavior detection via synthesized optical flow histogram[J]. Computer Engineering, 2017,43(10):228-233.)
[18] 李彦冬, 郝宗波, 雷航. 卷积神经网络研究综述[J]. 计算机应用, 2016, 36(9):2508-2515.(LI Y D, HAO Z B, LEI H. Survey of convolutional neural network[J]. Journal of Computer Applications, 2016, 36(9):2508-2515.)
[19] CUN Y L, BOSER B, DENKER J S, et al. Handwritten digit recognition with a back-propagation network[C]//NIPS 1989:Proceedings of the 2nd International Conference on Neural Information Processing Systems. Cambridge, MA:MIT Press, 1990:396-404.
[20] NAIR V, HINTON G E. Rectified linear units improve restricted Boltzmann machines[C]//ICML 2010:Proceedings of the 27th International Conference on Machine Learning.[S.l.]:Omnipress, 2010:807-814.

Abnormal crowd behavior detection based on motion saliency map

基于运动显著图的人群异常行为检测

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	NIU Kangli, CHEN Yuzhang, SHEN Junfeng, ZENG Zhangfan, PAN Yongcai, WANG Yichong. Dual-channel night vision image restoration method based on deep learning [J]. Journal of Computer Applications, 2021, 41(6): 1775-1784.
[2]	Huaiyu ZHU, Bo LI. Single shot multibox detector recognition method for aerial targets of unmanned aerial vehicle [J]. Journal of Computer Applications, 2021, 41(11): 3234-3241.
[3]	Guihui CHEN, Huikang LIU, Zhongbing LI, Jiao PENG, Shaotian WANG, Jinyu LIN. Improved algorithm of generative adversarial network based on arbitration mechanism [J]. Journal of Computer Applications, 2021, 41(11): 3185-3191.
[4]	YIN Chunyong, HE Miao. Text classification based on improved capsule network [J]. Journal of Computer Applications, 2020, 40(9): 2525-2530.
[5]	ZHANG Jiagang, LI Daping, YANG Xiaodong, ZOU Maoyang, WU Xi, HU Jinrong. Deformable medical image registration algorithm based on deep convolution feature optical flow [J]. Journal of Computer Applications, 2020, 40(6): 1799-1805.
[6]	YE Yang, CAI Qiong, DU Xiaobiao. Single image super-resolution method based on non-local channel attention mechanism [J]. Journal of Computer Applications, 2020, 40(12): 3618-3623.
[7]	DENG Tianmin, FANG Fang, ZHOU Zhenhao. Traffic sign recognition based on improved convolutional neural network with spatial pyramid pooling [J]. Journal of Computer Applications, 2020, 40(10): 2872-2880.
[8]	DU Nianmao, XU Jiachen, XIAO Zhiyong. Undersampled brain magnetic resonance image reconstruction method based on convolutional neural network [J]. Journal of Computer Applications, 2020, 40(10): 3060-3065.
[9]	CHENG Junhua, ZENG Guohui, LU Dunke, HUANG Bo. Improved convolution neural network model averaging method based on Dropout [J]. Journal of Computer Applications, 2019, 39(6): 1601-1606.
[10]	JI Shuwei, YANG Xiwang, HUANG Jinying, YIN Ning. Model compression method of convolution neural network based on feature-reuse [J]. Journal of Computer Applications, 2019, 39(6): 1607-1613.
[11]	CAI Ruichu, ZHONG Chunrong, YU Yang, CHEN Bingfeng, LU Ye, CHEN Yao. CNN quantization and compression strategy for edge computing applications [J]. Journal of Computer Applications, 2018, 38(9): 2449-2454.
[12]	YANG Chunni, FENG Chaosheng. Multi-intention recognition model with combination of syntactic feature and convolution neural network [J]. Journal of Computer Applications, 2018, 38(7): 1839-1845.
[13]	TAN Jiefan, ZHU Yan, CHEN Tung-shou, CHANG Chin-chen. Imbalanced image classification approach based on convolution neural network and cost-sensitivity [J]. Journal of Computer Applications, 2018, 38(7): 1862-1865.
[14]	WEI Zhenyu, WEN Chang, XIE Kai, HE Jianbiao. Real-time face detection for mobile devices with optical flow estimation [J]. Journal of Computer Applications, 2018, 38(4): 1146-1150.
[15]	XU Zhe, FENG Changhua. Modified scale dependent pooling model for traffic image recognition [J]. Journal of Computer Applications, 2018, 38(3): 671-676.