Journal of Computer Applications ›› 2017, Vol. 37 ›› Issue (1): 145-152.DOI: 10.11772/j.issn.1001-9081.2017.01.0145

Previous Articles     Next Articles

Real-time crowd counting method from video stream based on GPU

JI Lina1, CHEN Qingkui1,2, CHEN Yuanjing1, ZHAO Deyu2, FANG Yuling2, ZHAO Yongtao1   

  1. 1. College of Optical-Electrical and Computer Engineering, University of Shanghai Science and Technology, Shanghai 200093, China;
    2. College of Business, University of Shanghai Science and Technology, Shanghai 200093, China
  • Received:2016-07-30 Revised:2016-08-08 Online:2017-01-10 Published:2017-01-09
  • Supported by:
    This work is partially supported by the National Natural Science Foundation of China (61572325, 60970012), the Ministry of Education Doctoral Funds for Ph.D Supervisor of China (20113120110008), Shanghai Key Science and Technology Project (14511107902), Shanghai Engineering Research Center Project (GCZX14014), Shanghai Leading Academic Discipline Project (XTKX2012), Shanghai Special Fund for Research Base (C14001).

基于GPU的视频流人群实时计数

姬丽娜1, 陈庆奎1,2, 陈圆金1, 赵德玉2, 方玉玲2, 赵永涛1   

  1. 1. 上海理工大学 光电信息与计算机工程学院, 上海 200093;
    2. 上海理工大学 管理学院, 上海 200093
  • 通讯作者: 姬丽娜
  • 作者简介:姬丽娜(1990-),女,河南信阳人,硕士研究生,主要研究方向:计算机图形图像处理、并行计算、模式识别;陈庆奎(1966-),男,上海人,教授,博士生导师,博士,CCF会员,主要研究方向:网络计算、并行计算、物联网;陈圆金(1991-),男,河南信阳人,硕士研究生,主要研究方向:单光子探测器;赵德玉(1978-),男,山东临沂人,博士研究生,主要研究方向:高性能计算、GPU架构、CPU-GPU异构集群调度;方玉玲(1990-),女,河南信阳人,博士研究生,主要研究方向:高性能计算、GPU架构、CPU-GPU异构集群调度;赵永涛(1991-),男,河北邯郸人,硕士研究生,主要研究方向:模式识别、并行计算。
  • 基金资助:
    国家自然科学基金资助项目(61572325,60970012);高等学校博士学科点专项科研博导基金资助项目(20113120110008);上海重点科技攻关项目(14511107902);上海市工程中心建设项目(GCZX14014);上海市一流学科建设项目(XTKX2012);沪江基金研究基地专项(C14001)。

Abstract: Focusing on low counting accuracy caused by serious occlusions and abrupt illumination variations, a new real-time statistical method based on Gaussian Mixture Model (GMM) and Scale-Invariant Feature Transform (SIFT) features for video crowd counting was proposed. Firstly, the moving crowd were detected by using GMM-based motion segment method, and then the Gray Level Co Occurrence Matrix (GLCM) and morphological operations were applied to remove small moving objects of background and the dense noise in non-crowd foreground. Considering the high time-complexity of GMM algorithm, a novel parallel model with higher efficiency was proposed. Secondly, the SIFT feature points were acted as the basis of crowd statistics, and the execution time was reduced by using feature exaction based on binary image. Finally, a novel statistical analysis method based on crowd features and crowd number was proposed. The data sets with different level of crowd number were chosen to train and get the average feature number of a single person, and the pedestrians with different densities were counted in the experiment. The algorithm was accelerated by using multi-stream processors on Graphics Processing Unit (GPU) and the analysis about efficiently scheduling the tasks on Compute Unified Device Architecture (CUDA) streams in practical applications was conducted. The experimental results indicate that the speed is increased by 31.5% compared with single stream, by 71.8% compared with CPU.

Key words: video surveillance, Graphics Processing Unit (GPU) parallel computing, crowd counting, Scale-Invariant Feature Transform (SIFT), Gaussian Mixture Model (GMM), Compute Unified Device Architecture (CUDA)

摘要: 为了解决人群遮挡严重、光照突变等恶劣环境下人群计数准确率低的问题,提出基于混合高斯模型(GMM)和尺度不变特征变换(SIFT)特征的人群数量统计分析新方法。首先,基于GMM提取运动人群,并采用灰度共生矩阵(GLCM)和形态学方法去除背景中移动的小物体和较密集的噪声等非人群前景,针对GMM算法提出了一种效率较高的并行模型;接着,检测运动人群的SIFT特征点作为人群统计的基础,基于二值图像的特征提取大大减少了执行时间;最后,提出基于人群特征数和人群数量进行统计分析的新方法,选择不同等级的人群数量的数据集分别进行训练,统计得出平均单个特征点数,并对不同密度的行人进行计数实验。算法采用基于GPU多流处理器进行加速,并针对所提算法在统一计算设备架构(CUDA)流上任务的有效调度的方法进行分析。实验结果显示,相比单流提速31.5%,相比CPU提速71.8%。

关键词: 视频监控, GPU并行计算, 人群计数, 尺度不变特征变换, 混合高斯模型, 统一计算设备架构

CLC Number: