基于稠密光流轨迹和稀疏编码算法的行为识别方法

doi:10.11772/j.issn.1001-9081.2016.01.0181

计算机应用 ›› 2016, Vol. 36 ›› Issue (1): 181-187.DOI: 10.11772/j.issn.1001-9081.2016.01.0181

基于稠密光流轨迹和稀疏编码算法的行为识别方法

赵晓健, 曾晓勤

河海大学计算机与信息学院, 南京 211100

收稿日期:2015-06-26 修回日期:2015-09-13 出版日期:2016-01-10 发布日期:2016-01-09
通讯作者: 赵晓健(1990-),男,江苏南通人,硕士研究生,主要研究方向:机器学习、模式识别
作者简介:曾晓勤(1957-),男,安徽合肥人,教授,博士,主要研究方向:机器学习、图文法。
基金资助:
国家自然科学基金资助项目(60971088)。

Action recognition method based on dense optical flow trajectory and sparse coding algorithm

ZHAO Xiaojian, ZENG Xiaoqin

College of Computer and Information, Hohai University, Nanjing Jiangsu 211100, China

Received:2015-06-26 Revised:2015-09-13 Online:2016-01-10 Published:2016-01-09
Supported by:
This work is partially supported by the National Natural Science Foundation of China (60971088).

摘要/Abstract

摘要： 针对现有行为特征提取方法识别率低的问题,提出了一种融合稠密光流轨迹和稀疏编码框架的无监督行为特征提取方法(DOF-SC)。首先,在稠密光流(DOF)轨迹提取的基础上,对以轨迹为中心的原始图像块进行采样作为轨迹的原始特征;其次,对轨迹原始特征基于稀疏编码框架训练稀疏字典,得到轨迹的稀疏特征表示,利用词袋(BF)模型对稀疏特征聚类得到轨迹的码书,再根据码书对每个动作中出现的所有轨迹所属的码书类别进行投票,统计该动作中每个码书出现的次数,得到行为特征;最后,对行为特征利用基于直方图交叉核函数的支持向量机(SVM)进行训练得到行为识别模型,再利用该模型对行为进行分类预测,得到最终行为识别的结果。在对轨迹采样10%的情况下,DOF-SC算法得到的行为识别准确率在KTH数据库上高出采用运动边界直方图(MBH)作为特征的行为识别准确率的0.9%,在YouTube数据库上高出MBH作为特征的行为识别准确率的1.2%。实验数据表明了所提方法对行为识别的有效性。

关键词: 行为识别, 稀疏编码, 稠密光流, 词袋模型, 支持向量机

Abstract: Focusing on the issue that the existing action feature extraction method achieves lower recognition rate, a novel unsupervised one for action recognition by combining Dense Optical Flow trajectory and Sparse Coding (DOF-SC) algorithm was proposed. First of all, the trajectory-centered image patches were sampled as the original features based on the extraction of Dense Optical Flow (DOF). Then, the sparse dictionary on the basis of Sparse Coding (SC) framework was trained, and the sparse feature representation of the trajectory through dictionary was got, then the code book of the trajectory by clustering with the Bag-of-Feature (BF) model was achieved, and the trajectory of every action by code book was voted, the action features by counting the number of every code book were got. Finally, the examples for action recognition was classified and predicted by Support Vector Machine (SVM) with the kernel of histogram intersection function. The accuracy of the DOF-SC algorithm is superior to the accuracy of Motion Boundary Histogram (MBH) as the action feature by 0.9% in the KTH (Kungliga Tekniska Hgskolan) database and 1.2% in the YouTube database with the trajectory sampling rate of 10%. The results prove the effectiveness of the unsupervised action feature extraction method.

Key words: action recognition, Sparse Coding (SC), Dense Optical Flow (DOF), Bag-of-Features (BF) model, Support Vector Machine (SVM)

中图分类号:

TP181

赵晓健, 曾晓勤. 基于稠密光流轨迹和稀疏编码算法的行为识别方法[J]. 计算机应用, 2016, 36(1): 181-187.

ZHAO Xiaojian, ZENG Xiaoqin. Action recognition method based on dense optical flow trajectory and sparse coding algorithm[J]. Journal of Computer Applications, 2016, 36(1): 181-187.

参考文献

[1] WEINLAND D, RONFARD R, BOYER E. A survey of vision-based methods for action representation, segmentation and recognition [J]. Computer vision and image understanding, 2011, 115(2): 224-241.
[2] NIEBLES J C, WANG H, LI F. Unsupervised learning of human action categories using spatial-temporal words [J]. International journal of computer vision, 2008, 79(3): 299-318.
[3] LAPTEV I. On space-time interest points [J]. International journal of computer vision, 2005, 64(2/3): 107-123.
[4] WANG H, KLASER A, SCHMID C, et al. Action recognition by dense trajectories [C]// CVPR 2011: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition. Washington, D.C.: IEEE Computer Society, 2011: 3169-3176.
[5] OLSHAUSEN B A, FIELD D J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images [J]. Nature, 1996, 381(6583): 607-609.
[6] OLSHAUSEN B A, FIELD D J. Sparse coding with an overcomplete basis set: a strategy employed by V1? [J]. Vision research, 1997, 37(23): 3311-3325.
[7] LAPTEV I, MARSZALEK M, SCHMID C, et al. Learning realistic human actions from movies [C]// CVPR 2008: Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition. Washington, D.C.: IEEE Computer Society, 2008: 1-8.
[8] GERÓNIMO D, LÓPEZ A, PONSA D, et al. Haar wavelets and edge orientation histograms for on-board pedestrian detection [C]// IbPRIA'07: Proceedings of the 3rd Iberian Conference on Pattern Recognition and Image Analysis. Berlin: Springer, 2007: 418-425.
[9] LOWE D G. Object recognition from local scale-invariant features [C]// Proceedings of the Seventh IEEE International Conference on Computer Vision. Piscataway, NJ: IEEE, 1999: 1150-1157.
[10] BELONGIE S, MALIK J, PUZICHA J. Shape matching and object recognition using shape contexts [J]. IEEE transactions on pattern analysis and machine intelligence, 2002, 24(4): 509-522.
[11] DALAL N, TRIGGS B. Histograms of oriented gradients for human detection [C]// CVPR 2005: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, D.C.: IEEE Computer Society, 2005: 886-893.
[12] ZHU G, XU C, GAO W, et al. Action recognition in broadcast tennis video using optical flow and support vector machine [C]// ECCV'06: Proceedings of the 2006 International Conference on Computer Vision in Human-Computer Interaction. Berlin: Springer, 2006: 89-98.
[13] DALAL N, TRIGGS B, SCHMID C. Human detection using oriented histograms of flow and appearance [C]// ECCV'06: Proceedings of the 2006 International Conference on Computer Vision in Human-Computer Interaction. Berlin: Springer, 2006: 428-441.
[14] FARNEBÄCK G. Two-frame motion estimation based on polynomial expansion [C]// Proceedings of the 13th Scandinavian Conference on Image Analysis. Berlin: Springer, 2003: 363-370.
[15] SHI J, TOMASI C. Good features to track [C]// CVPR'94: Proceedings of the 1994 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 1994: 593-600.
[16] SCHULDT C, LAPTEV I, CAPUTO B. Recognizing human ac-tions: a local SVM approach [C]// ICPR 2004: Proceedings of the 17th International Conference on Pattern Recognition. Piscataway, NJ: IEEE, 2004: 32-36.
[17] DELAITRE V, LAPTEV I, SIVIC J. Recognizing human actions in still images: a study of bag-of-features and part-based representations [C]// Proceedings of the 2010 British Machine Vision Conference. Durham: British Machine Vision Association, 2010, 97: 1-11.
[18] LIU J, LUO J, SHAH M. Recognizing realistic actions from videos "in the wild" [C]// Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2009: 1996-2003.

基于稠密光流轨迹和稀疏编码算法的行为识别方法

Action recognition method based on dense optical flow trajectory and sparse coding algorithm

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	李扬志, 袁家政, 刘宏哲. 基于时空注意力图卷积网络模型的人体骨架动作识别算法[J]. 计算机应用, 2021, 41(7): 1915-1921.
[2]	刘世泽, 秦艳君, 王晨星, 高存远, 罗海勇, 赵方, 王宝会. 基于多尺度特征提取的交通模式识别算法[J]. 计算机应用, 2021, 41(6): 1573-1580.
[3]	贾鹤鸣, 姜子超, 李瑶, 孙康健. 基于改进斑点鬣狗优化算法的同步优化特征选择[J]. 计算机应用, 2021, 41(5): 1290-1298.
[4]	田志强, 邓春华, 张俊雯. 基于骨骼时序散度特征的人体行为识别算法[J]. 计算机应用, 2021, 41(5): 1450-1457.
[5]	蒋丽, 黄仕建, 严文娟. 基于低秩行为信息和多尺度卷积神经网络的人体行为识别方法[J]. 计算机应用, 2021, 41(3): 721-726.
[6]	袁芊芊, 邓洪敏, 王晓航. 基于超像素快速模糊C均值聚类与支持向量机的柑橘病虫害区域分割[J]. 计算机应用, 2021, 41(2): 563-570.
[7]	李凯, 李洁. 基于pinball损失的结构模糊多分类支持向量机算法[J]. 《计算机应用》唯一官方网站, 2021, 41(11): 3104-3112.
[8]	童林, 官铮. 改进鲸鱼优化支持向量机的交通流量模糊粒化预测[J]. 计算机应用, 2021, 41(10): 2919-2927.
[9]	陆荣秀, 陈明明, 杨辉, 朱建勇. 基于溶液图像时序特征的元素组分含量动态监测系统[J]. 计算机应用, 2021, 41(10): 3075-3081.
[10]	戎炜, 蒋哲远, 谢昭, 吴克伟. 基于聚类关联网络的群组行为识别[J]. 计算机应用, 2020, 40(9): 2507-2513.
[11]	周云, 陈淑荣. 基于双流非局部残差网络的行为识别方法[J]. 计算机应用, 2020, 40(8): 2236-2240.
[12]	杨文璐, 于孟孟, 谢宏. 基于关键姿势的双人交互行为识别[J]. 计算机应用, 2020, 40(8): 2231-2235.
[13]	张健铭, 施元昊, 徐正蓺, 魏建明. 基于误差预测的自适应UWB/PDR融合定位算法[J]. 计算机应用, 2020, 40(6): 1755-1762.
[14]	黄功, 赵永平, 谢云龙. 基于局部密度的加权一类支持向量机算法及其在涡轴发动机故障检测中的应用[J]. 计算机应用, 2020, 40(3): 917-924.
[15]	王杨, 赵红东. 基于改进粒子群优化的支持向量机与情景感知的人体活动识别[J]. 计算机应用, 2020, 40(3): 665-671.