Fast flame recognition approach based on local feature filtering

doi:10.11772/j.issn.1001-9081.2016.10.2907

Journal of Computer Applications ›› 2016, Vol. 36 ›› Issue (10): 2907-2911.DOI: 10.11772/j.issn.1001-9081.2016.10.2907

Previous Articles Next Articles

Fast flame recognition approach based on local feature filtering

MAO Wentao^1,2, WANG Wenpeng¹, JIANG Mengxue¹, OUYANG Jun³

1. College of Computer and Information Engineering, Henan Normal University, Xinxiang Henan 453007, China;
2. Engineering Technology Research Center for Computing Intelligence and Data Mining of Henan Province, Xinxiang Henan 453007, China;
3. Shouan Industrial Firefighting Company Limited, Beijing 100010, China

Received:2016-04-11 Revised:2016-06-30 Published:2016-10-10
Supported by:
BackgroundThis work is partially supported by the National Natural Science Foundation of China (U1204609), the Funding Scheme of University Science & Technology Innovation in Henan Province (15HASTIT022), the Funding Scheme of University Young Core Instructor in Henan Province (2014GGJS-046), the University Key Scientific Research Project in Henan Province (15A520078), the Foundation of Henan Normal University for Excellent Young Teachers (14YQ007).

基于局部特征过滤的快速火焰图像识别方法

毛文涛^1,2, 王文朋¹, 蒋梦雪¹, 欧阳军³

1. 河南师范大学计算机与信息工程学院, 河南新乡 453007;
2. 河南省高校计算智能与数据挖掘工程技术中心, 河南新乡 453007;
3. 首安工业消防有限公司, 北京 100010

通讯作者: 毛文涛,E-mail:maowt@htu.edu.cn
作者简介:毛文涛(1980—),男,河南新乡人,副教授,博士,CCF会员,主要方向:机器学习、弱信号检测;王文朋(1989—),男,河南新乡人,硕士研究生,主要研究方向:机器学习、模式识别;蒋梦雪(1990—),女,河南信阳人,硕士研究生,主要研究方向:机器学习、时间序列预测;欧阳军(1977—),男,湖北荆州人,高级工程师,博士,主要研究方向:机器学习在消防领域的应用。
基金资助:
国家自然科学基金资助项目（U1204609）；河南省高校科技创新人才支持计划项目（15HASTIT022）；河南省高校青年骨干教师资助计划项目（2014GGJS-046）；河南省高等学校重点科研项目计划项目（15A520078）；河南师范大学优秀青年科学基金资助项目（14YQ007）。

Abstract

Abstract: For flame recognition problem, the traditional recognition methods based on physical signal are easily affected by the external environment. Meanwhile, most of the current methods based on feature extraction of flame image are less discriminative to different scene and flame type, and then have lower recognition precision if the flame scene and type change. To overcome this drawback, a new fast recognition method for flame image was proposed by introducing colorspace information into Scale Invariant Feature Transform (SIFT) algorithm. Firstly, the feature descriptors of flame were extracted by SIFT algorithm from the frame images which were obtained from flame video. Secondly, the local noisy feature points were filtered by introducing the feature information of flame colorspace, and the feature descriptors were transformed into feature vectors by means of Bag Of Keypoints (BOK). Finally, Extreme Learning Machine (ELM) was utilized to establish a fast flame recognition model. Experiments were conducted on open flame datasets and real-life flame images. The results show that for different flame scenes and types the accuracy of the proposed method is more than 97%, and the recognition time is just 2.19 s for test set which contains 4301 images. In addition, comparing with the other three methods such as support vector machine based on entropy, texture and flame spread rate, support vector machine based on SIFT and fire specialty in color space, ELM based on SIFT and fire specialty in color space, the proposed method outperforms in terms of recognition accuracy and speed.

Key words: flame recognition, feature extraction, Scale Invariant Feature Transform (SIFT), Extreme Learning Machine (ELM), Bag Of Keypoints (BOK)

摘要： 传统的基于物理信号的火焰识别方法易被外部环境干扰，且现有火焰图像特征提取方法对于火焰和场景的区分度较低，从而导致火焰种类或场景改变时识别精度降低。针对这一问题，提出一种基于局部特征过滤和极限学习机的快速火焰识别方法，将颜色空间信息引入尺度不变特征变换（SIFT）算法。首先，将视频文件转化成帧图像，利用SIFT算法对所有图像提取特征描述符；其次，通过火焰在颜色空间上的信息特性进一步过滤局部噪声特征点，并借助关键点词袋（BOK）方法，将特征描述符转换成对应的特征向量；最后放入极限学习机进行训练，从而快速得到火焰识别模型。在火焰公开数据集及真实火灾场景图像进行的实验结果表明：所提方法对不同场景和火焰类型均具有较高的识别率和较快的检测速度，实验识别精度达97%以上；对于包含4301张图片数据的测试集，模型识别时间仅需2.19 s；与基于信息熵、纹理特征、火焰蔓延率的支持向量机模型，基于SIFT、火焰颜色空间特性的支持向量机模型，基于SIFT的极限学习机模型三种方法相比，所提方法在测试集精度、模型构建时间上均占有优势。

关键词: 火焰识别, 特征提取, 尺度不变特征变换, 极限学习机, 关键点词袋

CLC Number:

TP391.4

MAO Wentao, WANG Wenpeng, JIANG Mengxue, OUYANG Jun. Fast flame recognition approach based on local feature filtering[J]. Journal of Computer Applications, 2016, 36(10): 2907-2911.

毛文涛, 王文朋, 蒋梦雪, 欧阳军. 基于局部特征过滤的快速火焰图像识别方法[J]. 计算机应用, 2016, 36(10): 2907-2911.

References

[1] 徐炀. 智能火灾自动报警系统的构建[D]. 天津:天津理工大学, 2013:10-16.(XU Y. The structure of automatic fire alarm system based on virtual instrument [D]. Tianjin: Tianjin University of Technology, 2013:10-16.)
[2] 胡幸江. 多波段红外火焰探测器系统研究与产品开发[D]. 杭州:浙江大学, 2013:10-17.(HU X J. Research and product development of MIR flame detector system [D]. Hangzhou: Zhejiang University, 2013:10-17.)
[3] 乔建强. 火焰图像边缘检测及修复算法的研究[D]. 北京:华北电力大学, 2015:15-20.(QIAO J Q. Research on the flame image edge detection and restoration algorithm [D]. Beijing: North China Electric Power University, 2015:15-20.)
[4] 陈天炎, 曾思通, 吴海彬. 基于YCbCr颜色空间的火焰图像分割方法[J]. 传感器与微系统, 2011, 30(10):62-64.(CHEN T Y, ZENG S T, WU H B. Flame image segmentation method based onYCbCr color space[J]. Transducer and Microsystem Technologies, 2011, 30(10):62-64.)
[5] 邵良杉, 郭雅婵. 基于Codebook的视频火焰识别算法[J]. 计算机应用, 2015, 35(5):1483-1487.(SHAO L S, GUO Y C. Flame recognition algorithm based on Codebook in video[J]. Journal of Computer Applications, 2015, 35(5):1483-1487.)
[6] KO B C, CHEONG K H, NAM J Y. Fire detection based on vision sensor and support vector machines[J]. Fire Safety Journal, 2009, 44(3):322-329.
[7] CELIK T, DEMIREL H. Fire detection using statistical color model in video sequences[J]. Journal of Visual Communication & Image Representation, 2007, 18(2):176-185.
[8] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[9] CSURKA G, DANCE C R, FAN L, et al. Visual categorization with bags of keypoints[EB/OL]. [2016-02-15]. http://www.cs.haifa.ac.il/~rita/vision_lab_course/2007/Project3_files/csurka_dance_bags_keypoints.pdf.
[10] HUANG G B. What are extreme learning machines? Filling the gap between frank Rosenblatt's dream and John von Neumann's puzzle[J]. Cognitive Computation, 2015, 7(3):263-278.
[11] HUANG G B, ZHOU H, DING X, et al. Extreme learning machine for regression and multiclass classification [J]. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 2012, 42(2):513-529.
[12] HUANG G B, BAI Z, KASUN L L C, et al. Local receptive fields based extreme learning machine[J]. IEEE Computational Intelligence Magazine, 2015, 10(2):18-29.

[1]	ZHENG Zhiqiang, HU Xin, WENG Zhi, WANG Yuhe, CHENG Xi. Cattle eye image feature extraction method based on improved DenseNet [J]. Journal of Computer Applications, 2021, 41(9): 2780-2784.
[2]	SUN Haoyi, WANG Chuanmei, DING Yiming. Extreme learning machine optimization based on hidden layer output matrix [J]. Journal of Computer Applications, 2021, 41(9): 2481-2488.
[3]	TANG Yanqiang, LI Chenghai, SONG Yafei. Network security situation prediction based on improved particle swarm optimization and extreme learning machine [J]. Journal of Computer Applications, 2021, 41(3): 768-773.
[4]	SHE Yulong, ZHANG Xiaolong, CHENG Ruoqin, DENG Chunhua. Semantic segmentation method based on edge attention model [J]. Journal of Computer Applications, 2021, 41(2): 343-349.
[5]	HU Lihua, ZUO Weijian, NIE Yaoyao. Feature matching method based on weighted similarity measurement [J]. Journal of Computer Applications, 2021, 41(2): 511-516.
[6]	Jin ZHAO, Wen’ai SONG, Jun TAI, Jijiang YANG, Qing WANG, Xiaodan LI, Yi LEI, Yue QIU. Review of computer-aided face diagnosis for obstructive sleep apnea in children [J]. Journal of Computer Applications, 2021, 41(11): 3394-3401.
[7]	ZHU Xincheng, HE Kunjin, NI Na, HAO Bo. Rapid calculation method of orthopedic plate fit based on improved iterative closest point algorithm [J]. Journal of Computer Applications, 2021, 41(10): 3033-3039.
[8]	YIN Chunyong, HE Miao. Text classification based on improved capsule network [J]. Journal of Computer Applications, 2020, 40(9): 2525-2530.
[9]	ZHOU Yun, CHEN Shurong. Behavior recognition method based on two-stream non-local residual network [J]. Journal of Computer Applications, 2020, 40(8): 2236-2240.
[10]	ZHANG Jiagang, LI Daping, YANG Xiaodong, ZOU Maoyang, WU Xi, HU Jinrong. Deformable medical image registration algorithm based on deep convolution feature optical flow [J]. Journal of Computer Applications, 2020, 40(6): 1799-1805.
[11]	XU Dai, YUE Zhang, YANG Wenxia, REN Xiao. Tampered image recognition based on improved three-stream Faster R-CNN [J]. Journal of Computer Applications, 2020, 40(5): 1315-1321.
[12]	ZHANG Junsheng, XU Jingjing, YU Wei. No-reference image quality assessment method for facial beautification image [J]. Journal of Computer Applications, 2020, 40(4): 1184-1190.
[13]	LIU Shangwang, LIU Chengwei, ZHANG Aili. Real-time facial expression and gender recognition based on depthwise separable convolutional neural network [J]. Journal of Computer Applications, 2020, 40(4): 990-995.
[14]	GUO Zhiqing, HU Yongwu, LIU Peng, YANG Jie. Outdoor weather image classification based on feature fusion [J]. Journal of Computer Applications, 2020, 40(4): 1023-1029.
[15]	ZHU Zhe, XU Shaohua. Denoising autoencoder deep convolution process neural network and its application in time-varying signal classification [J]. Journal of Computer Applications, 2020, 40(3): 698-703.

Fast flame recognition approach based on local feature filtering

基于局部特征过滤的快速火焰图像识别方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics