Outdoor weather image classification based on feature fusion
GUO Zhiqing1,2, HU Yongwu2, LIU Peng2, YANG Jie2
1. Hubei Key Laboratory of Broadband Wireless Communication and Sensor Networks(Wuhan University of Technology), Wuhan Hubei 430070, China; 2. School of Information Engineering, Wuhan University of Technology, Wuhan Hubei 430070, China
Abstract：Weather conditions have great influence on the imaging performance of outdoor video equipment. In order to achieve the adaptive adjustment of imaging equipment in inclement weather,so as to improve the effect of intelligent monitoring system,by considering the characteristics that the traditional weather image classification methods have bad classification effect and cannot classify similar weather phenomena,and aiming at the low accuracy of deep learning methods on the weather recognition,a feature fusion model combining traditional methods with deep learning methods was proposed. In the fusion model,four artificially designed algorithms were used to extract traditional features,and AlexNet was used to extract deep features. The eigenvectors after fusion were used to discriminate the image weather conditions. The accuracy of the fusion model on a multi-background dataset reaches 93. 90%,which is better than those of three common methods for comparison,and also performs well on the Average Precision(AP)and Average Recall(AR)indicators;the model has the accuracy on a single background dataset reached 96. 97%,has the AP and AR better than those of other models,and can well recognize weather images with similar features. The experimental results show that the proposed feature fusion model can combine the advantages of traditional methods and deep learning methods to improve the accuracy of existing weather image classification methods,as well as improve the recognition rate under weather phenomena with similar features.
[1] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision,2004,60(2):91-110. [2] DALAL N,TRIGGS B. Histograms of oriented gradients for human detection[C]//Proceedings of the 2005 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2005:886-893. [3] ROSER M,MOOSMANN F. Classification of weather situations on single color images[C]//Proceedings of the 2008 Intelligent Vehicles Symposium. Piscataway:IEEE,2008:798-803. [4] LI Q,KONG Y,XIA S. A method of weather recognition based on outdoor images[C]//Proceedings of the 2014 International Conference on Computer Vision Theory and Applications. Piscataway:IEEE,2014:510-516. [5] LU C,LIN D,JIA J,et al. Two-class weather classification[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2014:3718-3725. [6] ZHANG Z,MA H. Multi-class weather classification on single images[C]//Proceedings of the 2015 IEEE International Conference on Image Processing. Piscataway:IEEE,2015:4396-4400. [7] ZHANG Z,MA H,FU H,et al. Scene-free multi-class weather classification on single images[J]. Neurocomputing,2016,207:365-373. [8] ZHENG C,ZHANG F,HOU H,et al. Active discriminative dictionary learning for weather recognition[J]. Mathematical Problems in Engineering,2016,2016:No. 8272859. [9] LECUN Y,KAVUKCUOGLU K,FARABET C. Convolutional networks and applications in vision[C]//Proceedings of 2010 IEEE International Symposium on Circuits and Systems. Piscataway:IEEE,2010:253-256. [10] ELHOSEINY M,HUANG S,ELGAMMAL A. Weather classification with deep convolutional neural networks[C]//Proceedings of the 2015 International Conference on Image Processing. Piscataway:IEEE,2015:3349-3353. [11] LI X,WANG Z,LU X. A multi-task framework for weather recognition[C]//Proceedings of the 25th ACM International Conference on Multimedia. New York:ACM,2017:1318-1326. [12] VILLARREAL GUERRA J C,KHANAM Z,EHSAN S,et al. Weather classification:a new multi-class dataset,data augmentation approach and comprehensive evaluations of convolutional neural networks[C]//Proceedings of the 2018 NASA/ESA Conference on Adaptive Hardware and Systems. Piscataway:IEEE,2018:305-310. [13] AN J,CHEN Y,SHIN S. Weather classification using convolutional neural networks[C]//Proceedings of the 2018 International SoC Design Conference. Piscataway:IEEE,2018:245-246. [14] 周飞燕, 金林鹏, 董军. 卷积神经网络研究综述[J]. 计算机学报,2017,40(6):1229-1251. (ZHOU F Y,JIN L P,DONG J. Review of convolutional neural network[J]. Chinese Journal of Computers,2017,40(6):1229-1251.) [15] PELI E. Contrast in complex images[J]. Journal of the Optical Society of America A,Optics Image Science and Vision,1990,7(10):2032-2040. [16] FAIRCHILD M D. Color Appearance Models[M]. 3rd ed. New York:Wiley Publishing,2013:189. [17] HE K,SWUN J,TANG X. Single image haze removal using dark channel prior[C]//Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2009:1956-1963. [18] KRIZHEVSKV A,SUTSKEVER I,HINTON G E. ImageNet classification with deep convolutional neural networks[C]//Proceedings of the 2012 Conference on Neural Information Processing Systems. New York:Curran Associates Inc.,2012:1097-1105. [19] SIMONYAN K,ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[EB/OL].[2019-04-10]. https://arxiv.org/pdf/1409.1556.pdf. [20] 刘渭滨, 邹智元, 邢薇薇. 模式分类中的特征融合方法[J]. 北京邮电大学学报,2017,40(4):1-8. (LIU W B,ZOU Z Y,XING W W. Feature fusion methods in pattern classification[J]. Journal of Beijing University of Posts and Telecommunications,2017,40(4):1-8.) [21] JACBOS N,ROMAN N,PLESS R. Consistent temporal variations in many outdoor scenes[C]//Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2007:1-6. [22] SZEGEDY C,LIU W,JIA Y,et al. Going deeper with convolutions[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2015:1-9.
2020, Vol. 40 
