基于三维卷积神经网络的虫音特征识别方法

doi:10.11772/j.issn.1001-9081.2019030481

计算机应用 ›› 2019, Vol. 39 ›› Issue (9): 2744-2748.DOI: 10.11772/j.issn.1001-9081.2019030481

• 虚拟现实与多媒体计算 • 上一篇下一篇

基于三维卷积神经网络的虫音特征识别方法

万永菁¹, 王博玮¹, 娄定风²

1. 华东理工大学信息科学与工程学院, 上海 200237;
2. 深圳海关, 广东深圳 518045

收稿日期:2019-03-22 修回日期:2019-05-24 发布日期:2019-04-29 出版日期:2019-09-10
通讯作者: 王博玮
作者简介:万永菁(1975-),女,江西南昌人,副教授,博士,主要研究方向:智能信息处理、图像处理、模式识别、音频信号处理;王博玮(1997-),男,湖南益阳人,主要研究方向:信号处理、数据挖掘、机器学习;娄定风(1960-),男,江西南昌人,研究员,主要研究方向:昆虫声学。
基金资助:
国家自然科学基金资助项目（61872143）；国家大学生创新创业训练计划项目（201810251064）。

Insect sound feature recognition method based on three-dimensional convolutional neural network

WAN Yongjing1, WANG Bowei1, LOU Dingfeng2

1. School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237, China;
2. Shenzhen Customs, Shenzhen Guangdong 518045, China

Received:2019-03-22 Revised:2019-05-24 Online:2019-04-29 Published:2019-09-10
Supported by:
This work is partially supported by the National Natural Science Foundation of China (61872143), the National Undergraduate Innovation and Entrepreneurship Training Program of China (201810251064).

摘要/Abstract

摘要：

进口木材蛀虫检疫是海关的一项重要工作，但其存在着虫声检测算法准确率低、鲁棒性差等问题。针对这些问题，提出了一种基于三维卷积神经网络（3D CNN）的虫音检测方法以实现虫音特征的识别。首先，对原始虫音音频进行交叠分帧预处理，并使用短时傅里叶变换得到虫音音频的语谱图；然后，将语谱图作为3D CNN的输入，使其通过包含三层卷积层的3D CNN以判断音频中是否存在虫音特征。通过设置不同分帧长度下的输入进行网络训练及测试；最后以准确率、F₁分数以及ROC曲线作为评估指标进行性能分析。结果表明，在交叠分帧长度取5 s时，训练及测试效果最佳。此时，3D CNN模型在测试集上的准确率达到96.0%，F₁分数为0.96，且比二维卷积神经网络（2D CNN）模型准确率提高近18%。说明所提算法能准确地从音频信号中提取虫音特征并完成蛀虫识别任务，为海关检验检疫提供有力保障。

关键词: 三维卷积神经网络, 短时傅里叶变换, 语谱图, 虫音识别, 声学信号处理

Abstract:

The quarantine of imported wood is an important task for the customs, but there are problems such as low accuracy and poor robustness in the insect sound detection algorithm. To solve these problems, an insect sound detection method based on Three-Dimensional Convolutional Neural Network (3D CNN) was proposed to detect the presence of insect sound features. Firstly, the original insect audio was framed and pre-processed, and Short-Time Fourier Transform (STFT) was operated to obtain the spectrogram of the insect audio. Then, the spectrogram was used as the input of the 3D CNN consisting three convolutional layers. Network training and testing were conducted by setting inputs with different framing lengths. Finally, the analysis of performance was carried out using metrics like accuracy, F₁ score and ROC curve. The experiments showed that the test results were best when the overlap framing length was 5 seconds. The best result of the 3D CNN model on the test set achieved an accuracy of 96.0% and an F₁ score of 0.96. The accuracy was increased by nearly 18% compared with that of the two-dimensional convolutional neural network (2D CNN) model. It shows that the proposed model can extract the insect sound features from the audio signal more accurately and complete the insect identification task, which provides an engineering solution for customs inspection and quarantine.

Key words: Three-Dimensional Convolutional Neural Network (3D CNN), Short-Time Fourier Transform (STFT), spectrogram, insect sound detection, acoustic signal processing

中图分类号:

TP391.4

万永菁, 王博玮, 娄定风. 基于三维卷积神经网络的虫音特征识别方法[J]. 计算机应用, 2019, 39(9): 2744-2748.

WAN Yongjing, WANG Bowei, LOU Dingfeng. Insect sound feature recognition method based on three-dimensional convolutional neural network[J]. Journal of Computer Applications, 2019, 39(9): 2744-2748.

参考文献

[1] 李瑞法,张学勤,陈莹,等.我国进境原木主要疫情分析[J].中国森林病虫,2015,34(5):8-11.(LI R F, ZHANG X Q, CHEN Y, et al. Analysis on main epidemic situation of pests in imported logs[J]. Forest Pest and Disease, 2015, 34(5):8-11.)
[2] 娄定风,许小芳,李嘉,等.6种木材钻蛀性昆虫的声学特征与比较[J].植物检疫,2013,27(1):6-10.(LOU D F, XU X F, LI J, et al. Acoustic characteristics and their comparison of six species of wood borers[J]. Plant Quarantine, 2013, 27(1):6-10.)
[3] SUTIN A, FLYNN T, SALLOUM, H, et al. Vibro-acoustic methods of insect detection in agricultural shipments and wood packing materials[C]//Proceedings of the 2017 IEEE International Symposium on Technologies for Homeland Security. Piscataway, NJ:IEEE, 2017:1-6.
[4] 祁骁杰,卜宇飞,许志春,等.杨树木段内光肩星天牛幼虫数量的声学检测[J].环境昆虫学报,2016, 38(3):529-534.(QI X J, BU Y F, XU Z C, et al. Using acoustic technology detect the different numbers of anoplophora glabripennis larvae in poplar[J]. Journal of Environmental Entomology, 2016, 38(3):529-534.)
[5] PARSONS S, JONES G. Acoustic identification of twelve species of echolocating bat by discriminant function analysis and artificial neural networks[J]. Journal of Experimental Biology, 2000, 203(17):2641-2656.
[6] YAZGAÇ B G, KIRCI M, KIVAN M. Detection of sunn pests using sound signal processing methods[C]//Proceedings of the 2016 5th International Conference on Agro-Geoinformatics (Agro-Geoinformatics). Piscataway, NJ:IEEE, 2016:1-6.
[7] ZILLI D, PARSON O, MERRETT G, et al. A hidden Markov model-based acoustic cicada detector for crowdsourced smartphone biodiversity monitoring[C]//Proceedings of the 23rd International Joint Conference on Artificial Intelligence. Palo Alto, CA:AAAI Press, 2013:2945-2951.
[8] LIKITHA M S, GUPTA S R R, HASITHA K, et al. Speech based human emotion recognition using MFCC[C]//Proceedings of the 2017 International Conference on Wireless Communications, Signal Processing and Networking. Piscataway, NJ:IEEE, 2017:2257-2260.
[9] POTAMITIS I, GANCHEV T, FAKOTAKIS N. Automatic acoustic identification of crickets and cicadas[C]//Proceedings of the 9th International Symposium on Signal Processing and Its Applications. Piscataway, NJ:IEEE, 2007:1-4.
[10] DONG X, YAN N, WEI Y. Insect sound recognition based on convolutional neural network[C]//Proceedings of the IEEE 3rd International Conference on Image, Vision and Computing. Piscataway, NJ:IEEE, 2018:855-859.
[11] KISKIN I, ZILLI D, LI Y, et al. Bioacoustic detection with wavelet-conditioned convolutional neural networks[EB/OL].[2018-12-28]. https://link.springer.com/article/10.1007/s00521-018-3626-7.
[12] ZHOU X, LI J, ZHOU X. Cascaded CNN-resBiLSTM-CTC:an end-to-end acoustic model for speech recognition[EB/OL].[2019-02-01]. https://arxiv.org/pdf/1810.12001.pdf.
[13] SCHMIDHUBER J. Deep learning in neural networks:an overview[J]. Neural Networks, 2015, 61:85-117.
[14] HUANG J, ZHOU W, LI H, et al. Sign language recognition using 3D convolutional neural networks[C]//Proceedings of the 2015 IEEE International Conference on Multimedia and Expo. Piscataway, NJ:IEEE, 2015:1-6.
[15] IOFFE S, SZEGEDY C. Batch normalization:accelerating deep network training by reducing internal covariate shift[C]//Proceedings of the 32nd International Conference on International Conference on Machine Learning. Brookline, MA:JMLR, 2015, 37:448-456.
[16] SRIVASTAVA N, HINTON G, KRIZHEVSKY A, et al. Dropout:a simple way to prevent neural networks from overfitting[J]. Journal of Machine Learning Research, 2014, 15(1):1929-1958.
[17] ABADI M, BARHAM P, CHEN J, et al. TensorFlow:a system for large-scale machine learning[C]//Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. Berkeley, CA:USENIX Association, 2016:265-283.
[18] DOWNEY T J, MEYER D J, PRICE R K, et al. Using the receiver operating characteristic to asses the performance of neural classifiers[C]//Proceedings of the 1999 International Joint Conference on Neural Networks. Piscataway, NJ:IEEE, 1999:3642-3646.
[19] ZEILER M D. ADADELTA:an adaptive learning rate method[EB/OL].[2019-02-01]. https://arxiv.org/pdf/1212.5701.pdf.
[20] SELVARAJU R R, COGSWELL M, DAS A, et al. Grad-CAM:visual explanations from deep networks via gradient-based localization[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision. Piscataway, NJ:IEEE, 2017, 1:618-626.

基于三维卷积神经网络的虫音特征识别方法

Insect sound feature recognition method based on three-dimensional convolutional neural network

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 9

编辑推荐

Metrics

[1]	徐少伟, 秦品乐, 曾建朝, 赵致楷, 高媛. 基于注意力机制的两阶段纵膈淋巴结自动分割算法[J]. 计算机应用, 2021, 41(2): 556-562.
[2]	陈莉, 王洪元, 张云鹏, 曹亮, 殷雨昌. 联合均等采样随机擦除和全局时间特征池化的视频行人重识别方法[J]. 计算机应用, 2021, 41(1): 164-169.
[3]	王杰, 王让定, 严迪群, 林昱臻. 基于卷积神经网络框架的回声隐藏检测方法[J]. 计算机应用, 2020, 40(2): 375-380.
[4]	金忠星, 李东. 消费者偏好预测的深度学习神经网络模型[J]. 计算机应用, 2019, 39(7): 1888-1893.
[5]	徐姗姗, 颜超, 高琳明. 基于三维卷积神经网络的湖泊提取算法[J]. 计算机应用, 2019, 39(12): 3450-3455.
[6]	李璨, 王让定, 严迪群. 基于卷积神经网络的翻录语音检测算法[J]. 计算机应用, 2018, 38(1): 79-83.
[7]	陶中幸裴东王全州杨鸿武裴会新. 基于现场可编程门阵列的语谱图显示与增强[J]. 计算机应用, 2011, 31(07): 1995-1997.
[8]	张静余小清许雪琼常辽豫万旺根李昌莲. 基于非线性变换法语谱图的伪彩色显示[J]. 计算机应用, 2010, 30(1): 270-273.
[9]	梁泽马义德张恩溯朱望飞汤书森. 一种基于脉冲耦合神经网络的语音情感识别新方法[J]. 计算机应用, 2008, 28(3): 710-713.