Small-array speech enhancement based on noise cancellation and beamforming

doi:10.11772/j.issn.1001-9081.2019122106

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (8): 2386-2391.DOI: 10.11772/j.issn.1001-9081.2019122106

• Virtual reality and multimedia computing • Previous Articles Next Articles

Small-array speech enhancement based on noise cancellation and beamforming

LONG Chao, ZENG Qingning, LUO Ying

College of Electronic Engineering and Automation, Guilin University of Electronic Technology, Guilin Guangxi 541004, China

Received:2019-12-13 Revised:2020-04-18 Online:2020-05-14 Published:2020-08-10
Supported by:
This work is partially supported by the National Natural Science Foundation of China (61961009), the Key Project of Natural Science Foundation of Guangxi Province (2016GXNSFDA380018), the Foundation of Ministry of Education Key Laboratory of Cognitive Radio and Information Processing (CRKL160107).

基于噪声抵消与波束形成的小阵语音增强

龙超, 曾庆宁, 罗瀛

桂林电子科技大学电子工程与自动化学院, 广西桂林 541004

通讯作者: 曾庆宁(1963-),男,广西桂林人,教授,博士,主要研究方向:语音与图像信号处理,1586477188@qq.com
作者简介:龙超(1966-),女,湖南湘潭人,高级实验师,主要研究方向:智能机器人;罗瀛(1991-),男,广西桂林人,助理实验师,硕士,主要研究方向:语音信号处理。
基金资助:
国家自然科学基金资助项目（61961009）；广西自然科学基金重点项目（2016GXNSFDA380018）；认知无线电与信息处理教育部重点实验室基金资助项目（CRKL160107）。

Abstract

Abstract: In order to improve the speech enhancement effect of small microphone array, a better method was proposed for small-array speech enhancement by combining the Array Crosstalk Resistant Adaptive Noise Cancellation (ACRANC) method with the BeamForming (BF) method. Firstly, ACRANC subsystems were constructed to obtain multiple channels of enhanced speech signals. Then, the proposed Adaptive Mode Control (AMC) algorithm and the Delay And Sum (DAS) beamforming method were applied to the enhanced speech signals for further improving the enhancement effect of multi-channel speech signals. The computational complexity of the proposed method was estimated, and it was verified that the proposed method was able to be realized in real-time with common chips. Experimental results in actual environments show that the speech enhancement effect of the proposed method is higher than that of the ACRANC method and thus the method has some advantages.

Key words: speech enhancement, noise cancellation, microphone array, crosstalk, BeamForming (BF)

摘要： 为了提高麦克风小阵的语音增强效果，将阵列抗串扰自适应噪声抵消（ACRANC）方法与波束形成（BF）方法相结合，提出了一种效果更好的小阵语音增强方法。首先，通过生成多个ACRANC子系统，获得多路增强语音信号；然后，通过所提的自适应模式控制（AMC）算法和延迟求和（DAS）波束形成方法进一步提高多路增强语音信号的增强效果。对提出的方法进行了计算复杂度估计，验证了所提方法可以通过普通芯片实时实现。实际环境下的实验结果也表明，所提方法的语音增强效果相较ACRANC方法有所提高，具有一定的优越性。

关键词: 语音增强, 噪声抵消, 麦克风阵列, 串扰, 波束形成

CLC Number:

TN912.35

LONG Chao, ZENG Qingning, LUO Ying. Small-array speech enhancement based on noise cancellation and beamforming[J]. Journal of Computer Applications, 2020, 40(8): 2386-2391.

龙超, 曾庆宁, 罗瀛. 基于噪声抵消与波束形成的小阵语音增强[J]. 计算机应用, 2020, 40(8): 2386-2391.

References

[1] GREENBERG J E, ZUREK P M. Microphone-array hearing aids[M]//BRANDSTEIN M, WARD D. Microphone Arrays:Signal Processing Techniques and Application. Berlin:Springer, 2001:229-253.
[2] 李艳生,刘园,张毅. 基于感知掩蔽的重构非负矩阵分解单通道语音增强算法[J]. 计算机应用, 2019, 39(3):894-898. (LI Y S, LIU Y, ZHANG Y. Reconstructed NMF single channel speech enhancement algorithm based on perceptual masking[J]. Journal of Computer Applications, 2019, 39(3):894-898.)
[3] 葛宛营,张天骐. 基于掩蔽估计与优化的单通道语音增强算法[J]. 计算机应用, 2019, 39(10):3065-3070. (GE W Y, ZHANG T Q. Monaural speech enhancement algorithm based on mask estimation and optimization[J]. Journal of Computer Applications, 2019, 39(10):3065-3070.)
[4] 欧世峰,赵晓晖,顾海军. 改进的基于信号子空间的多通道语音增强算法[J]. 电子学报, 2005, 33(10):1786-1789. (OU S F, ZHAO X H, GU H J. An improved speech enhancement approach based on signal subspace with multi-input[J]. Acta Electronica Sinica, 2005, 33(10):1786-1789.)
[5] GANNOT S, BURSHTEIN D, WEINSTEIN E. Analysis of the power spectral deviation of the general transfer function GSC[J]. IEEE Transactions on Signal Processing, 2004, 52(4):1115-1121.
[6] 杨立春,钱沄涛. 基于相干性滤波器的广义旁瓣抵消器麦克风小阵列语音增强方法[J]. 电子与信息学报, 2012, 34(12):3027-3033. (YANG L C, QIAN Y T. Speech enhancement with generalized sidelobe canceller based on a coherence-based filter for small microphone arrays[J]. Journal of Electronics and Information, 2012, 34(12):3027-3033.)
[7] 马金龙,曾庆宁,胡丹,等.基于麦克风小阵的多噪声环境语音增强算法[J]. 计算机应用, 2015, 35(8):2341-2344. (MA J L, ZENG Q N, HU D, et al. Speech enhancement algorithm based on microphone array under multiple noise environments[J]. Journal of Computer Application, 2015, 35(8):2341-2344.)
[8] LI K, FU Q, YAN Y. Speech enhancement using robust generalized sidelobe canceller with multi-channel post-filtering in adverse environments[J]. Chinese Journal of Electronics, 2012,12(1):85-90.
[9] MARKOVICH-GOLAN S, GANNOT S, COHEN I. Distributed multiple constraints generalized sidelobe canceler for fully connected wireless acoustic sensor networks[J]. IEEE Transactions on Audio, Speech, and Language Processing, 2013, 21(2):333-356.
[10] KIM S M, KIM H K. Hybrid probabilistic adaptation mode controller for generalized sidelobe cancellers applied to multi-microphone speech enhancement[J]. Digital Signal Processing, 2014, 25:123-133.
[11] SHIN M, MUN S, HAN D K, KO H. New generalized sidelobe canceller with denoising auto-encoder for improved speech enhancement[J]. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2017, E100-A(12):3038-3040.
[12] 曾庆宁,欧阳缮,廖桂生. 基于阵列抗串扰自适应噪声抵消的语音增强[J]. 电子学报, 2005, 33(2):241-244. (ZENG Q N, OUYANG S, LIAO G S. Speech enhancement based on array cross-talk resistant adaptive noise cancellation[J]. Acta Electronica Sinica, 2005, 33(2):241-244.)
[13] ZENG Y, HENDRIKS R C. Distributed delay and sum beamformer for speech enhancement via randomized gossip[J]. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014, 22(1):260-273.
[14] SOHN J, KIM N S, SUN W. A statistical model-based voice activity detection[J]. IEEE Signal Processing Letters, 1999, 6(1):1-3.
[15] HU Y, LOIZOU P C. Subjective comparison and evaluation of speech enhancement algorithms[J]. Speech Communication, 2007, 49(7/8):588-601.
[16] YOUSEFIAN N, LOIZOU P C. A dual-microphone speech enhancement algorithm based on the coherence function[J]. IEEE Transactions on Audio, Speech, and Language Processing, 2012, 20(2):599-609.
[17] XU Y, DU J, DAI L, et al. An experimental study on speech enhancement based on deep neural networks[J]. IEEE Signal Processing Letters, 2014, 21(1):65-68.
[18] 蒋茂松,王冬霞,牛芳琳,等. 稀疏正则非负矩阵分解的语音增强算法[J]. 计算机应用, 2018, 38(4):1176-1180. (JIANG M S, WANG D X, NIU F L, et al. Speech enhancement method based on sparsity-regularized non-negative matrix factorization[J]. Journal of Computer Applications, 2018, 38(4):1176-1180.)
[19] 许春冬,许瑞龙,周静. 基于自动编码生成对抗网络的语音增强算法[J]. 计算机工程与设计, 2019, 40(9):2578-2583. (XU C D, XU R L, ZHOU J. Speech enhancement based on auto-encoders and generative adversarial network[J]. Computer Engineering and Design, 2019, 40(9):2578-2583.)

Small-array speech enhancement based on noise cancellation and beamforming

基于噪声抵消与波束形成的小阵语音增强

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	Xinyuan YOU, Heng WANG. Monaural speech enhancement based on gated dilated convolutional recurrent network [J]. Journal of Computer Applications, 2024, 44(4): 1317-1324.
[2]	Jianqing GAO, Yanhui TU, Feng MA, Zhonghua FU. Progressive ratio mask-based adaptive noise estimation method [J]. Journal of Computer Applications, 2023, 43(4): 1303-1308.
[3]	Yutang JIN, Yisong WANG, Lihui WANG, Pengli ZHAO. Speech enhancement algorithm based on multi-scale ladder-type time-frequency Conformer GAN [J]. Journal of Computer Applications, 2023, 43(11): 3607-3615.
[4]	Bennian YU, Yongzhao ZHAN, Qirong MAO, Wenlong DONG, Honglin LIU. Double complex convolution and attention aggregating recurrent network for speech enhancement [J]. Journal of Computer Applications, 2023, 43(10): 3217-3224.
[5]	WU Qinghe, WU Haifeng, SHEN Yong, ZENG Yu. Speech enhancement using multi-microphone state space model under industrial noise environment [J]. Journal of Computer Applications, 2020, 40(5): 1476-1482.
[6]	ZHANG Wei, WANG Dongxia, YU Ling. Fast echo cancellation algorithm in smart speaker [J]. Journal of Computer Applications, 2020, 40(4): 1191-1195.
[7]	WANG Yongbiao, ZHANG Wenxi, WANG Yahui, KONG Xinxin, LYU Tong. Speech enhancement algorithm based on MMSE spectral subtraction with Laplacian distribution [J]. Journal of Computer Applications, 2020, 40(3): 878-882.
[8]	LI Yansheng, LIU Yuan, ZHANG Yi. Reconstructed NMF single channel speech enhancement algorithm based on perceptual masking [J]. Journal of Computer Applications, 2019, 39(3): 894-898.
[9]	GE Wanying, ZHANG Tianqi. Monaural speech enhancement algorithm based on mask estimation and optimization [J]. Journal of Computer Applications, 2019, 39(10): 3065-3070.
[10]	JIANG Maosong, WANG Dongxia, NIU Fanglin, CAO Yudong. Speech enhancement method based on sparsity-regularized non-negative matrix factorization [J]. Journal of Computer Applications, 2018, 38(4): 1176-1180.
[11]	LIU Yi, HU Zhe, JING Xiaorong. Downlink beamforming design based user scheduling for MIMO-NOMA systems [J]. Journal of Computer Applications, 2018, 38(11): 3282-3286.
[12]	XU Wenchao, WANG Guangyan, CHEN Lei. Speech enhancement algorithm based on improved variable-step LMS algorithm in cochlear implant [J]. Journal of Computer Applications, 2017, 37(4): 1212-1216.
[13]	MA Jinlong, ZENG Qingning, HU Dan, LONG Chao, XIE Xianming. Speech enhancement algorithm based on microphone array under multiple noise environments [J]. Journal of Computer Applications, 2015, 35(8): 2341-2344.
[14]	LIU Yan, NI Wanshun. Speech enhancement based on bionic wavelet transform of subband spectrum entropy [J]. Journal of Computer Applications, 2015, 35(3): 868-871.
[15]	CAI Yu HAO Chengpeng HOU Caohuan. Speech enhancement using subband spectral-subtraction [J]. Journal of Computer Applications, 2014, 34(2): 567-571.