基于时频二维能量特征的汉语音节切分方法

doi:10.11772/j.issn.1001-9081.2016.11.3222

计算机应用 ›› 2016, Vol. 36 ›› Issue (11): 3222-3228.DOI: 10.11772/j.issn.1001-9081.2016.11.3222

基于时频二维能量特征的汉语音节切分方法

张扬, 赵晓群, 王缔罡

同济大学电子与信息工程学院, 上海 201804

收稿日期:2016-05-27 修回日期:2016-06-20 出版日期:2016-11-10 发布日期:2016-11-12
通讯作者: 赵晓群
作者简介:张扬(1989-),男,山东滨州人,博士研究生,主要研究方向:语音信号处理;赵晓群(1962-),男,黑龙江依安人,教授,博士,主要研究方向:语音信号处理、编码理论;王缔罡(1988-),男,上海人,博士研究生,主要研究方向:编码理论。

Chinese speech segmentation into syllables based on energies in different times and frequencies

ZHANG Yang, ZHAO Xiaoqun, WANG Digang

College of electronics and information engineering, Tongji University, Shanghai 201804, China

Received:2016-05-27 Revised:2016-06-20 Online:2016-11-10 Published:2016-11-12

摘要/Abstract

摘要： 较准确的语音切分方法可以极大提高语料标注等工作的效率，有助于语音识别等应用中语音与模型的对齐。利用汉语语音在时频二维的能量特征设计了一种新的汉语语音音节切分方法。用传统方法判断静音帧，用相同时间不同频率的二维能量判断清音帧，用不同时间特定频段的0-1二维能量判断浊音帧及有话帧，综合4种判断结果给出音节切分位置。实验结果表明，该方法切分准确度优于基于归并的音节切分自动机（MBSDA）和高斯拟合法，其音节切分误差为0.0297 s，音节切分偏差率为7.93%。

关键词: 音节切分, 时频二维, 短时能量, 切分偏差率

Abstract: Precise speech segmentation methods, which can also greatly improve the efficiency of corpus annotation works, are helpful in comparing voice with voice models in speech recognition. A new Chinese speech segmentation into syllables based on the feature of time-frequency-dimensional energy was proposed:firstly, silence frames were searched in traditional way; secondly, unvoiced frames were sought using the difference of energies in different frequencies; thirdly, the voiced frames and speech frames were looked for with the help of 0-1 energies in special frequency ranges; finally, syllable positions were given depending on the judgements above. The experimental results show that the proposed method whose syllable error is 0.0297 s and syllable deviation is 7.93% is superior to Merging-Based Syllable Detection Automaton (MBSDA) and method of Gauss fitting.

Key words: speech segmentation into syllables, time-frequency-dimensional, short-time energy, segmentation deviation rate

中图分类号:

TP391.4

张扬, 赵晓群, 王缔罡. 基于时频二维能量特征的汉语音节切分方法[J]. 计算机应用, 2016, 36(11): 3222-3228.

ZHANG Yang, ZHAO Xiaoqun, WANG Digang. Chinese speech segmentation into syllables based on energies in different times and frequencies[J]. Journal of Computer Applications, 2016, 36(11): 3222-3228.

参考文献

[1] FARAJI N, AHADI S M, SHEIKHZADEH H. Sequential method for speech segmentation based on random matrix theory[J]. IET Signal Processing, 2013, 7(7):625-633.
[2] SATTAR F, NILSSON M, CLAESSON I. Segmentation and its real-world applications in speech processing[C]//Proceedings of the 9th International Symposium on Signal Processing and Its Applications. Piscataway, NJ:IEEE, 2007:1-4.
[3] BROGNAUX S, DRUGMAN T. HMM-based speech segmentation:improvements of fully automatic approaches[J]. IEEE/ACM Transactions on Audio Speech and Language Processing, 2016,24(1):5-15.
[4] KISS G, SZTAHO D, VICSI K. Language independent automatic speech segmentation into phoneme-like units on the base of acoustic distinctive features[C]//Proceedings of the 4th International Conference on Cognitive Infocommunications. Piscataway, NJ:IEEE, 2013:579-582.
[5] MPORAS I, LAZARIDIS A, GANCHEV T, et al. Using hybrid HMM-based speech segmentation to improve synthetic speech quality[C]//Proceedings of the 4th Panhellenic Conference on Informatics. Piscataway, NJ:IEEE, 2009:118-122.
[6] ZIOLKO B, MANANDHAR S, WILSON R C, et al. Wavelet method of speech segmentation[C]//Proceedings of the 6th European Signal Processing Conference. Piscataway, NJ:IEEE, 2006:1-5.
[7] LEE K S. MLP-based phone boundary refining for a TTS database[J]. IEEE Transactions on Audio, Speech and Language Processing, 2006,14(3):981-989.
[8] ABEL A K, HUNTER D, SMITH L S. A biologically inspired onset and offset speech segmentation approach[C]//Proceedings of the 2015 International Joint Conference on Neural Networks. Piscataway, NJ:IEEE, 2015:1-8.
[9] MUSFIR M, KRISHNAN K R, MURTHY H A. Analysis of fricatives, stop consonants and nasals in the automatic segmentation of speech using the group delay algorithm[C]//Proceedings of the 201420th National Conference on Communications. Piscataway, NJ:IEEE,2013:1-6.
[10] AKDEMIR E, CILOGLU T. HMM topology for boundary refinement in automatic speech segmentation[J]. Electronics letters,2010,46(15):1086-1087.
[11] 杜守栓. 方言口音普通话语音自动切分算法研究[D].北京:中国科学院计算技术研究所, 2006:15-26.(DU S S. Research on robust automatic segmentation of dialectal speech[D]. Beijing:Chinese Academy of Sciences, Institute of Computing Technology, 2006:15-26.)
[12] 张继勇,郑方,杜术,等.连续汉语语音识别中基于归并的音节切分自动机[J].软件学报,1999,10(11):1212-1215.(ZHANG J Y,ZHENG F,DU S, et al. Merging-based syllables detection automaton in continuous Chinese speech recognition[J]. Journal of Software,1999,10(11):1212-1215.)
[13] 韩虎. 汉语连续语音的音节自动标注算法研究及实现[D].哈尔滨:哈尔滨工业大学,2008:21-44.(HAN H. Research and realization of the automatic syllable marking algorithm for Chinese continuous speech[D]. Harbin:Harbin Institute of Technology, 2008:21-44.)
[14] 张扬,赵晓群,王缔罡. 基于音节长度高斯拟合的汉语音音节切分方法[J]. 计算机应用,2016,36(5):1410-1414.(ZHANG Y, ZHAO X Q, WANG D G. Chinese speech segmentation method based on Gauss distribution of time spans of syllables[J]. Journal of Computer Applications,2016,36(5):1410-1414.)
[15] FISHER E, TABRIKIAN J, DUBNOV S. Generalized likelihood ratio test for voiced-unvoiced decision in noisy speech using the harmonic model[J]. IEEE Transactions on Audio, Speech and Language Processing, 2006, 14(2):502-510.
[16] 金学成,汪增福.基于线性预测残差倒谱的基音周期检测[J].模式识别与人工智能,2008,21(1):104-110.(JIN X C,WANG Z F.A pitch detection algorithm based on linear predication residual cepstrum[J]. Pattern Identification and Artificial Intelligence, 2008,21(1):104-110.)
[17] 党晓妍,魏旋,崔慧娟,等.声码器清浊音判决算法优化[J].清华大学学报:自然科学版,2008,48(7):1119-1122.(DANG X Y,WEI X,CUI H J, et al. Improvement of voiced-unvoiced classification in vocoders[J]. Journal of Tsinghua University (Science and Technology),2008,48(7):1119-1122.)

基于时频二维能量特征的汉语音节切分方法

Chinese speech segmentation into syllables based on energies in different times and frequencies

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 6

编辑推荐

Metrics

[1]	常峥, 罗萍, 杨波, 张晓晓. 基于HHT-MFCC和短时能量的慢性阻塞性肺病患者呼吸声识别[J]. 计算机应用, 2021, 41(2): 598-603.
[2]	李灿, 杨雅婷, 马玉鹏, 董瑞. 基于语种相似性挖掘的神经机器翻译语料库扩充方法[J]. 《计算机应用》唯一官方网站, 2021, 41(11): 3145-3150.
[3]	张扬, 赵晓群, 王缔罡. 基于音节时间长度高斯拟合的汉语音节切分方法[J]. 计算机应用, 2016, 36(5): 1410-1414.
[4]	吕霄云王宏霞. 基于MFCC和短时能量混合的异常声音识别算法[J]. 计算机应用, 2010, 30(3): 796-798.
[5]	杨永超付中华蒋冬梅. 基于DSP的实时语音检测的设计与实现[J]. 计算机应用, 2008, 28(2): 491-493,.
[6]	唐升侯榆青克兢. 一种基于短时能量自适应的回声隐藏算法[J]. 计算机应用, 2008, 28(11): 2824-2826.