Classifier fusion for speech emotion recognition based on improved queuing voting algorithm

• Intelligence perception • Previous Articles Next Articles

Classifier fusion for speech emotion recognition based on improved queuing voting algorithm

Received:2008-08-01 Revised:2008-10-13 Online:2009-02-01 Published:2009-04-22
Contact: Li-Qin Fu

基于改进的排序式选举算法的语音情感融合识别

付丽琴毛峡陈立江

1.北京航空航天大学电子信息工程学院，北京，100083 2. 中北大学信息与通信工程学院，太原，030051 北京航空航天大学电子信息工程学院，北京，100083 北京航空航天大学电子信息工程学院，北京，100083

通讯作者: 付丽琴

Abstract

Abstract: According to the continuous space model for emotion, an improved queuing voting algorithm was proposed to implement the fusion of multiple emotion classifiers for a good emotion recognition result. Based on hidden Markov model (HMM) and artificial neural network (ANN), three kinds of classifier were designed. Then, the improved queuing voting algorithm was used to fuse them. Experimental study had been carried out by using Mandarin emotional speech database recoded and emotional speech database respectively. The results prove that the improved queuing voting algorithm can attain better fusion effect than conventional fusion algorithm and excel any single classifier evidently. The provided algorithm is not only easy to implement, but also transplantable. It is suitable for the fusion of any emotion classifiers.

Key words: speech emotion recognition, data fusion, Hidden Markov Model (HMM), Artificial Neural Network（ANN）, queuing voting algorithm

摘要： 根据情感的连续空间模型，提出一种改进的排序式选举算法，实现多个情感分类器的融合，取得了很好的情感识别效果。首先以隐马尔可夫模型（HMM）和人工神经网络（ANN）为基础，设计了三种分类器；然后用改进的排序式选举算法，实现对三种分类器的融合。分别利用普通话情感语音库和德语情感语音库进行实验，结果表明，与几种传统融合算法相比，改进的排序式选举法能够取得更好的融合效果，其识别性能明显优于单分类器。该算法不仅简单，而且可移植性好，可用于其他任意多个情感分类器的融合。

关键词: 语音情感识别, 数据融合, 隐马尔可夫模型, 人工神经网络, 排序式选举法

Li-Qin Fu Xia Mao Li-Jiang Chen. Classifier fusion for speech emotion recognition based on improved queuing voting algorithm[J]. Journal of Computer Applications.

付丽琴毛峡陈立江. 基于改进的排序式选举算法的语音情感融合识别[J]. 计算机应用.

[1]	QU Jingyi, CAO Lei, CHEN Min, DONG Liang, CAO Yexiu. CliqueNet flight delay prediction model based on clique random connection [J]. Journal of Computer Applications, 2020, 40(8): 2420-2427.
[2]	HUO Weigang, WANG Huifang. Time series anomaly detection method based on autoencoder and HMM [J]. Journal of Computer Applications, 2020, 40(5): 1329-1334.
[3]	LIN Zheng, LYU Xiafu. Autonomous obstacle avoidance of unmanned surface vessel based on improved fuzzy algorithm [J]. Journal of Computer Applications, 2019, 39(9): 2523-2528.
[4]	WANG Jince, DENG Yueping, SHI Ming, ZHOU Yunfei. Time series trend prediction at multiple time scales [J]. Journal of Computer Applications, 2019, 39(4): 1046-1052.
[5]	HUANG Fengyu, WU Yefu, CHEN Jingren, WU Bing. Traffic behavior spectrum analysis method based on regional road live data [J]. Journal of Computer Applications, 2019, 39(3): 907-912.
[6]	YANG Shiqiang, LUO Xiaoyu, QIAO Dan, LIU Peilei, LI Dexin. Continuous action segmentation and recognition based on sliding window and dynamic programming [J]. Journal of Computer Applications, 2019, 39(2): 348-353.
[7]	DING Jingquan, MA Bo, LI Xiao. Multi-view deep anomaly detection framework for vehicle refueling behaviors based on spatio-temporal data fusion [J]. Journal of Computer Applications, 2019, 39(11): 3370-3375.
[8]	QIU Jinyi, LUO Jun, LI Xiu, JIA Wei, NI Fuchuan, FENG Hui. Multi-scale grape image recognition method based on convolutional neural network [J]. Journal of Computer Applications, 2019, 39(10): 2930-2936.
[9]	WU Renbiao, LI Jiayi, QU Jingyi. Flight delay prediction model based on dual-channel convolutional neural network [J]. Journal of Computer Applications, 2018, 38(7): 2100-2106.
[10]	XU Shuang, ZHANG Qian, LI Yan, LIU Jiayong. Multi-source point of interest fusion algorithm based on distance and category [J]. Journal of Computer Applications, 2018, 38(5): 1334-1338.
[11]	QU Licheng, GAO Fenfen, BAI Chao, LI Mengmeng, ZHAO Ming. Radar-guided video linkage surveillance model and algorithm [J]. Journal of Computer Applications, 2018, 38(12): 3625-3630.
[12]	REN Xiaoxu, LYU Liangfu, CUI Guangtai. Data fusion algorithm of coupled images [J]. Journal of Computer Applications, 2018, 38(10): 2862-2868.
[13]	GUO Leiyong, LI Yu, LIN Shengyi, TAN Hongzhou. Excitation piecewise expansion method for speech bandwidth expansion based on hidden Markov model [J]. Journal of Computer Applications, 2017, 37(8): 2416-2420.
[14]	LI Fangwei, LI Qi, ZHU Jiang. Improved method of situation assessment method based on hidden Markov model [J]. Journal of Computer Applications, 2017, 37(5): 1331-1334.
[15]	XIE Lin, PENG Jian, LIU Tang, LIU Huashan. Energy hole avoidance strategy based on multi-level energy heterogeneity for wireless sensor networks [J]. Journal of Computer Applications, 2016, 36(6): 1475-1479.