计算机应用 ›› 2013, Vol. 33 ›› Issue (02): 503-506.DOI: 10.3724/SP.J.1087.2013.00503

• 多媒体处理技术 • 上一篇    下一篇

基于细胞神经网络的快速手语视频分割方法

张爱华1,2,雷小亚2,陈晓雷1,陈莉莉2   

  1. 1. 兰州理工大学 电气工程与信息工程学院,兰州 730050
    2. 兰州理工大学 计算机与通信学院,兰州 730050
  • 收稿日期:2012-08-22 修回日期:2012-10-06 出版日期:2013-02-01 发布日期:2013-02-25
  • 通讯作者: 雷小亚
  • 作者简介:张爱华(1964-),女,河北永年人,教授,博士,主要研究方向:机器视觉信息获取与处理、检测技术、智能信息处理;
    雷小亚(1987-),女,甘肃天水人,硕士研究生,主要研究方向:数字图像处理、图像通信;
    陈晓雷(1979-),男,甘肃兰州人,博士研究生,主要研究方向:数字图像处理、智能信息处理;
    陈莉莉(1986-),女,甘肃武威人,硕士研究生,主要研究方向:数字图像处理、智能信息处理。
  • 基金资助:
    湖南省科技厅资助项目;甘肃省自然科学基金资助项目

Fast segmentation of sign language video based on cellular neural network

ZHANG Aihua1,2,LEI Xiaoya1,CHEN Xiaolei2,CHEN Lili1   

  1. 1. School of Computer and Communication, Lanzhou University of Technology, Lanzhou Gansu 730050, China
    2. School of Electrical and Information Engineering, Lanzhou University of Technology, Lanzhou Gansu 730050, China
  • Received:2012-08-22 Revised:2012-10-06 Online:2013-02-01 Published:2013-02-25
  • Contact: LEI Xiaoya

摘要: 为实现感兴趣区手语视频编码,提高通话效率,提出一种基于细胞神经网络(CNN)的快速手语视频分割方法。该方法首先利用肤色信息特征进行基于CNN的肤色检测,检测出手语视频中的肤色区域;然后对肤色检测结果,利用帧差法进行基于CNN的运动检测,获得初始的手势区域;最后采用形态学处理方法进行空洞填充和边界平滑,实现了手语视频图像序列中的面部和手部区域的分割。研究结果表明,该方法能够快速准确地进行手语视频分割。

关键词: 细胞神经网络, 手语, 视频分割, 肤色检测, 运动检测

Abstract: To achieve sign language video coding of region of interest, and improve call efficiency, a fast segmentation methodology of sign language video based on Cellular Neural Network (CNN) was proposed. Firstly, the skin regions of sign language video were detected through corresponding CNN templates by using the skin color information characteristics. Secondly, CNN based motion detection was carried out on the skin detection results by using inter-frame difference algorithm, and then the initial gesture region could be obtained. Finally, morphological processing methods were employed to fill small holes and smooth the boundaries of regions, and eventually the segmentation of the face and hands regions of sign language video image sequence was realized. The results show that the method can rapidly and accurately segment sign language video.

Key words: Cellular Neural Network (CNN), sign language, video segmentation, skin color detection, motion detection

中图分类号: