计算机应用 ›› 2010, Vol. 30 ›› Issue (06): 1704-1707.

• 典型应用 • 上一篇    下一篇

视频情感语义分析——类型-强度分解法

郭戈1,平西建2   

  1. 1. 信息工程大学
    2.
  • 收稿日期:2010-01-06 修回日期:2010-02-18 发布日期:2010-06-01 出版日期:2010-06-01
  • 通讯作者: 郭戈

Affective semantic analysis in video: type-intensity decomposition method

  • Received:2010-01-06 Revised:2010-02-18 Online:2010-06-01 Published:2010-06-01

摘要: 提出一种视频情感语义分析方法,利用强度和类型两个独立分量构造的二维空间来建立人类情感模型,通过多模态的听觉、视觉特征,分别构造连续型的情感强度时序曲线和离散型的情感类型时序曲线,从而建立低层特征空间与情感空间之间的映射关系,实现对视频内容的情感注释和分析。类型-强度分解曲线可客观、真实地描述视频情感内容随时间的变化情况。实验结果验证了该方法的有效性。

关键词: 情感语义, 情感强度曲线, 情感类型曲线, 情感模型

Abstract: This paper looked into a new direction in video content, affective semantic analysis, which can be defined as the understanding of feelings or emotions expected to arise in viewers while watching video clip. According to the approach proposed in this paper, the affective semantic space can be decomposed by two independence elements, affective intensity and affective type. Thus the affective video content was mapped onto the 2-D emotion space by the model that bridges the gap between low-level features and high-level affective semantic meaning. A number of effective audiovisual cues were formulated to help establish the two element curves. The simulations verify the method's reliability and consistency between the emotions reflected by the video and the feelings observed on the viewers.

Key words: affective semantic, affective intensity curve, affective type curve, affective model