计算机应用 ›› 2015, Vol. 35 ›› Issue (6): 1643-1648.DOI: 10.11772/j.issn.1001-9081.2015.06.1643

• 人工智能 • 上一篇    下一篇

基于分布和逆文本类别指数的特征迁移加权算法

邱云飞1, 刘世兴1, 林明明1, 邵良杉2   

  1. 1. 辽宁工程技术大学 软件学院, 辽宁 葫芦岛 125105;
    2. 辽宁工程技术大学 系统工程研究所, 辽宁 葫芦岛 125105
  • 收稿日期:2014-12-22 修回日期:2015-03-17 发布日期:2015-06-12
  • 通讯作者: 刘世兴(1990-),男,辽宁丹东人,硕士研究生,主要研究方向:数据挖掘、特征选择;494784913@qq.com
  • 作者简介:邱云飞(1976-),男,辽宁阜新人,教授,博士,CCF会员,主要研究方向:数据挖掘、情感分析;林明明(1989-),女,辽宁大连人,硕士研究生,主要研究方向:数据挖掘、情感分析;邵良杉(1961-),男,辽宁凌源人,教授,博士,主要研究方向:数据挖掘、情感分析。
  • 基金资助:

    国家自然科学基金资助项目(70971059);辽宁省创新团队项目(2009T045);辽宁省高等学校杰出青年学者成长计划项目(LJQ2012027)。

Feature transfer weighting algorithm based on distribution and term frequency-inverse class frequency

QIU Yunfei1, LIU Shixing1, LIN Mingming1, SHAO Liangshan2   

  1. 1. School of Software, Liaoning Technical University, Huludao Liaoning 125105, China;
    2. System Engineering Institute, Liaoning Technical University, Huludao Liaoning 125105, China
  • Received:2014-12-22 Revised:2015-03-17 Published:2015-06-12

摘要:

传统机器学习面临一个难题,即当训练数据与测试数据不再服从相同分布时,由训练集得到的分类器无法对测试集文本准确分类。针对该问题,根据迁移学习原理,在源领域和目标领域的交集特征中,依据改进的特征分布相似度进行特征加权;在非交集特征中,引入语义近似度和新提出的逆文本类别指数(TF-ICF),对特征在源领域内进行加权计算,充分利用大量已标记的源领域数据和少量已标记的目标领域数据获得所需特征,以便快速构建分类器。在文本数据集20Newsgroups和非文本数据集UCI中的实验结果表明,基于分布和逆文本类别指数的特征迁移加权算法能够在保证精度的前提下对特征快速迁移并加权。

关键词: 迁移学习, 特征分布, 逆文本类别指数, 语义近似度, 特征加权

Abstract:

Traditional machine learning faces a problem: when the training data and test data no longer obey the same distribution, the classifier trained by training data can't classify test data accurately. To solve this problem, according to the transfer learning principle, the features were weighted according to the improved distribution similarity of source domain and target domain's intersection features. The semantic similarity and Term Frequency-Inverse Class Frequency (TF-ICF) were used to weight non-intersection features in source domain. Lots of labeled source domain data and a little labeled target domain were used to obtain the required features for building text classifier quickly. The experimental results on test dataset 20Newsgroups and non-text dataset UCI show that feature transfer weighting algorithm based on distribution and TF-ICF can transfer and weight features rapidly while guaranteeing precision.

Key words: transfer learning, feature distribution, Term Frequency-Inverse Class Frequency (TF-ICF), semantic similarity, feature weighting

中图分类号: