计算机应用 ›› 2013, Vol. 33 ›› Issue (11): 3084-3089.

• 人工智能 • 上一篇    下一篇

迁移学习支持向量回归机

史荧中1,2,王士同1,蒋亦樟1,刘培林1,2   

  1. 1. 江南大学 数字媒体学院,江苏 无锡 214122
    2. 无锡职业技术学院 物联网学院,江苏 无锡 214121
  • 收稿日期:2013-05-28 修回日期:2013-07-21 出版日期:2013-11-01 发布日期:2013-12-04
  • 通讯作者: 史荧中
  • 作者简介:史荧中(1970-),男,江苏无锡人,讲师,博士研究生,主要研究方向:人工智能;王士同(1964-),男,江苏扬州人,教授,博士生导师,主要研究方向:模糊人工智能、模式识别;蒋亦樟(1988-),男,江苏无锡人,博士研究生,主要研究方向:机器学习;刘培林(1972-),女,山西代县人,副教授,硕士,主要研究方向:图像处理、模式识别。
  • 基金资助:
    国家自然科学基金资助项目;国家自然科学基金资助项目

Transfer learning support vector regression

SHI Yingzhong1,2,WANG Shitong2,JIANG Yizhang2,LIU Peilin1,2   

  1. 1. College of Internet of Things, Wuxi Institute of Technology, Wuxi Jiangsu 214121,China
    2. School of Digital Media, Jiangnan University, Wuxi Jiangsu 214122, China;
  • Received:2013-05-28 Revised:2013-07-21 Online:2013-12-04 Published:2013-11-01
  • Contact: SHI Yingzhong

摘要: 传统的回归系统构建方法假设用于建模的数据是充分的,但若当前场景中重要数据信息缺失,则基于此数据集训练所得系统泛化能力较差。针对此缺陷,以支持向量回归机(SVR)为基础,提出了具有迁移学习能力的回归机系统,即迁移学习支持向量回归机(T-SVR)。T-SVR不仅能充分利用当前场景的数据信息,而且能有效地利用历史知识来学习,具有通过迁移历史场景知识来弥补当前场景信息缺失的能力。具体地,通过控制目标函数中当前模型与历史模型的相似性,使当前模型能在信息缺失和不足时从历史场景中得到有益信息,得到增强的当前场景模型。在模拟数据和酒类光谱数据集上的实验研究亦验证了在信息缺失场景下T-SVR较之于传统回归系统建模方法的更好适应性。

关键词: 迁移学习, 数据缺失, 支持向量回归机, 知识相关性, 信息修补

Abstract: The classical regression systems modeling methods suppose that the training data are sufficient, but partial information missing may weaken the generalization abilities of the regression systems constructed based on this dataset. In order to solve this problem, a regression system with the transfer learning abilities, i.e. Transfer learning Support Vector Regression (T-SVR for brevity) was proposed based on support vector regression. T-SVR could use the current data information sufficiently, and learn from the existing useful historical knowledge effectively, so that remedy the information lack in the current scene. Reinforced current model was obtained through controlling the similarity between current model and history model in the object function and current model can benefit from history scene when information is missing or insufficient. The experiments on simulation data and real data show that T-SVR has better adaptability than the traditional regression modeling method in the scene with information missing.

Key words: transfer learning, data missing, Supported Vector Regression (SVR), knowledge similarity, information remedy

中图分类号: