Journal of Computer Applications ›› 2026, Vol. 46 ›› Issue (6): 1776-1784.DOI: 10.11772/j.issn.1001-9081.2025060737

• Artificial intelligence • Previous Articles    

Gradient orthogonal projection based continual embedding method for dynamic knowledge graph

Meihua WANG1, Jie HUANG1, Wen WEN2(), Ruichu CAI2, Peijie HUANG1, Yuhong XU1, Xinlong LIN1   

  1. 1.College of Mathematics and Informatics,South China Agricultural University,Guangzhou Guangdong 510640,China
    2.School of Computer Science and Technology,Guangdong University of Technology,Guangzhou Guangdong 510006,China
  • Received:2025-07-05 Revised:2026-01-08 Accepted:2026-01-14 Online:2026-02-05 Published:2026-06-10
  • Contact: Wen WEN
  • About author:WANG Meihua, born in 1970, M. S., associate professor. Her research interests include machine learning, knowledge graph and continuous learning, data mining.
    HUANG Jie, born in 1999, M. S. His research interests include machine learning, knowledge graph and continuous learning.
    CAI Ruichu, born in 1983, Ph. D., professor. His research interests include causal discovery, machine learning.
    HUANG Peijie, born in 1980, Ph. D., associate professor. His research interests include artificial intelligence, natural language processing, spoken dialogue system.
    XU Yuhong, born in 1994, Ph. D., associate professor. His research interests include causal discovery, machine learning, ensemble learning, unbalanced learning.
    LIN Xinlong, born in 2000, M. S. His research interests include machine learning, time series data mining.
    First author contact:WEN wen, born in 1983, Ph. D., professor. Her research interests include machine learning, time series data mining.
  • Supported by:
    Natural Science Foundation of Guangdong Province(2024A1515011380);Research Project on Key Areas of Universities in Guangdong Province(2024ZDZX4032)

基于梯度正交投影的动态知识图谱持续嵌入方法

王美华1, 黄杰1, 温雯2(), 蔡瑞初2, 黄沛杰1, 徐禹洪1, 林新龙1   

  1. 1.华南农业大学 数学与信息学院,广州 510640
    2.广东工业大学 计算机学院,广州 510006
  • 通讯作者: 温雯
  • 作者简介:王美华(1970—),女,江苏常州人,副教授,硕士,主要研究方向:机器学习、知识图谱与持续学习、数据挖掘
    黄杰(1999—),男,广东河源人,硕士,主要研究方向:机器学习、知识图谱与持续学习
    蔡瑞初(1983—),男,浙江温州人,教授,博士,CCF会员,主要研究方向:因果发现、机器学习
    黄沛杰(1980—),男,广东潮州人,副教授,博士,CCF会员,主演研究方向:人工智能、自然语言处理、口语对话系统
    徐禹洪(1994—),男,广东佛山人,副教授,博士,CCF会员,主要研究方向:因果发现、机器学习、集成学习、不平衡学习
    林新龙(2000—) 男,广东佛山人,硕士,主要研究方向:机器学习、时序数据挖掘。
    第一联系人:温雯(1983—),女,江西赣州人,教授,博士,CCF会员,主要研究方向:机器学习、时序数据挖掘
  • 基金资助:
    广东省自然科学基金资助项目(2024A1515011380);广东省普通高校重点领域研究项目(2024ZDZX4032)

Abstract:

To address the issue that the existing Knowledge Graph (KG) embedding models cannot adapt to the increasing KG, a dynamic KG continual embedding method based on gradient orthogonal projection, named GOPemb (Gradient Orthogonal Projection embedding), was proposed. Firstly, the Core Gradient Spaces (CGSs) of old entities and old relationships were stored in historical snapshots during the training process. Secondly, when learning new triples, the gradient update directions for old entities and old relationships were constrained to align with the orthogonal directions of their respective CGSs, thereby learning new knowledge efficiently while preserving historical knowledge effectively. Finally, the CGSs of old entities and old relationships were updated to prepare for the next learning iteration. Experimental results show that compared to the best method in the comparison group, IncDE (Incremental Distillation Embedding), GOPemb method achieves average improvements of 9.2%, 14.0%, and 8.0% in MRR (Mean Reciprocal Rank), H@3 (Top-3 Hit Rate), and H@10 (Top-10 Hit Rate), respectively, on the selected datasets ICEWS05-15-CL、ICEWS18-CL and GDELT-CL. Furthermore, experimental results on learning efficiency confirm the time efficiency of GOPemb method, indicating that the method has efficient continual embedding capability.

Key words: knowledge graph, knowledge graph embedding, representation learning, Continual Learning (CL), incremental learning

摘要:

针对现有的知识图谱(KG)嵌入模型无法适应不断增长的KG的问题,提出一种基于梯度正交投影的动态KG持续嵌入方法GOPemb (Gradient Orthogonal Projection embedding)。首先,在训练过程中将旧实体和旧关系的核心梯度空间(CGS)存储于历史快照;其次,在学习新三元组时,旧实体和旧关系的梯度更新方向被约束为与它们各自CGS的正交方向一致,从而在有效保留历史知识的同时高效地学习新知识;最后,更新旧实体和旧关系的CGS,从而为下一次的学习迭代作准备。实验结果显示,相较于对比方法中最优的IncDE (Incremental Distillation Embedding),GOPemb方法在数据集ICEWS05-15-CL、ICEWS18-CL和GDELT-CL上的MRR (Mean Reciprocal Rank)、H@3 (Top-3 Hit Rate)和H@10 (Top-10 Hit Rate)分别平均提升了9.2%、14.0%和8.0%。此外,学习效率的实验结果也验证了GOPemb方法的时间高效性,表明该方法具备高效的持续嵌入能力。

关键词: 知识图谱, 知识图谱嵌入, 表示学习, 持续学习, 增量学习

CLC Number: