Journal of Computer Applications ›› 2026, Vol. 46 ›› Issue (7): 2043-2053.DOI: 10.11772/j.issn.1001-9081.2025060753
• Artificial intelligence •
Jiahang LI, Qilong HAN(
), Lijie LI, Hui ZHANG
Received:2025-07-09
Revised:2025-09-01
Accepted:2025-09-09
Online:2025-09-12
Published:2026-07-10
Contact:
Qilong HAN
About author:LI Jiahang, born in 1996, Ph. D. candidate. His research interests include knowledge graph completion.Supported by:通讯作者:
韩启龙
作者简介:李佳航(1996—),男,山东临沂人,博士研究生,主要研究方向:知识图谱补全基金资助:CLC Number:
Jiahang LI, Qilong HAN, Lijie LI, Hui ZHANG. Large language model-driven method for qualifier enhancement in hyper-relational knowledge graphs[J]. Journal of Computer Applications, 2026, 46(7): 2043-2053.
李佳航, 韩启龙, 李丽洁, 张慧. 基于大语言模型的超关系知识图谱限定符增强方法[J]. 《计算机应用》唯一官方网站, 2026, 46(7): 2043-2053.
Add to citation manager EndNote|Ris|BibTeX
URL: https://www.joca.cn/EN/10.11772/j.issn.1001-9081.2025060753
| 数据集 | 实体数 | 关系数 | 样本数 | ||
|---|---|---|---|---|---|
| 训练集 | 验证集 | 测试集 | |||
| WikiPeople | 34 825 | 178 | 294 439 | 37 715 | 37 712 |
| WD50K | 47 156 | 531 | 166 435 | 23 913 | 46 159 |
Tab. 1 Statistics of datasets
| 数据集 | 实体数 | 关系数 | 样本数 | ||
|---|---|---|---|---|---|
| 训练集 | 验证集 | 测试集 | |||
| WikiPeople | 34 825 | 178 | 294 439 | 37 715 | 37 712 |
| WD50K | 47 156 | 531 | 166 435 | 23 913 | 46 159 |
| 分类 | 模型 | WikiPeople | WD50K | ||||||
|---|---|---|---|---|---|---|---|---|---|
| MRR | Hit@1 | Hit@5 | Hit@10 | MRR | Hit@1 | Hit@5 | Hit@10 | ||
| 非原始结构模型 | NaLP | 0.407 | 0.335 | 0.549 | 0.174 | 0.132 | 0.265 | ||
| HyConvE | 0.361 | 0.273 | 0.385 | 0.497 | 0.297 | 0.225 | 0.318 | 0.372 | |
| HyCubE | 0.436 | 0.362 | 0.583 | 0.302 | 0.247 | 0.417 | |||
| 原始结构模型 | STARE | 0.483 | 0.379 | 0.581 | 0.627 | 0.339 | 0.260 | 0.401 | 0.485 |
| Hy-T | 0.480 | 0.406 | 0.577 | 0.621 | 0.336 | 0.269 | 0.394 | 0.481 | |
| ShrinkE | 0.482 | 0.416 | 0.503 | 0.593 | 0.335 | 0.268 | 0.397 | 0.480 | |
| HEAT | 0.507 | 0.332 | 0.493 | 0.629 | 0.343 | 0.208 | |||
| sHINGE | 0.459 | 0.382 | 0.476 | 0.542 | 0.326 | 0.252 | 0.374 | 0.458 | |
| IRE | 0.403 | 0.513 | |||||||
| L-EQs | 0.597 | 0.488 | 0.651 | 0.724 | 0.406 | 0.304 | 0.439 | 0.544 | |
Tab. 2 Experimental results of hyper-relational knowledge graph completion
| 分类 | 模型 | WikiPeople | WD50K | ||||||
|---|---|---|---|---|---|---|---|---|---|
| MRR | Hit@1 | Hit@5 | Hit@10 | MRR | Hit@1 | Hit@5 | Hit@10 | ||
| 非原始结构模型 | NaLP | 0.407 | 0.335 | 0.549 | 0.174 | 0.132 | 0.265 | ||
| HyConvE | 0.361 | 0.273 | 0.385 | 0.497 | 0.297 | 0.225 | 0.318 | 0.372 | |
| HyCubE | 0.436 | 0.362 | 0.583 | 0.302 | 0.247 | 0.417 | |||
| 原始结构模型 | STARE | 0.483 | 0.379 | 0.581 | 0.627 | 0.339 | 0.260 | 0.401 | 0.485 |
| Hy-T | 0.480 | 0.406 | 0.577 | 0.621 | 0.336 | 0.269 | 0.394 | 0.481 | |
| ShrinkE | 0.482 | 0.416 | 0.503 | 0.593 | 0.335 | 0.268 | 0.397 | 0.480 | |
| HEAT | 0.507 | 0.332 | 0.493 | 0.629 | 0.343 | 0.208 | |||
| sHINGE | 0.459 | 0.382 | 0.476 | 0.542 | 0.326 | 0.252 | 0.374 | 0.458 | |
| IRE | 0.403 | 0.513 | |||||||
| L-EQs | 0.597 | 0.488 | 0.651 | 0.724 | 0.406 | 0.304 | 0.439 | 0.544 | |
| Top-5排名 | HEAT | IRE | L-EQs(M) | L-EQs |
|---|---|---|---|---|
| 1 | Brentford | BUFC | MTFC | |
| 2 | Flamengo | ASMFC | Didier Six | Man Utd |
| 3 | ASMFC | R.Zaragoza | ||
| 4 | Man Utd | 3.Liga | Barcelona | |
| 5 | S.C.I | Barcelona | TBJ | WBAFC |
Tab. 3 Case study of HKGC
| Top-5排名 | HEAT | IRE | L-EQs(M) | L-EQs |
|---|---|---|---|---|
| 1 | Brentford | BUFC | MTFC | |
| 2 | Flamengo | ASMFC | Didier Six | Man Utd |
| 3 | ASMFC | R.Zaragoza | ||
| 4 | Man Utd | 3.Liga | Barcelona | |
| 5 | S.C.I | Barcelona | TBJ | WBAFC |
| [1] | Cao J, Fang J, Meng Z, et al. Knowledge graph embedding: a survey from the perspective of representation spaces [J]. ACM Computing Surveys, 2024, 56(6): No.159. |
| [2] | Liang K, Meng L, Liu M, et al. A survey of knowledge graph reasoning on graph types: static, dynamic, and multi-modal [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46(12): 9456-9478. |
| [3] | 丁瑞卿,赵俊峰,王乐业.综合实体语义和本体信息的多源中文医疗知识图谱实体对齐[J].软件学报, 2025, 36(11): 5178-5196. |
| Ding Ruiqing, Zhao Junfeng, Wang Leye. Multi-source Chinese medical knowledge graph entity alignment via entity semantics and ontology information [J]. Journal of Software, 2025, 36(11): 5178-5196. | |
| [4] | Vidal M E, Chudasama Y, Huang H, et al. Integrating knowledge graphs with symbolic AI: the path to interpretable hybrid AI systems in medicine [J]. Journal of Web Semantics, 2025, 84: No.100856. |
| [5] | 杜雪盈,刘名威,沈立炜,等.面向链接预测的知识图谱表示学习方法研究综述[J].软件学报, 2024, 35(1): 87-117. |
| Du Xueying, Liu Mingwei, Shen Liwei, et al. Research on knowledge graph representation learning methods for link prediction: a review [J]. Journal of Software, 2024, 35(1): 87-117. | |
| [6] | Shomer H, Jin W, Li J, et al. Learning representations for hyper-relational knowledge graphs [C]// ASONAM 2023. New York: ACM, 2023: 253-257. |
| [7] | Cao Z, Xu Q, Yang Z, et al. GAHE: geometry-aware embedding for hyper-relational knowledge graph representation [J]. ACM Transactions on Multimedia Computing, Communications and Applications, 2025, 21(7): No.205. |
| [8] | Fatemi B, Taslakian P, Vazquez D, et al. Knowledge hypergraphs: prediction beyond binary relations [C]// IJCAI 2021. California: ijcai.org, 2021: 2191-2197. |
| [9] | Guan S, Jian X, Guo J, et al. Link prediction on n-ary relational data based on relatedness evaluation [J]. IEEE Transactions on Knowledge and Data Engineering, 2023, 35(1): 672-685. |
| [10] | Wang C, Wang X, Li Z, et al. HyConvE: a novel embedding model for knowledge hypergraph link prediction with convolutional neural networks [C]// WWW 2023. New York: ACM, 2023: 188-198. |
| [11] | Li Z, Wang X, Zhao J, et al. HyCubE: efficient knowledge hypergraph 3D circular convolutional embedding [J]. IEEE Transactions on Knowledge and Data Engineering, 2025, 37(4): 1902-1914. |
| [12] | Galkin M, Trivedi P, Maheshwari G, et al. Message passing for hyper-relational knowledge graphs [C]// EMNLP 2020. Stroudsburg: ACL, 2020: 7346-7359. |
| [13] | Yu D, Yang Y. Improving hyper-relational knowledge graph completion [PP/OL]. arXiv (2021-04-16) [2025-04-12]. . |
| [14] | Xiong B, Nayyeri M, Pan S, et al. Shrinking embeddings for hyper-relational knowledge graphs [C]// ACL 2023. Stroudsburg: ACL, 2023: 13306-13320. |
| [15] | Ma T, Huang L, Xue H. Improving hyper-relational knowledge graph representation with multi-grained encoding [C]// DASFAA 2023. Cham: Springer, 2023: 758-767. |
| [16] | Lu Y, Yang D, Wang P, et al. Schema-aware hyper-relational knowledge graph embeddings for link prediction [J]. IEEE Transactions on Knowledge and Data Engineering, 2024, 36(6): 2614-2628. |
| [17] | Han Q, Li J, Lu D, et al. Independent embedding-based relational enhancement model for hyper-relational knowledge graph [C]// DASFAA 2024. Singapore: Springer, 2024: 496-506. |
| [18] | Luo H, E H, Yang Y, et al. Text2NKG: fine-grained n-ary relation extraction for n-ary relational knowledge graph construction [C]// NeurIPS 2024. Red Hook: Curran Associates Inc., 2024: 27417-27439. |
| [19] | Hu Z, Gutiérrez-Basulto V, Xiang Z, et al. HyperFormer: enhancing entity and relation interaction for hyper-relational knowledge graph completion [C]// CIKM 2023. New York: ACM, 2023: 803-812. |
| [20] | Liu X, Mao T, Shi Y, et al. Overview of knowledge reasoning for knowledge graph [J]. Neurocomputing, 2024, 585: No.127571. |
| [21] | Yin G, Zhang H, Yang Y, et al. Inductive link prediction on n-ary relational facts via semantic hypergraph reasoning [C]// KDD 2025.1. New York: ACM, 2025: 1821-1832. |
| [22] | Li J, Luo X, Lu G, et al. Hyper-relational knowledge representation learning with multi-hypergraph disentanglement [C]// WWW 2025. New York: ACM, 2025: 3288-3299. |
| [23] | Ren X, Tang J, Yin D, et al. A survey of large language models for graphs [C]// KDD 2024. New York: ACM, 2024: 6616-6626. |
| [24] | Liu B, Fang Y, Xu N, et al. Large language models for knowledge graph embedding techniques, methods, and challenges: a survey [J]. Mathematics, 2025, 13(14): No.2244. |
| [25] | Agrawal G, Pal K, Deng Y, et al. CyberQ: generating questions and answers for cybersecurity education using knowledge graph-augmented LLMs [C]// AAAI 2024. Palo Alto: AAAI Press, 2024: 23164-23172. |
| [26] | Sun L, Tao Z, Li Y, et al. ODA: observation-driven agent for integrating LLMs and knowledge graphs [C]// ACL 2024. Stroudsburg: ACL, 2024: 7417-7431. |
| [27] | Liu B, Zhang J, Lin F, et al. Filter-then-generate: large language models with structure-text adapter for knowledge graph completion [C]// COLING 2025. Stroudsburg: ACL, 2025: 11181-11195. |
| [28] | Tan X, Wang X, Liu Q, et al. Paths-over-graph: knowledge graph empowered large language model reasoning [C]// WWW 2025. New York: ACM, 2025: 3505-3522. |
| [29] | Liu H, Wang S, Zhu Y, et al. Knowledge graph-enhanced large language models via path selection [C]// ACL 2024. Stroudsburg: ACL, 2024: 6311-6321. |
| [30] | Shu X, Dang X, Dong X, et al. Utilizing large language models for hyper knowledge graph construction in mine hoist fault analysis [J]. Symmetry, 2024, 16(12): No.1600. |
| [31] | Dang X, Shu X, Li F, et al. Research on predicting super-relational data links for mine hoists within hyper-relational knowledge graphs [J]. Information, 2025, 16(1): No.3. |
| [32] | Panda P, Agarwal A, Devaguptapu C, et al. HOLMES: hyper-relational knowledge graphs for multi-hop question answering using LLMs [C]// ACL 2024. Stroudsburg: ACL, 2024: 13263-13282. |
| [33] | Cui H, Wang N, Han Q, et al. A two-stage parallel method on GPU based on hybrid-compression-format for diagonal matrix [J]. Concurrency and Computation: Practice and Experience, 2024, 36(1): No.e7887. |
| [34] | Cui H, Wang N, Wang Y, et al. An effective SPMV based on block strategy and hybrid compression on GPU [J]. The Journal of Supercomputing, 2022, 78(5): 6318-6339. |
| [35] | Vrandečić D, Krötzsch M. Wikidata: a free collaborative knowledgebase [J]. Communications of the ACM, 2014, 57(10): 78-85. |
| [36] | Sun Z, Deng Z H, Nie J Y, et al. RotatE: knowledge graph embedding by relational rotation in complex space [PP/OL]. arXiv (2019-02-26) [2025-04-12]. . |
| [37] | Team Llama. The Llama 3 herd of models [PP/OL]. V3. arXiv (2024-11-23) [2025-04-12]. . |
| [38] | DeepSeek-AI. DeepSeek-R1: incentivizing reasoning capability in LLMs via reinforcement learning [PP/OL]. arXiv (2025-01-22) [2025-04-12]. . |
| [39] | Bai J, Bai S, Chu Y, et al. Qwen technical report [PP/OL]. arXiv (2023-09-28) [2025-04-12]. . |
| [40] | Team MiniCPM. MiniCPM4: ultra-efficient LLMs on end devices [PP/OL]. arXiv (2025-06-09) [2025-04-12]. . |
| [41] | Sheng L, Zhang A, Zhang Y, et al. Language representations can be what recommenders need: findings and potentials [PP/OL]. V4. arXiv (2025-04-21) [2025-04-12]. . |
| [42] | Touvron H, Martin L, Stone K, et al. Llama 2: open foundation and fine-tuned chat models [PP/OL]. V2. arXiv (2023-07-19) [2025-04-12]. . |
| [1] | Longyu XIONG, Shengdong DU, Haochen SHI, Jie HU, Yan YANG, Tianrui LI. Government affairs hotline question answering system based on knowledge-enhanced large language model architecture [J]. Journal of Computer Applications, 2026, 46(6): 1721-1727. |
| [2] | Jintao WANG, Zhilin GAO, Qixiang MENG, Fanliang BU. Legal case retrieval method via case information reformulation using large language model [J]. Journal of Computer Applications, 2026, 46(6): 1785-1792. |
| [3] | Yusheng YI, Zhaohao HUANG, Zihao DENG, Leilei KONG, Haoliang QI. CORER: collaborative multi-knowledge large language model prompt framework for IT application innovation database migration [J]. Journal of Computer Applications, 2026, 46(6): 1811-1817. |
| [4] | Taixin CAI, Fengfeng WEI. Large language model-enhanced ant colony optimization for multi-solution traveling salesman problems [J]. Journal of Computer Applications, 2026, 46(6): 1712-1720. |
| [5] | Xing SHENG, Sunxian WENG, Kuosong CHEN, Zhongping WANG, Ruifeng REN, Yong LIU. Deep learning-based patent value evaluation for power grid enterprises [J]. Journal of Computer Applications, 2026, 46(5): 1468-1474. |
| [6] | Qianfei WANG, Yang LI, Deyu LI, Suge WANG. Dual-channel feature fusion representation method for short-text clustering based on large language model [J]. Journal of Computer Applications, 2026, 46(5): 1441-1449. |
| [7] | Jiali ZHENG, Gang ZHOU, Jing CHEN, Shunhang LI. Adaptive multi-feature fusion detection method for AI-generated text [J]. Journal of Computer Applications, 2026, 46(5): 1433-1440. |
| [8] | Xiaoyu WANG, Xin LI, Di XUE, Zhangtao JIANG, Wei WANG, Yanjun XIAO. Vulnerability classification framework for video surveillance network security based on large language models [J]. Journal of Computer Applications, 2026, 46(4): 1158-1170. |
| [9] | Kaizhou SHI, Xuan HE, Guoyi HOU, Gen LI, Shuanggao LI, Xiang HUANG. Airborne product metrological traceability knowledge graph construction method based on large language models [J]. Journal of Computer Applications, 2026, 46(4): 1086-1095. |
| [10] | Haoyang ZHANG, Liping ZHANG, Sheng YAN, Na LI, Xuefei ZHANG. Review of large language model methods for knowledge graph completion [J]. Journal of Computer Applications, 2026, 46(3): 683-695. |
| [11] | Bin SHEN, Xiaoning CHEN, Hua CHENG, Yiquan FANG, Huifeng WANG. Intelligent undergraduate teaching evaluation system based on large language models [J]. Journal of Computer Applications, 2026, 46(3): 993-1003. |
| [12] | Enkang XI, Jing FAN, Yadong JIN, Hua DONG, Hao YU, Yihang SUN. Review of threats faced by federated learning in privacy and security field [J]. Journal of Computer Applications, 2026, 46(3): 798-808. |
| [13] | Yiming HUANG, Xihua ZOU, Guo DENG, Di ZHENG. Pre-answering and retrieval filtering: dual-stage optimization method for RAG-based question-answering systems [J]. Journal of Computer Applications, 2026, 46(3): 696-707. |
| [14] | Dingjia WU, Zhe CUI. MG-SQL: SQL generation framework with enhanced schema linking and multi-generator collaboration [J]. Journal of Computer Applications, 2026, 46(3): 723-731. |
| [15] | Rilong WANG, Zhenping LI, Xiaosong LI, Qiang GAO, Ya HE, Yong ZHONG, Yingxiao ZHAO. Multi-Agent collaborative knowledge reasoning framework [J]. Journal of Computer Applications, 2026, 46(3): 708-714. |
| Viewed | ||||||
|
Full text |
|
|||||
|
Abstract |
|
|||||