Journal of Computer Applications ›› 2022, Vol. 42 ›› Issue (4): 1050-1056.DOI: 10.11772/j.issn.1001-9081.2021071227
• The 36 CCF National Conference of Computer Applications (CCF NCCA 2020) • Previous Articles
Shoulong JIAO(), Youxiang DUAN, Qifeng SUN, Zihao ZHUANG, Chenhao SUN
Received:
2021-07-14
Revised:
2021-08-22
Accepted:
2021-08-23
Online:
2022-04-28
Published:
2022-04-10
Contact:
Shoulong JIAO
About author:
DUAN Youxiang, born in 1964, Ph. D., professor. His research interests include network and service computing, computer technology application in field of oil and gas.Supported by:
通讯作者:
焦守龙
作者简介:
段友祥(1964—),男,山东东营人,教授,博士,CCF会员,主要研究方向:网络与服务计算、计算机技术在油气领域的应用基金资助:
CLC Number:
Shoulong JIAO, Youxiang DUAN, Qifeng SUN, Zihao ZHUANG, Chenhao SUN. Knowledge representation learning method incorporating entity description information and neighbor node features[J]. Journal of Computer Applications, 2022, 42(4): 1050-1056.
焦守龙, 段友祥, 孙歧峰, 庄子浩, 孙琛皓. 融合实体描述信息和邻居节点特征的知识表示学习方法[J]. 《计算机应用》唯一官方网站, 2022, 42(4): 1050-1056.
Add to citation manager EndNote|Ris|BibTeX
URL: http://www.joca.cn/EN/10.11772/j.issn.1001-9081.2021071227
数据集 | #Ent | #Rel | #Train | #Valid | #Text |
---|---|---|---|---|---|
FB15K-237 | 14 541 | 237 | 272 115 | 17 535 | 20 466 |
WN18RR | 40 943 | 11 | 86 835 | 3 034 | 3 134 |
Tab. 1 Experimental dataset statistics
数据集 | #Ent | #Rel | #Train | #Valid | #Text |
---|---|---|---|---|---|
FB15K-237 | 14 541 | 237 | 272 115 | 17 535 | 20 466 |
WN18RR | 40 943 | 11 | 86 835 | 3 034 | 3 134 |
模型 | 准确率 | 模型 | 准确率 | ||
---|---|---|---|---|---|
FB15K-237 | WN18RR | FB15K-237 | WN18RR | ||
TransE | 66.7 | 58.5 | DKRL | 76.3 | 77.1 |
TransH | 75.1 | 73.2 | KBGAT | 78.4 | 77.5 |
TransR | 73.3 | 74.2 | BAGAT | 82.1 | 78.6 |
TransD | 69.6 | 68.8 |
Tab. 2 Accuracy of triple classification
模型 | 准确率 | 模型 | 准确率 | ||
---|---|---|---|---|---|
FB15K-237 | WN18RR | FB15K-237 | WN18RR | ||
TransE | 66.7 | 58.5 | DKRL | 76.3 | 77.1 |
TransH | 75.1 | 73.2 | KBGAT | 78.4 | 77.5 |
TransR | 73.3 | 74.2 | BAGAT | 82.1 | 78.6 |
TransD | 69.6 | 68.8 |
模型 | MR | Hits@n/% | ||
---|---|---|---|---|
@1 | @3 | @10 | ||
TransE | 330 | 19.8 | 37.6 | 44.1 |
DKRL | 217 | 20.3 | 32.7 | 47.9 |
ConvKB | 226 | 19.8 | 32.4 | 50.1 |
ConvE | 247 | 22.5 | 34.2 | 49.6 |
R-GCN | 600 | 10.0 | 18.1 | 30.0 |
KBGAT | 210 | 43.9 | 55.6 | 62.6 |
BAGAT | 153 | 45.7 | 56.0 | 66.1 |
Tab. 3 Link prediction results on FB15K-237 dataset
模型 | MR | Hits@n/% | ||
---|---|---|---|---|
@1 | @3 | @10 | ||
TransE | 330 | 19.8 | 37.6 | 44.1 |
DKRL | 217 | 20.3 | 32.7 | 47.9 |
ConvKB | 226 | 19.8 | 32.4 | 50.1 |
ConvE | 247 | 22.5 | 34.2 | 49.6 |
R-GCN | 600 | 10.0 | 18.1 | 30.0 |
KBGAT | 210 | 43.9 | 55.6 | 62.6 |
BAGAT | 153 | 45.7 | 56.0 | 66.1 |
模型 | MR | Hits@n/% | ||
---|---|---|---|---|
@1 | @3 | @10 | ||
TransE | 2 310 | 4.25 | 44.00 | 52.90 |
DKRL | 2 197 | 10.30 | 45.30 | 54.70 |
ConvKB | 1 734 | 5.73 | 44.30 | 55.30 |
ConvE | 3 457 | 38.90 | 43.50 | 53.10 |
R-GCN | 6 679 | 8.00 | 13.50 | 20.80 |
KBGAT | 1 940 | 36.10 | 48.30 | 58.10 |
BAGAT | 1 878 | 36.40 | 48.50 | 59.30 |
Tab. 4 Link prediction results on WN18RR dataset
模型 | MR | Hits@n/% | ||
---|---|---|---|---|
@1 | @3 | @10 | ||
TransE | 2 310 | 4.25 | 44.00 | 52.90 |
DKRL | 2 197 | 10.30 | 45.30 | 54.70 |
ConvKB | 1 734 | 5.73 | 44.30 | 55.30 |
ConvE | 3 457 | 38.90 | 43.50 | 53.10 |
R-GCN | 6 679 | 8.00 | 13.50 | 20.80 |
KBGAT | 1 940 | 36.10 | 48.30 | 58.10 |
BAGAT | 1 878 | 36.40 | 48.50 | 59.30 |
1 | BENGIO Y, COURVILLE A, VINCENT P. Representation learning: a review and new perspectives[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(8): 1798-1828. 10.1109/tpami.2013.50 |
2 | 王智悦,于清,王楠,等. 基于知识图谱的智能问答研究综述[J]. 计算机工程与应用, 2020, 56(23):1-11. 10.1109/aeeca52519.2021.9574313 |
WANG Z Y, YU Q, WANG N, et al. Survey of intelligent question answering research based on knowledge graph[J]. Computer Engineering and Applications, 2020, 56(23):1-11. 10.1109/aeeca52519.2021.9574313 | |
3 | WANG Q, MAO Z D, WANG B, et al. Knowledge graph embedding: a survey of approaches and applications[J]. IEEE Transactions on Knowledge and Data Engineering, 2017, 29(12): 2724-2743. 10.1109/TKDE.2017.2754499 |
4 | BENGIO Y. Learning deep architectures for AI[J]. Foundations and Trends in Machine Learning, 2009, 2(1): 1-127. 10.1561/2200000006 |
5 | TURIAN J, RATINOV L, BENGIO Y. Word representations: a simple and general method for semi-supervised learning[C]// Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA: Association for Computational Linguistics, 2010: 384-394. |
6 | 刘知远,孙茂松,林衍凯,等. 知识表示学习研究进展[J]. 计算机研究与发展, 2016, 53(2):247-261. 10.7544/issn1000-1239.2016.20160020 |
LIU Z Y, SUN M S, LIN Y K, et al. Knowledge representation learning: a review[J]. Journal of Computer Research and Development, 2016, 53(2): 247-261. 10.7544/issn1000-1239.2016.20160020 | |
7 | 张正航,钱育蓉,行艳妮,等. 基于TransE的表示学习方法研究综述[J]. 计算机应用研究, 2021, 38(3):656-663. 10.19734/j.issn.1001-3695.2020.02.0028 |
ZHANG Z H, QIAN Y R, XING Y N, et al. Survey of representation learning methods based on TransE[J]. Application Research of Computers, 2021, 38(3): 656-663. 10.19734/j.issn.1001-3695.2020.02.0028 | |
8 | NATHANI D, CHAUHAN J, SHARMA C, et al. Learning attention-based embeddings for relation prediction in knowledge graphs[C]// Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA: Association for Computational Linguistics, 2019: 4710-4723. 10.18653/v1/p19-1466 |
9 | VELIČKOVIĆ P, CUCURULL G, CASANOVA A, et al. Graph attention networks[EB/OL] (2018-02-04) [2021-05-22].. |
10 | DEVLIN J, CHANG M W, LEE K, et al. BERT: pre-training of deep bidirectional transformers for language understanding[C]// Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Long and Short Papers). Stroudsburg, PA: Association for Computational Linguistics, 2019,1: 4171-4186. |
11 | CHANG L, ZHU M L, GU T L, et al. Knowledge graph embedding by dynamic translation[J]. IEEE Access, 2017, 5: 20898-20907. 10.1109/access.2017.2759139 |
12 | BORDES A, USUNIER N, GARCIA-DURÁN A, et al. Translating embeddings for modeling multi-relational data[C]// Proceedings of the 26th International Conference on Neural Information Processing Systems. Red Hook, NY: Curran Associates Inc., 2013: 2787-2795. 10.1007/978-3-662-44848-9_28 |
13 | WANG Z, ZHANG J W, FENG J L, et al. Knowledge graph embedding by translating on hyperplanes[C]// Proceedings of the 28th AAAI Conference on Artificial Intelligence. Palo Alto, CA: AAAI Press, 2014: 1112-1119. 10.1609/aaai.v33i01.33017152 |
14 | LIN Y K, LIU Z Y, SUN M S, et al. Learning entity and relation embeddings for knowledge graph completion[C]// Proceedings of the 29th AAAI Conference on Artificial Intelligence. Palo Alto, CA: AAAI Press, 2015: 2181-2187. 10.1609/aaai.v34i05.6281 |
15 | JI G L, HE S Z, XU L H, et al. Knowledge graph embedding via dynamic mapping matrix[C]// Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Long Papers). Stroudsburg, PA: Association for Computational Linguistics, 2015, 1:687-696. 10.3115/v1/p15-1067 |
16 | XIE R B, LIU Z Y, JIA J, et al. Representation learning of knowledge graphs with entity descriptions[C]// Proceedings of the 30th AAAI Conference on Artificial Intelligence. Palo Alto, CA: AAAI Press, 2016: 2659-2665. |
17 | DETTMERS T, MINERVINI P, STENETORP P, et al. Convolutional 2D knowledge graph embeddings[C]// Proceedings of the 32nd AAAI Conference on Artificial Intelligence. Palo Alto, CA: AAAI Press, 2018: 1811-1818. |
18 | NGUYEN D Q, NGUYEN T D, NGUYEN D Q, et al. A novel embedding model for knowledge base completion based on convolutional neural network[C]// Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, (Short Papers). Stroudsburg. PA: Association for Computational Linguistics, 2018, 2:327-333. 10.18653/v1/n18-2053 |
19 | SCHLICHTKRULL M, KIPF T N, BLOEM P, et al. Modeling relational data with graph convolutional networks[C]// Proceedings of the 2018 European Extended Semantic Web Conference, LNCS 10843. Cham: Springer, 2018: 593-607. |
20 | MIKOLOV T, SUTSKEVER I, CHEN K, et al. Distributed representations of words and phrases and their compositionality[C]// Proceedings of the 26th International Conference on Neural Information Processing Systems. Red Hook, NY: Curran Associates Inc., 2013:3111-3119. |
21 | COLLOBERT R, WESTON J, BOTTOU L, et al. Natural language processing (almost) from scratch[J]. Journal of Machine Learning Research, 2011, 12:2493-2537. |
22 | XU J M, XU B, TIAN G H, et al. Short text hashing improved by integrating multi-granularity topics and tags[C]// Proceedings of the 2015 International Conference on Intelligent Text Processing and Computational Linguistics, LNCS 9041. Cham: Springer, 2015: 444-455. |
23 | BOLLACKER K, EVANS C, PARITOSH P, et al. Freebase: a collaboratively created graph database for structuring human knowledge[C]// Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. New York: ACM, 2008: 1247-1250. 10.1145/1376616.1376746 |
24 | MILLER G A. WordNet: a lexical database for English[J]. Communications of the ACM, 1995, 38(11): 39-41. 10.1145/219717.219748 |
[1] | Zengzhen DU, Dongxin TANG, Dan XIE. Method of generating rhetorical questions based on deep neural network in intelligent consultation [J]. Journal of Computer Applications, 2022, 42(3): 867-873. |
[2] | Lu ZHANG, Jiapeng LIU, Dongmei TIAN. Application of Stacking-Bagging-Vote multi-source information fusion model for financial early warning [J]. Journal of Computer Applications, 2022, 42(1): 280-286. |
[3] | Xueqiang LYU, Chen PENG, Le ZHANG, Zhi’an DONG, Xindong YOU. Text multi-label classification method incorporating BERT and label semantic attention [J]. Journal of Computer Applications, 2022, 42(1): 57-63. |
[4] | YU Dunhui, WAN Peng, WANG She. Entity association query system based on enterprise knowledge graph construction [J]. Journal of Computer Applications, 2021, 41(9): 2510-2516. |
[5] | LIU Yaxuan, ZHONG Yong. Joint extraction method of entities and relations based on subject attention [J]. Journal of Computer Applications, 2021, 41(9): 2517-2522. |
[6] | TIAN Ling, ZHANG Jinchuan, ZHANG Jinhao, ZHOU Wangtao, ZHOU Xue. Knowledge graph survey: representation, construction, reasoning and knowledge hypergraph theory [J]. Journal of Computer Applications, 2021, 41(8): 2161-2186. |
[7] | YU Dunhui, ZHANG Luyi, ZHANG Xiaoxiao, MAO Liang. User recommendation method of cross-platform based on knowledge graph and restart random walk [J]. Journal of Computer Applications, 2021, 41(7): 1871-1877. |
[8] | LIU Huan, LI Xiaoge, HU Likun, HU Feixiong, WANG Penghua. Knowledge graph driven recommendation model of graph neural network [J]. Journal of Computer Applications, 2021, 41(7): 1865-1870. |
[9] | QIN Li, HAO Zhigang, LI Guoliang. Construction and correlation analysis of national food safety standard graph [J]. Journal of Computer Applications, 2021, 41(4): 1005-1011. |
[10] | SUN Jianqiang, XU Shaohua. Knowledge reasoning method based on differentiable neural computer and Bayesian network [J]. Journal of Computer Applications, 2021, 41(2): 337-342. |
[11] | Haitao XUE, Li WANG, Yanjie YANG, Biao LIAN. Rumor detection model based on user propagation network and message content [J]. Journal of Computer Applications, 2021, 41(12): 3540-3545. |
[12] | DONG Yongfeng, LIU Chao, WANG Liqin, LI Yingshuang. Relationship reasoning method combining multi-hop relationship path information [J]. Journal of Computer Applications, 2021, 41(10): 2799-2805. |
[13] | WU Xiaoping, ZHANG Qiang, ZHAO Fang, JIAO Lin. Entity relation extraction method for guidelines of cardiovascular disease based on bidirectional encoder representation from transformers [J]. Journal of Computer Applications, 2021, 41(1): 145-149. |
[14] | CHEN Jiawei, HAN Fang, WANG Zhijie. Aspect-based sentiment analysis with self-attention gated graph convolutional network [J]. Journal of Computer Applications, 2020, 40(8): 2202-2206. |
[15] | MA Dongxue, SONG She, XIE Zhenping, LIU Yuan. Domain ontology driven approach for bidding webpage parsing [J]. Journal of Computer Applications, 2020, 40(6): 1574-1579. |
Viewed | ||||||
Full text |
|
|||||
Abstract |
|
|||||