Cloud-edge collaborative data storage and retrieval architecture for industrial scenarios

doi:10.11772/j.issn.1001-9081.2024070993

Journal of Computer Applications ›› 2025, Vol. 45 ›› Issue (9): 2902-2912.DOI: 10.11772/j.issn.1001-9081.2024070993

• Advanced computing • Previous Articles

Cloud-edge collaborative data storage and retrieval architecture for industrial scenarios

Xuecheng QIN, Chunyan LIU(), Bao LI, Yunlong ZHAO

College of Computer Science and Technology，Nanjing University of Aeronautics and Astronautics，Nanjing Jiangsu 211106，China

Received:2024-07-17 Revised:2024-09-08 Accepted:2024-09-25 Online:2024-11-19 Published:2025-09-10
Contact: Chunyan LIU
About author:QIN Xuecheng， born in 1998， M. S. candidate. His research interests include distributed graph data storage and retrieval.
LI Bao， born in 1988， Ph. D. candidate. Her research interests include master data management.
ZHAO Yunlong， born in 1975， Ph. D.， professor. His research interests include swarm intelligence， ubiquitous computing， intelligent manufacturing.
Supported by:
National Science and Technology Major Project of New Generation Artificial Intelligence(2022ZD0115403)

面向工业场景的云边协同数据存储与检索架构

秦学程, 刘春颜(), 李宝, 赵蕴龙

南京航空航天大学计算机科学与技术学院，南京 211106

通讯作者: 刘春颜
作者简介:秦学程（1998—），男，江苏盐城人，硕士研究生，主要研究方向：分布式图数据存储与检索
李宝（1988—），女，山东淄博人，博士研究生，主要研究方向：主数据管理
赵蕴龙（1975—），男，黑龙江哈尔滨人，教授，博士，主要研究方向：群体智能、普适计算、智能制造。
基金资助:
新一代人工智能国家科技重大专项(2022ZD0115403)

Abstract

Abstract:

Facing the scenarios of distributed storage and cross-domain circulation of data in various business domains in industrial scenarios， a cloud-edge collaborative data storage and retrieval architecture was proposed to address the problems of multiple and complex business systems， huge amounts of data， and the inability of some data to be uploaded to the cloud， aiming to achieve unified storage and efficient cross-domain circulation of large-scale data. In this architecture， a data encoding rule based on the RDF （Resource Description Framework） graph model and a multi-level efficient data storage strategy based on S-tree （Signature-tree） were designed to ensure that data that cannot be uploaded to the cloud are stored in the edge server， and data that can be uploaded to the cloud are stored in the cloud server. Besides， a cloud-edge collaborative storage-oriented index tree efficient collaborative retrieval method based on cloud-edge collaborative retrieval CECI-tree （Cloud-Edge Collaboration Index-tree） was proposed to improve efficiency of data retrieval effectively through the cloud-edge collaborative indexing mechanism. Experimental results of comparing the proposed architecture with methods such as RDF-3X and GRIN show that the proposed architecture performs better in terms of running efficiency and CPU utilization.

Key words: distributed storage, Resource Description Framework (RDF), cloud-edge collaboration, collaborative storage, collaborative retrieval

摘要：

面向工业场景各业务域中数据分布式存储和跨域流转的场景，针对业务系统多而复杂、数据量庞大且部分数据不可上云的问题，提出云边协同的数据存储与检索架构，旨在实现大规模数据的统一存储和跨域高效流转。该架构中，设计基于资源描述框架（RDF）图模型的数据编码规则和基于S-tree（Signature-tree）的数据多层级高效存储策略，从而保证不可上云数据存储在边缘侧服务器上，而可上云数据存储在云服务器上。此外，提出面向云边协同存储的基于云边协同索引树（CECI-tree）的高效协同检索方法，通过云边协同索引机制提高数据检索的效率。所提架构与RDF-3X和GRIN等方法进行比的实验结果表明，该架构的运行效率和CPU利用率表现更优。

关键词: 分布式存储, 资源描述框架, 云边协同, 协同存储, 协同检索

CLC Number:

TP311.133.1

Xuecheng QIN, Chunyan LIU, Bao LI, Yunlong ZHAO. Cloud-edge collaborative data storage and retrieval architecture for industrial scenarios[J]. Journal of Computer Applications, 2025, 45(9): 2902-2912.

秦学程, 刘春颜, 李宝, 赵蕴龙. 面向工业场景的云边协同数据存储与检索架构[J]. 《计算机应用》唯一官方网站, 2025, 45(9): 2902-2912.

Figures/Tables 19

References 38

[1]	HERMANN M， PENTEK T， OTTO B. Design principles for industry 4.0 scenarios ［C］// Proceedings of the 49th Hawaii International Conference on System Sciences. Piscataway： IEEE， 2016： 3928-3937.
[2]	WU X， ZHU X， WU G Q， et al. Data mining with big data ［J］. IEEE Transactions on Knowledge and Data Engineering， 2014， 26（1）： 97-107.
[3]	施巍松，孙辉，曹杰，等.边缘计算：万物互联时代新型计算模型［J］.计算机研究与发展， 2017， 54（5）： 907-924.
	SHI W S， SUN H， CAO J， et al. Edge computing： an emerging computing model for the Internet of everything era ［J］. Journal of Computer Research and Development， 2017， 54（5）： 907-924.
[4]	LI J， HUANG L， ZHOU Y， et al. Computation partitioning for mobile cloud computing in a big data environment ［J］. IEEE Transactions on Industrial Informatics， 2017， 13（4）： 2009-2018.
[5]	Apache software foundation. Apache Hadoop ［EB/OL］. ［2024-10-06］. .
[6]	SHAO B， WANG H， LI Y. Trinity： a distributed graph engine on a memory cloud ［C］// Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data. New York： ACM， 2013： 505-516.
[7]	ROHLOFF K， SCHANTZ R E. High-performance， massively scalable distributed systems using the MapReduce software framework： the SHARD triple-store ［C］// Proceedings of the 2010 SPLASH Workshop on Programming Support Innovations for Emerging Distributed Applications. New York： ACM， 2010： No.4.
[8]	HUSAIN M， McGLOTHLIN J， MASUD M M， et al. Heuristics-based query processing for large RDF graphs using cloud computing ［J］. IEEE Transactions on Knowledge and Data Engineering， 2011， 23（9）： 1312-1327.
[9]	ZHANG X， CHEN L， WANG M. Towards efficient join processing over large RDF graph using MapReduce ［C］// Proceedings of the 2012 International Conference on Scientific and Statistical Database Management， LNCS 7338. Berlin： Springer， 2012： 250-259.
[10]	ZHANG X， CHEN L， TONG Y， et al. EAGRE： towards scalable I/O efficient SPARQL query evaluation on the cloud ［C］// Proceedings of the IEEE 29th International Conference on Data Engineering. Piscataway： IEEE， 2013： 565-576.
[11]	HUANG J， ABADI D J， REN K. Scalable SPARQL querying of large RDF graphs ［J］. Proceedings of the VLDB Endowment， 2011， 4（11）： 1123-1134.
[12]	HOSE K， SCHENKEL R. WARP： workload-aware replication and partitioning for RDF ［C］// Proceedings of the IEEE 29th International Conference on Data Engineering Workshops. Piscataway： IEEE， 2013： 1-6.
[13]	MACAK M， STOVCIK M， BUHNOVA B. The suitability of graph databases for big data analysis： a benchmark ［C］// Proceedings of the 5th International Conference on Internet of Things， Big Data and Security — Volume 1： IoTBDS. Setúbal： SciTePress， 2020： 213-220.
[14]	W3C. RDF 1.1 concepts and abstract syntax ［EB/OL］. ［2024-06-06］. .
[15]	Neo4j， Inc. Neo4j graph database and analytics ［EB/OL］. ［2024-05-11］. .
[16]	HARRIS S， GIBBINS N. 3store： efficient bulk RDF storage ［C］// Proceedings of the 1st International Workshop on Practical and Scalable Semantic Systems. Aachen： CEUR-WS.org， 2003： 1-15.
[17]	PAN Z， HEFLIN J. DLDB： extending relational databases to support semantic Web queries ［C］// Proceedings of the 1st International Workshop on Practical and Scalable Semantic Systems. Aachen： CEUR-WS.org， 2003： 1-5.
[18]	WILKINSON K. Jena property table implementation ［R/OL］. ［2024-06-06］. .
[19]	ABADI D J， MARCUS A， MADDEN S R. Scalable semantic Web data management using vertical partitioning ［C］// Proceedings of the 33rd International Conference on Very Large Data Bases. ［S.l.］： VLDB Endowment， 2007： 411-422.
[20]	ABADI D J， MARCUS A， MADDEN S R， et al. SW-Store： a vertically partitioned DBMS for semantic Web data management ［J］. The VLDB Journal， 2009， 18（2）： 385-406.
[21]	NEUMANN T， WEIKUM G. RDF-3X： a RISC-style engine for RDF ［J］. Proceedings of the VLDB Endowment， 2008， 1（1）： 647-659.
[22]	WEISS C， KARRAS P， BERNSTEIN A. Hexastore： sextuple indexing for semantic Web data management ［J］. Proceedings of the VLDB Endowment， 2008， 1（1）： 1008-1019.
[23]	BORNEA M A， DOLBY J， KEMENTSIETSIDIS A， et al. Building an efficient RDF store over a relational database ［C］// Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data. New York： ACM， 2013： 121-132.
[24]	SUN W， FOKOUE A， SRINIVAS K， et al. SQLGraph： an efficient relational-based property graph store ［C］// Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data. New York： ACM， 2015： 1887-1901.
[25]	LI F， OOI B C， ÖZSU M T， et al. Distributed data management using MapReduce ［J］. ACM Computing Surveys， 2014， 46（3）： No.31.
[26]	KARYPIS G， KUMAR V. Analysis of multilevel graph partitioning ［C］// Proceedings of the 1995 ACM/IEEE Conference on Supercomputing. New York： ACM， 1995： No.29-es.
[27]	KHADILKAR V， KANTARCIOGLU M， THURAISINGHAM B， et al. Jena-HBase： a distributed， scalable and efficient RDF triple store ［C］// Proceedings of the ISWC 2012 Posters and Demonstrations Track. Aachen： CEUR-WS.org， 2012： No.14.
[28]	PAPAILIOU N， TSOUMAKOS D， KONSTANTINOU I， et al. H2RDF+ an efficient data management system for big RDF graphs ［C］// Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data. New York： ACM， 2014： 909-912.
[29]	QUILITZ B， LESER U. Querying distributed RDF data sources with SPARQL ［C］// Proceedings of the 2008 European Semantic Web Conference， LNCS 5021. Berlin： Springer， 2008： 524-538.
[30]	ZENG K， YANG J， WANG H， et al. A distributed graph engine for Web scale RDF data ［J］. Proceedings of the VLDB Endowment， 2013， 6（4）： 265-276.
[31]	LEE K， LIU L. Scaling queries over big RDF graphs with semantic hash partitioning ［J］. Proceedings of the VLDB Endowment， 2013， 6（14）： 1894-1905.
[32]	LEE K， LIU L， TANG Y， et al. Efficient and customizable data partitioning framework for distributed big RDF data processing in the cloud ［C］// Proceedings of the IEEE 6th International Conference on Cloud Computing. Piscataway： IEEE， 2013： 327-334.
[33]	GURAJADA S， SEUFERT S， MILIARAKI I， et al. TriAD： a distributed shared-nothing RDF engine based on asynchronous message passing ［C］// Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data. New York： ACM， 2014： 289-300.
[34]	W 3C. SPARQL 1.1 query language ［EB/OL］. ［2024-06-15］. .
[35]	CORMEN T H， LEISERSON C E， RIVEST R L， et al. Introduction to algorithms ［M］. 4th ed. Cambridge， MA： MIT Press， 2022.
[36]	DEPPISCH U. S-tree： a dynamic balanced signature index for office retrieval ［C］// Proceedings of the 9th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York： ACM， 1986： 77-87.
[37]	PENG P， ZOU L， GUAN R. Accelerating partial evaluation in distributed SPARQL query evaluation ［C］// Proceedings of the IEEE 35th International Conference on Data Engineering. Piscataway： IEEE， 2019： 112-123.
[38]	GUO Y， PAN Z， HEFLIN J. LUBM： a benchmark for OWL knowledge base systems ［J］. Journal of Web Semantics， 2005， 3（2/3）： 158-182.

主语（S）	谓语（P）	宾语（O）
engine	fittings	oil pump
	fittings	crankshaft
	fittings	cylinder
	emission standard	Euro6
	fuel type	gasoline
	displacement	2.0 T
	maximum power	100 W
crankshaft	weight	22 kg
	surface treatment	polishing
	durability	30 000 h
	fittings	Crankshaft bearing

主语（S）	谓语（P）	宾语（O）
engine	fittings	oil pump
	fittings	crankshaft
	fittings	cylinder
	emission standard	Euro6
	fuel type	gasoline
	displacement	2.0 T
	maximum power	100 W
crankshaft	weight	22 kg
	surface treatment	polishing
	durability	30 000 h
	fittings	Crankshaft bearing

主语（S）	谓语（P）	宾语（O）
engine	fittings	oil pump
	fittings	crankshaft
	fittings	cylinder
	emission standard	Euro6
	fuel type	gasoline
	displacement	2.0 T
	maximum power	100 W
crankshaft	weight	22 kg
	surface treatment	polishing
	durability	30 000 h
	fittings	Crankshaft bearing

主语（S）	谓语（P）	宾语（O）
engine	fittings	oil pump
	fittings	crankshaft
	fittings	cylinder
	emission standard	Euro6
	fuel type	gasoline
	displacement	2.0 T
	maximum power	100 W
crankshaft	weight	22 kg
	surface treatment	polishing
	durability	30 000 h
	fittings	Crankshaft bearing

v_u.eEncode	e_i.eEncode	v_i.tEncode
0000 0000 0111 0000	0010 0010 1000	0010 0000 1100 0000
	0010 0010 1000	0100 0000 0011 0000
	0010 0010 1000	0001 0000 0101 0000
	1001 0000 1000	0100 0101 0000 0000
	0010 1000 0100	0010 0100 0010 0000
	0001 1000 0100	0100 1000 0101 0010
	0010 0100 0001	0010 1000 0100 0000

Cloud-edge collaborative data storage and retrieval architecture for industrial scenarios

面向工业场景的云边协同数据存储与检索架构

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 19

References 38

Related Articles 15

Recommended Articles

Metrics

[1]	Jiantao JIANG, Baoyan SONG, Xiaohuan SHAN. Diversity semantic query on resource description framework graphs based on multi-level neighborhood predicate label tree encoding index [J]. Journal of Computer Applications, 2025, 45(8): 2464-2469.
[2]	Chenwei LIN, Ping CHEN. Evaluation of cross-domain attacks in cloud-edge collaborative industrial control systems [J]. Journal of Computer Applications, 2025, 45(5): 1548-1555.
[3]	Shangjing LIN, Ji MA, Bei ZHUANG, Yueying LI, Ziyi LI, Tie LI, Jin TIAN. Wireless traffic prediction based on federated learning [J]. Journal of Computer Applications, 2023, 43(6): 1900-1909.
[4]	Sheng YE, Jing WANG, Jianfeng XIN, Guiling WANG, Chenhong GUO. Dynamic evolution method for microservice composition systems in cloud-edge environment [J]. Journal of Computer Applications, 2023, 43(6): 1696-1704.
[5]	Li YANG, Jianting CHEN, Yang XIANG. Performance optimization strategy of distributed storage for industrial time series big data based on HBase [J]. Journal of Computer Applications, 2023, 43(3): 759-766.
[6]	Yunbo LONG, Dan TANG. Load balancing method based on local repair code in distributed storage [J]. Journal of Computer Applications, 2023, 43(3): 767-775.
[7]	Na ZHOU, Ming CHENG, Menglin JIA, Yang YANG. Medical image privacy protection based on thumbnail encryption and distributed storage [J]. Journal of Computer Applications, 2023, 43(10): 3149-3155.
[8]	Pengxin TIAN, Guannan SI, Zhaoliang AN, Jianxin LI, Fengyu ZHOU. Survey of data-driven intelligent cloud-edge collaboration [J]. Journal of Computer Applications, 2023, 43(10): 3162-3169.
[9]	Jun FENG, Bingfa WANG, Jiamin LU. Query performance evaluation of distributed resource description framework data management systems [J]. Journal of Computer Applications, 2022, 42(2): 440-448.
[10]	QING Xinyi, CHEN Yuling, ZHOU Zhengqiang, TU Yuanchao, LI Tao. Blockchain storage expansion model based on Chinese remainder theorem [J]. Journal of Computer Applications, 2021, 41(7): 1977-1982.
[11]	WANG Yijie, FAN Jiafei, WANG Chenyu. Two-stage task offloading strategy based on game theory in cloud-edge environment [J]. Journal of Computer Applications, 2021, 41(5): 1392-1398.
[12]	YANG Cheng, LU Jiamin, FENG Jun. Survey of large-scale resource description framework data partitioning methods in distributed environment [J]. Journal of Computer Applications, 2020, 40(11): 3184-3191.
[13]	ZHANG Hang, LIU Shanzheng, TANG Dan, CAI Hongliang. Erasure code with low recovery-overhead in distributed storage systems [J]. Journal of Computer Applications, 2020, 40(10): 2942-2950.
[14]	ZHANG Guochao, WANG Ruijin. Blockchain shard storage model based on threshold secret sharing [J]. Journal of Computer Applications, 2019, 39(9): 2617-2622.
[15]	GUAN Haoyuan, ZHU Bin, LI Guanyu, CAI Yongjia. Efficient subgraph matching method based on resource description framework graph segmentation and vertex selectivity [J]. Journal of Computer Applications, 2019, 39(2): 360-369.