Design and implementation of block transmission mechanism based on remote direct memory access

doi:10.11772/j.issn.1001-9081.2021122243

Journal of Computer Applications ›› 2023, Vol. 43 ›› Issue (2): 484-489.DOI: 10.11772/j.issn.1001-9081.2021122243

• Network and communications • Previous Articles

Design and implementation of block transmission mechanism based on remote direct memory access

Dong SUN¹^,², Biao WANG¹^,², Yun XU¹^,²()

^1.College of Computer Science and Technology，University of Science and Technology of China，Hefei Anhui 230027，China
^2.Key Laboratory of High Performance Computing of Anhui Province （University of Science and Technology of China），Hefei Anhui 230027，China

Received:2022-01-07 Revised:2022-03-28 Accepted:2022-04-13 Online:2022-06-20 Published:2023-02-10
Contact: Yun XU
About author:SUN Dong， born in 1998， M. S. candidate. His research interests include blockchain.
WANG Biao， born in 1998， M. S. candidate. His research interests include key-value store， Remote Direct Memory Access （RDMA）.
Supported by:
Program of Introducing Talents of Discipline to Universities(111 Project)

基于RDMA的区块传输机制设计与实现

孙栋¹^,², 王彪¹^,², 徐云¹^,²()

^1.中国科学技术大学计算机科学与技术学院，合肥 230027
^2.安徽省高性能计算重点实验室（中国科学技术大学），合肥 230027

通讯作者: 徐云
作者简介:孙栋（1998—），男，安徽安庆人，硕士研究生，主要研究方向：区块链
王彪（1998—），男，安徽安庆人，硕士研究生，主要研究方向：键值存储、远程直接内存访问（RDMA）；
基金资助:
国家外专局111引智计划项目(BP0719016)

Abstract

Abstract:

With the continuous development of blockchain technology， the block transmission delay has become a performance bottleneck of the scalability of the blockchain system. Remote Direct Memory Access （RDMA） technology， which supports high-bandwidth and low-delay data transmission， provides a new idea for block transmission with low latency. Therefore， a block catalogue structure for block information sharing was designed based on the characteristics of RDMA primitives， and the basic working process of block transmission was proposed and implemented on this basis. Experimental results show that compared with TCP（Transmission Control Protocol） transmission mechanism， the RDMA-based block transmission mechanism reduces the transmission delay between nodes by 44%， the transmission delay among the whole network by 24.4% on a block of 1 MB size， and the number of temporary forks appeared in blockchain by 22.6% on a blockchain of 10 000 nodes. It can be seen that the RDMA-based block transmission mechanism takes advantage of the performance of high speed networks， reduces block transmission latency and the number of temporary forks， thereby improving the scalability of the existing blockchain systems.

Key words: blockchain, Remote Direct Memory Access (RDMA), scalability, block transmission, low latency

摘要：

随着区块链技术的不断发展，区块的传输延迟成为区块链系统可扩展性的性能瓶颈。远程直接内存访问（RDMA）技术能够支持高带宽和低时延的数据传输，为低延迟区块传输提供了新的思路。因此，结合RDMA原语的特性，设计了用于区块信息共享的区块目录结构，并在此基础上设计并实现了区块传输的基本工作过程。实验结果表明，相较于基于TCP的方案，在1 MB大小的区块上基于RDMA的区块传输机制将节点间的区块传输延迟降低了44%，全网络的区块传输延迟降低了24.4%，在10 000节点规模的区块链上，区块链发生临时分叉的数量降低了22.6%。可见，基于RDMA的区块传输机制充分发挥了高速网络的性能优势，降低了区块传输延迟及临时分叉的数量，提高了现有区块链系统的可扩展性。

关键词: 区块链, 远程直接内存访问, 可扩展性, 区块传输, 低延迟

CLC Number:

TP393

Dong SUN, Biao WANG, Yun XU. Design and implementation of block transmission mechanism based on remote direct memory access[J]. Journal of Computer Applications, 2023, 43(2): 484-489.

孙栋, 王彪, 徐云. 基于RDMA的区块传输机制设计与实现[J]. 《计算机应用》唯一官方网站, 2023, 43(2): 484-489.

Figures/Tables 11

Fig. 1 Overall framework of the proposed method

Fig. 2 Basic processes of two block transmission schemes

Tab. 1 Fields stored in block catalogue

字段名	字段的意义
id	区块id
hash	区块hash值
addr	区块所在注册内存的虚拟地址
length	区块所在注册内存的大小
key	区块所在注册内存的访问钥匙
flag	此区块信息是否过期

Fig. 3 Block information sharing

Fig. 4 Updating process of block catalogue based on one-side primitives

Fig. 5 Block transmission process based on one-side primitives

Fig. 6 Comparison of time consumed by copy and register operations under different data sizes

Tab. 2 Experimental environment configuration

类型	型号
网卡	Mellanox MT27800
处理器	Intel Xeon Gold 6161
操作系统	Ubuntu18.04

Tab. 3 Comparison of transmission latency between nodes

方案	区块大小/MB
方案	0.1	0.3	0.5	1.0
RDMA方案	195	410	636	1 138
TCP方案	361	739	1 121	2 041

Tab. 4 Comparison of transmission latency among whole network in simulated environment

方案	区块大小/MB
方案	0.3	0.5	1.0
RDMA方案	77	107	146
TCP方案	98	134	193

Tab. 5 Comparison of temporary fork numbers in simulated environment

方案	网络节点数
方案	2 000	5 000	10 000
RDMA方案	75	85	96
TCP方案	94	109	124

References 17

1	NAKAMOTO S. Bitcoin： a peer-to-peer electronic cash system［EB/OL］. ［2021-11-15］.. 10.2139/ssrn.3977007
2	WOOD G. Ethereum： a secure decentralized generalized transaction ledger［EB/OL］. ［2021-11-17］..
3	EYAL I， GENCER A E， SIRER E G， et al. Bitcoin-NG： a scalable blockchain protocol［C］// Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation. Berkeley： USENIX Association， 2016： 45-59.
4	黄建华，夏旭，李忠诚，等. 基于动态授权的信任度证明机制［J］. 软件学报， 2019， 30（9）： 2593-2607. 10.13328/j.cnki.jos.005772
	HUANG J H， XIA X， LI Z C， et al. Proof of trust： mechanism of trust degree based on dynamic authorization［J］. Journal of Software， 2019， 30（9）： 2593-2607. 10.13328/j.cnki.jos.005772
5	黄嘉成，许新华，王世纯. 委托权益证明共识机制的改进方案［J］. 计算机应用， 2019， 39（7）：2162-2167. 10.11772/j.issn.1001-9081.2018122527
	HUANG J C， XU X H， WANG S C. Improved scheme of delegated proof of stake consensus mechanism［J］. Journal of Computer Applications， 2019， 39（7）： 2162- 2167. 10.11772/j.issn.1001-9081.2018122527
6	HUANG B B， JIN L， LU Z H， et al. BoR： toward high-performance permissioned blockchain in RDMA-enabled network［J］. IEEE Transactions on Services Computing， 2020， 13（2）： 301-313. 10.1109/tsc.2019.2948009
7	BONNEAU J， MILLER A， CLARK J， et al. SoK： research perspectives and challenges for Bitcoin and cryptocurrencies［C］// Proceedings of the 2015 IEEE Symposium on Security and Privacy. Piscataway： IEEE， 2015： 104-121. 10.1109/sp.2015.14
8	BECK M， KAGAN M. Performance evaluation of the RDMA over Ethernet （RoCE） standard in enterprise data centers infrastructure［C］// Proceedings of the 3rd Workshop on Data Center — Converged and Virtual Ethernet Switching. ［S.l.］： International Teletraffic Congress， 2011： 9-15. 10.1111/j.1467-9213.2008.557.x
9	DRAGOJEVIĆ A， NARAYANAN D， NIGHTINGALE E B， et al. No compromises： distributed transactions with consistency， availability， and performance［C］// Proceedings of the 25th Symposium on Operating Systems Principles. New York： ACM， 2015： 54-70. 10.1145/2815400.2815425
10	WEI X D， SHI J X， CHEN Y Z， et al. Fast in-memory transaction processing using RDMA and HTM［C］// Proceedings of the 25th Symposium on Operating Systems Principles. New York： ACM， 2015： 87-104. 10.1145/2815400.2815419
11	AL-MAMUN A， ZHAO D F. BAASH： enabling blockchain-as-a-service on high-performance computing systems［EB/OL］. （2020-01-20）［2021-11-18］.. 10.1145/3458817.3476155
12	BI W， YANG H W， ZHENG M L. An accelerated method for message propagation in blockchain networks［EB/OL］. （2018-09-03）［2021-11-19］..
13	AYINALA K， CHOI B Y， SONG S. Accelerating block propagation in PoW blockchain networks with pipelining and chunking［C］// Proceedings of the 7th Symposium on Hot Topics in the Science of Security. New York： ACM， 2020： No.16. 10.1145/3384217.3385621
14	ZHAO C H， WANG T T， ZHANG S L. LightBlock： reducing bandwidth required to synchronize blocks in Ethereum network［C］// Proceedings of the 2021 International Conference on Communications， Information System and Computer Engineering. Piscataway： IEEE， 2021： 868-874. 10.1109/cisce52179.2021.9445911
15	RÜSCH S， MESSADI I， KAPITZA R. Towards low-latency byzantine agreement protocols using RDMA［C］// Proceedings of the 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops. Piscataway： IEEE， 2018： 146-151. 10.1109/dsn-w.2018.00054
16	WANG C， JIANG J Y， CHEN X S， et al. APUS： fast and scalable Paxos on RDMA［C］// Proceedings of the 2017 Symposium on Cloud Computing. New York： ACM， 2017： 94-107. 10.1145/3127479.3128609
17	AOKI Y， OTSUKI K， KANEKO T， et al. SimBlock： a blockchain network simulator［C］// Proceedings of the 2019 IEEE Conference on Computer Communications Workshops. Piscataway： IEEE， 2019： 325-329. 10.1109/infcomw.2019.8845253

[1]	Shumin TANG, Yu JIN. Consensus mechanism of voting scheme in blockchain based on Chinese remainder theorem [J]. Journal of Computer Applications, 2023, 43(2): 458-466.
[2]	Xiaoqiong PANG, Yunting WANG, Wenjun CHEN, Pan JIANG, Yanan GAO. Fair and verifiable multi-keyword ranked search over encrypted data based on blockchain [J]. Journal of Computer Applications, 2023, 43(1): 130-139.
[3]	Jindong WANG, Qiang LI. Improved practical Byzantine fault tolerance consensus algorithm based on Raft algorithm [J]. Journal of Computer Applications, 2023, 43(1): 122-129.
[4]	Wei LIU, Cong ZHANG, Wei SHE, Xuan SONG, Zhao TIAN. Data trusted traceability method based on Merkle mountain range [J]. Journal of Computer Applications, 2022, 42(9): 2765-2771.
[5]	Yangnan GUO, Wenbao JIANG, Shuai YE. Supervisable blockchain anonymous transaction system model [J]. Journal of Computer Applications, 2022, 42(9): 2757-2764.
[6]	Hongliang TIAN, Jiayue WANG, Chenxi LI. Data storage scheme based on hybrid algorithm blockchain and node identity authentication [J]. Journal of Computer Applications, 2022, 42(8): 2481-2486.
[7]	Xu WANG, Yumin SHEN, Xiaoyun XIONG, Peng LI, Jinlong WANG. Data management method for building internet of things based on Hashgraph [J]. Journal of Computer Applications, 2022, 42(8): 2471-2480.
[8]	Jie ZHANG, Shanshan XU, Lingyun YUAN. Internet of things access control model based on blockchain and edge computing [J]. Journal of Computer Applications, 2022, 42(7): 2104-2111.
[9]	Chunming TANG, Yuqing CHEN, Zidi ZHANG. Improved consensus algorithm based on binomial swap forest and HotStuff [J]. Journal of Computer Applications, 2022, 42(7): 2112-2117.
[10]	Zheng DI, Yifan CAO, Chao QIU, Tao LUO, Xiaofei WANG. New computing power network architecture and application case analysis [J]. Journal of Computer Applications, 2022, 42(6): 1656-1661.
[11]	Yuntao XU, Junwu ZHU, Binwen SUN, Maosheng SUN, Sihai CHEN. Election-based supply chain： a supply chain autonomy framework based on blockchain [J]. Journal of Computer Applications, 2022, 42(6): 1770-1775.
[12]	Yang LI, Long XU, Yanqiang LI, Shaopeng LI. Smart contract-based access control architecture and verification for internet of things [J]. Journal of Computer Applications, 2022, 42(6): 1922-1931.
[13]	Xiuli REN, Lei ZHANG. Improved multi-primary-node consensus mechanism based on practical Byzantine fault tolerance [J]. Journal of Computer Applications, 2022, 42(5): 1500-1507.
[14]	Jiagui XIE, Zhiping LI, Jian JIN. Cross-chain mechanism based on Spark blockchain [J]. Journal of Computer Applications, 2022, 42(2): 519-527.
[15]	Jiagui XIE, Zhiping LI, Jian JIN, Bo ZHANG, Jian GUO, Fanjie NIE. New permissioned public blockchain based on main-sub chain architecture [J]. Journal of Computer Applications, 2022, 42(12): 3822-3830.

Design and implementation of block transmission mechanism based on remote direct memory access

基于RDMA的区块传输机制设计与实现

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 11

References 17

Related Articles 15

Recommended Articles

Metrics