Two-phase resource allocation technology for network slices in smart grid

doi:10.11772/j.issn.1001-9081.2020081343

Journal of Computer Applications ›› 2021, Vol. 41 ›› Issue (7): 2033-2038.DOI: 10.11772/j.issn.1001-9081.2020081343

Special Issue: 网络与通信

• Network and communications • Previous Articles Next Articles

Two-phase resource allocation technology for network slices in smart grid

SHANG Fangjian¹, LI Xin¹, Di ZHAI², LU Yang², ZHANG Donglei², QIAN Yuwen³

1. Information and Communication Branch Company, State Grid Jibei Electric Power Company Limited, Beijing 100044, China;
2. Global Energy Interconnection Research Institute, Beijing 102209, China;
3. School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing Jiangsu 210094, China

Received:2020-09-04 Revised:2020-12-11 Online:2021-07-10 Published:2021-01-11
Supported by:
This work is partially supported by Science and Technology Project of State Grid Jibei Electric Power Company Limited (SGJBXT00YJJS1900030).

智能电网中两阶段网络切片资源分配技术

尚芳剑¹, 李信¹, 翟迪², 陆阳², 张东磊², 钱玉文³

1. 国网冀北电力有限公司信息通信分公司, 北京 100044;
2. 全球能源互联网研究院有限公司, 北京 102209;
3. 南京理工大学电子工程与光电技术学院, 南京 210094

通讯作者: 钱玉文
作者简介:尚芳剑(1990-),女,河北保定人,工程师,硕士,主要研究方向:电力线通信、物联网;李信(1985-),女,河北廊坊人,高级工程师,博士,主要研究方向:电力线通信、物联网;翟迪(1989-),男,河南郑州人,工程师,博士,主要研究方向:物联网、无线室内定位、高精度时频同步;陆阳(1984-),男,江西南昌人,高级工程师,博士,主要研究方向:电力线通信、传感技术;张东磊(1986-),男,浙江宁波人,高级工程师,博士,主要研究方向:电力线通信、传感技术;钱玉文(1975-),男,江苏南京人,副教授,博士,主要研究方向:智能电网、5G通信、网络隐蔽通信。
基金资助:
国网冀北电力有限公司科技项目（SGJBXT00YJJS1900030）。

Abstract

Abstract: To satisfy the diverse demands of network slicing in smart grid, a slicing resource allocation model based on cloud-edge collaboration in smart grid was proposed. Furthermore, a two-phase cooperative slice allocation model was developed to optimize the allocation of the network slices. In the first phase, an optimization model for the resource allocation in local edge network was established to optimize the user experience, and the optimization problem was solved with the Lagrange multiplier method. In the second phase, the system was modeled as a Markov decision process, and then the deep reinforcement learning was adopted to adaptively allocate the resources to the slices of the core cloud. Experimental results show that the proposed two-phrase slice resource allocation model can effectively reduce the network delay and improve the user satisfaction.

Key words: smart grid, 5th generation mobile network, network slice, Markov decision process, deep reinforcement learning

摘要： 为满足网络切片在智能电网中的多样化需求，提出了一个在智能电网中基于云-边协同的切片资源分配模型。为优化网络切片分配，提出一种两阶段的切片分配模型：在第一阶段中，以用户体验最优为目标，建立了本地边缘网络的资源分配问题的优化模型，并采用拉格朗日乘子法对此最优问题进行了求解；在第二阶段中，首先将网络切片资源分配系统建模成Markov决策过程，然后提出使用深度增强学习方法对核心云的切片自适应地进行资源分配。实验结果表明所提的两阶段切片资源优化分配模型可有效减少网络延迟，提高用户满意度。

关键词: 智能电网, 5G通信网络, 网络切片, 马尔可夫决策过程, 深度增强学习

CLC Number:

TN915

SHANG Fangjian, LI Xin, Di ZHAI, LU Yang, ZHANG Donglei, QIAN Yuwen. Two-phase resource allocation technology for network slices in smart grid[J]. Journal of Computer Applications, 2021, 41(7): 2033-2038.

尚芳剑, 李信, 翟迪, 陆阳, 张东磊, 钱玉文. 智能电网中两阶段网络切片资源分配技术[J]. 计算机应用, 2021, 41(7): 2033-2038.

References

[1] MAHMOOD N H,LAURIDSEN M,BERARDINELLI G,et al. Radio resource management techniques for eMBB and mMTC services in 5G dense small cell scenarios[C]//Proceedings of the IEEE 84th Vehicular Technology Conference. Piscataway:IEEE, 2016:1-5.
[2] QIAN Y,SHI L,LI J,et al. A workflow-aided internet of things paradigm with intelligent edge computing[J]. IEEE Network, 2020,34(6):92-99.
[3] VASSILARAS S,GKATZIKIS L,LIAKOPOULOS N,et al. The algorithmic aspects of network slicing[J]. IEEE Communications Magazine,2017,55(8):112-119.
[4] GIL HERRERA J,BOTERO J F. Resource allocation in NFV:a comprehensive survey[J]. IEEE Transactions on Network and Service Management,2016,13(3):518-532.
[5] SALLENT O,PÉREZ-ROMERO J,FERRUS R,et al. On radio access network slicing from a radio resource management perspective[J]. IEEE Wireless Communications,2017,24(5):166-174.
[6] LEE Y L,LOO J,CHUAH T C,et al. Dynamic network slicing for multitenant heterogeneous cloud radio access networks[J]. IEEE Transactions on Wireless Communications,2018,17(4):2146-2161.
[7] HA V N, LE L B. End-to-end network slicing in virtualized OFDMA-based cloud radio access networks[J]. IEEE Access, 2017,5:18675-18691.
[8] BERGER L T,SCHWAGER A,PAGANI P,et al. MIMO power line communications[J]. IEEE Communications Surveys and Tutorials,2015,17(1):106-124.
[9] VO P L,NGUYEN M N H,LE T A,et al. Slicing the edge:resource allocation for RAN network slicing[J]. IEEE Wireless Communications Letters,2018,7(6):970-973.
[10] JIANG M,CONDOLUCI M,MAHMOODI T. Network slicing in 5G:an auction-based model[C]//Proceeding of the 2017 IEEE International Conference on Communications. Piscataway:IEEE, 2017:1-6.
[11] 刘明月, 涂崎, 汪洋, 等. 智能电网中网络切片的资源分配算法研究[J]. 电力信息与通信技术,2020,18(8):20-29(LIU M Y,TU Q,WANG Y,et al. Research on resource allocation algorithm of network slice in smart grid[J]. Electric Power Information and Communication Technology, 2020, 18(8):20-29.)
[12] 黄敏, 王大朋, 吴明明, 等. 5G网络切片在智能电网的应用研究[J]. 中国新通信,2020,22(20):122.(HUANG M,WANG D P,WU M M,et al. Application research of 5G network slicing in smart grid[J]. China New Telecommunications, 2020, 22(20):122.)
[13] 甄岩, 余梦月, 赵海波. 电力异构无线通信网络切片方案[J]. 电信科学,2020,36(2):76-82.(ZHEN Y,YU M Y,ZHAO H B. Network slicing scheme for heterogeneous power wireless communication networks[J]. Telecommunications Science,2020, 36(2):76-82.)
[14] NARMANLIOGLU O,ZEYDAN E,ARSLAN Ş Ş. Service-aware multi-resource allocation in software-defined next generation cellular networks[J]. IEEE Access,2018,6:20348-20363.
[15] WANG G,FENG G,TAN W,et al. Resource allocation for network slices in 5G with network resource pricing[C]//Proceeding of the 2017 IEEE Global Communications Conference. Piscataway:IEEE,2017:1-6.
[16] FENG Z,QIU C,FENG Z,et al. An effective approach to 5G:wireless network virtualization[J]. IEEE Communications Magazine,2015,53(12):53-59.
[17] RAZA M R,FIORANI M,ROSTAMI A,et al. Dynamic slicing approach for multi-tenant 5G transport networks[J]. IEEE/OSA Journal of Optical and Communication Networking,2018,10(1):A77-A90.
[18] OLIVA A D L, LI X, COSTA-PÉREZ X, et al. 5GTRANSFORMER:slicing and orchestrating transport networks for industry verticals[J]. IEEE Communication Magazine,2018,56(8):78-84.
[19] QIAN Y,YAN J,GUAN H,et al. Design of hybrid wireless and power line sensor networks with dual-interface relay in IoT[J]. IEEE Internet of Things Journal,2019,6(1):239-249.
[20] QIAN Y,LI S,LI J,et al. Cache-enabled MIMO power line communications with precoding design in smart grid[J]. IEEE Transactions on Green Communications and Networking,2020,4(1):315-325.
[21] LI J,CHEN H,CHEN Y,et al. Pricing and resource allocation via game theory for a small-cell video caching system[J]. IEEE Journal on Selected Areas in Communications,2016,34(8):2115-2129.

Two-phase resource allocation technology for network slices in smart grid

智能电网中两阶段网络切片资源分配技术

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	ZHOU Shuo, QIU Runhe, TANG Minjun. Power allocation algorithm for CR-NOMA system based on tabu search and Q-learning [J]. Journal of Computer Applications, 2021, 41(7): 2026-2032.
[2]	WANG Jianping, WANG Gang, MAO Xiaobin, MA Enqi. Motion control method of two-link manipulator based on deep reinforcement learning [J]. Journal of Computer Applications, 2021, 41(6): 1799-1804.
[3]	ZHANG Lihua, WANG Xinyi, HU Fangzhou, HUANG Yang, BAI Jiayi. Data sharing model of smart grid based on double consortium blockchains [J]. Journal of Computer Applications, 2021, 41(4): 963-969.
[4]	YAO Xinghu, TAN Xiaoyang. Reward highway network based global credit assignment algorithm in multi-agent reinforcement learning [J]. Journal of Computer Applications, 2021, 41(1): 1-7.
[5]	FU Kui, LIANG Shaoqing, LI Bing. Commodity recommendation model based on improved deep Q network structure [J]. Journal of Computer Applications, 2020, 40(9): 2613-2621.
[6]	TAN Xin, LI Xiaohui, LIU Zhenxing, DING Yuemin, ZHAO Min, WANG Qi. Sampling awareness weighted round robin scheduling algorithm in power grid [J]. Journal of Computer Applications, 2019, 39(7): 2061-2064.
[7]	WANG Tiantian, YU Shuangyuan, XU Baomin. Research on proof of work mining dilemma based on policy gradient algorithm [J]. Journal of Computer Applications, 2019, 39(5): 1336-1342.
[8]	LIU Xindong, XU Shuishuai, CHEN Jianhua. Authentication scheme for smart grid communication based on elliptic curve cryptography [J]. Journal of Computer Applications, 2019, 39(3): 779-783.
[9]	LI Zhuhong, ZHAO Canming, YAN Long, ZHANG Xinming. Load balancing opportunistic routing protocol for power line communication network in smart grids [J]. Journal of Computer Applications, 2019, 39(3): 812-816.
[10]	XIA Min, SONG Wenzhu, SHI Bicheng, LIU Jia. Deep reinforcement learning method based on weighted densely connected convolutional network [J]. Journal of Computer Applications, 2018, 38(8): 2141-2147.
[11]	LONG Dan, LI Xiaohui, DING Yuemin. Multicast routing of power grid based on demand response constraints [J]. Journal of Computer Applications, 2018, 38(4): 1102-1105.
[12]	WANG Yang, WU Fan, YAO Zongqiang, LIU Jie, LI Dong. Residential electricity consumption analysis based on regularized matrix factorization [J]. Journal of Computer Applications, 2017, 37(8): 2405-2409.
[13]	LI Zhuhong, ZHAO Canming, ZHOU Fang, ZHANG Xinming. Efficient and load balanced open shortest path first protocol in electric power communication network [J]. Journal of Computer Applications, 2017, 37(7): 1873-1876.
[14]	WANG Qi, QIN Jin. Automatic hierarchical approach of MAXQ based on action space partition [J]. Journal of Computer Applications, 2017, 37(5): 1357-1362.
[15]	WU Zhenquan, LIANG Yuhui, KANG Jiawen, YU Rong, HE Zhaoshui. Secure data storage and sharing system based on consortium blockchain in smart grid [J]. Journal of Computer Applications, 2017, 37(10): 2742-2747.