Online federated incremental learning algorithm for blockchain

doi:10.11772/j.issn.1001-9081.2020050609

Journal of Computer Applications ›› 2021, Vol. 41 ›› Issue (2): 363-371.DOI: 10.11772/j.issn.1001-9081.2020050609

Special Issue: 人工智能

• Artificial intelligence • Previous Articles Next Articles

Online federated incremental learning algorithm for blockchain

LUO Changyin^1,2,3, CHEN Xuebin^1,2,3, MA Chundi¹, WANG Junyu^1,2,3

1. School of Science, North China University of Science and Technology, Tangshan Hebei 063210, China;
2. Hebei Key Laboratory of Data Science and Applications(North China University of Science and Technology), Tangshan Hebei 063210, China;
3. Tangshan Data Science Laboratory(North China University of Science and Technology), Tangshan Hebei 063210, China

Received:2020-05-16 Revised:2020-07-22 Online:2021-02-10 Published:2021-02-27
Supported by:
This work is partially supported by the National Natural Science Foundation of China (61572170, 61170254), the Tangshan Science and Technology Project (18120203A).

面向区块链的在线联邦增量学习算法

罗长银^1,2,3, 陈学斌^1,2,3, 马春地¹, 王君宇^1,2,3

1. 华北理工大学理学院, 河北唐山 063210;
2. 河北省数据科学与应用重点实验室(华北理工大学), 河北唐山 063210;
3. 唐山市数据科学重点实验室(华北理工大学), 河北唐山 063210

通讯作者: 陈学斌
作者简介:罗长银(1994-),男,陕西安康人,硕士研究生,CCF会员,主要研究方向:数据安全;陈学斌(1970-),男,河北唐山人,教授,博士,CCF高级会员,主要研究方向:数据安全、物联网安全、网络安全;马春地(1999-),男,河北唐山人,主要研究方向:网络安全;王君宇(1996-),女,河北唐山人,硕士研究生,主要研究方向:网络安全。
基金资助:
国家自然科学基金资助项目（61572170，61170254）；唐山市科技项目（18120203A）。

Abstract

Abstract: As generalization ability of the out-dated traditional data processing technology is weak, and the technology did not take into account the multi-source data security issues, a blockchain oriented online federated incremental learning algorithm was proposed. Ensemble learning and incremental learning were applied to the framework of federated learning, and stacking ensemble algorithm was used to integrate the local models and the model parameters in model training phase were uploaded to the blockchain with fast synchronization. This made the accuracy of the constructed global model only fall by 1%, while the safety in the stage of training and the stage of storage was improved, so that the costs of the data storage and the transmission of model parameters were reduced, and at the same time, the risk of data leakage caused by model gradient updating was reduced. Experimental results show that the accuracy of the model is over 91.5% and the variance of the model is lower than 10^-5, and compared with the traditional integrated data training model, the model has the accuracy slightly reduced, but has the security of data and model improved with the accuracy of the model guaranteed.

Key words: blockchain, ensemble learning, federated learning, incremental learning

摘要： 针对传统数据处理技术存在模型过时、泛化能力减弱以及并未考虑多源数据安全性的问题，提出一种面向区块链的在线联邦增量学习算法。该算法将集成学习与增量学习应用到联邦学习的框架下，使用stacking集成算法来整合多方本地模型，且将模型训练阶段的模型参数上传至区块链并快速同步，使得在建立的全局模型准确率仅下降1%的情况下，模型在训练阶段与存储阶段的安全性均得到了提升，降低了数据存储与模型参数传输的成本，同时也降低了因模型梯度更新造成数据泄漏的风险。实验结果表明，在公开的数据集上进行训练，各时间段内模型的准确度均在91.5%以上，且方差均低于10^-5；与传统整合数据训练模型相比，该模型在准确率上略有下降，但能够在保证模型准确率的同时提高数据与模型的安全性。

关键词: 区块链, 集成学习, 联邦学习, 增量学习

CLC Number:

TP391

LUO Changyin, CHEN Xuebin, MA Chundi, WANG Junyu. Online federated incremental learning algorithm for blockchain[J]. Journal of Computer Applications, 2021, 41(2): 363-371.

罗长银, 陈学斌, 马春地, 王君宇. 面向区块链的在线联邦增量学习算法[J]. 计算机应用, 2021, 41(2): 363-371.

References

[1] SUN C, SHRIVASTAVA A, SINGH S, et al. Revisiting unreasonable effectiveness of data in deep learning era[EB/OL].[2019-08-04]. https://arxiv.org/pdf/1707.02968.pdf.
[2] YANG Q,LIU Y,CHEN T,et al. Federated machine learning:concept and applications[J]. ACM Transactions on Intelligent Systems and Technology,2019,10(2):No. 12.
[3] MCMAHAN H B,MOORE E,RAMAGE D,et al. Communicationefficient learning of deep networks from decentralized data[EB/OL]. (2017-02-28)[2019-12-02]. https://arxiv.org/pdf/1602.05629.pdf.
[4] KIM H,PARK J,BENNIS M,et al. On-device federated learning via blockchain and its latency analysis[EB/OL].[2019-06-01]. https://arxiv.org/pdf/1808.03949v1.pdf.
[5] LI S,CHENG Y,LIU Y,et al. Abnormal client behavior detection in federated learning[EB/OL].[2019-12-06]. https://arxiv.org/pdf/1910.09933.pdf.
[6] ZHU L,LIU Z,HAN S. Deep leakage from gradients[EB/OL].[2019-12-19]. https://arxiv.org/pdf/1906.08935.pdf.
[7] 章宁, 钟珊. 基于区块链的个人隐私保护机制[J]. 计算机应用, 2017,37(10):2787-2793.(ZHANG N,ZHONG S. Mechanism of personal privacy protection based on blockchain[J]. Journal of Computer Applications,2017,37(10):2787-2793.)
[8] 拜亚萌, 满君丰, 张宏. 基于区块链的电子健康记录安全存储模型[J]. 计算机应用,2020,40(4):961-965.(BAI Y M,MAN J F,ZHANG H. Secure storage model of electronic health records based on blockchain[J]. Journal of Computer Applications,2020, 40(4):961-965.)
[9] 李云飞, 柳青, 郝林, 等. 一种有效的RSA算法改进方案[J]. 计算机应用,2010,30(9):2393-2397.(LI Y F,LIU Q,HAO L,et al. Efficient variant of RSA cryptosystem[J]. Journal of Computer Applications,2010,30(9):2393-2397.)
[10] 娄悦, 施荣华, 曹龄兮. 基于强认证技术的会话初始协议安全认证模型[J]. 计算机应用,2006,26(10):2332-2335.(LOU Y,SHI R H,CAO L X. SIP secure authentication model based on strong authentication technology[J]. Journal of Computer Applications,2006,26(10):2332-2335.)
[11] 汪希仁, 孙战辉, 祝永霞. 一种新的封闭ECDSA签名阈下信道方案[J]. 计算机与网络,2013,39(6):71-73.(WANG X R, SUN Z H,ZHU Y X. A new subliminal-free protocol in ECDSA[J]. Computer and Network,2013,39(6):71-73.)
[12] 胡彬轩. 基于联邦学习的空气质量监测系统设计与实现[D]. 北京:北京邮电大学,2019:30-40.(HU B X. Design and implementation of air quality monitoring system based on federal learning[D]. Beijing:Beijing University of Posts and Telecommunications,2019:30-40.)
[13] GAO H,HUANG W,YANG X. Applying probabilistic model checking to path planning in an intelligent transportation system using mobility trajectories and their statistical data[J]. Intelligent Automation and Soft Computing,2019,25(3):547-559.
[14] GAO H,HUANG W,DUAN Y,et al. Research on cost-driven services composition in an uncertain environment[J]. Journal of Internet Technology,2019,20(3):755-769.
[15] PREUVENEERS D,RIMMER V,TSINGENOPOULOS I,et al. Chained anomaly detection models for federated learning:an intrusion detection case study[J]. Applied Sciences,2018,8(12):No. 2663.
[16] BRISIMI T S,CHEN R,MELA T,et al. Federated learning of predictive models from federated electronic health records[J]. International Journal of Medical Informatics,2018,112:59-67.
[17] ZHANG W,ZHANG Y,ZHAI J,et al. Multi-source data fusion using deep learning for smart refrigerators[J]. Computers in Industry,2018,95:15-21.
[18] LEE J,SUN J,WANG F,et al. Privacy-preserving patient similarity learning in a federated environment:development and analysis[J]. JMIR Medical Informatics,2018,6(2):No. e20.
[19] SHEN G,HAN X,ZHOU J,et al. Research on intelligent analysis and depth fusion of multi-source traffic data[J]. IEEE Access,2018,6:59329-59335.
[20] LIU J,LI T,XIE P,et al. Urban big data fusion based on deep learning:an overview[J]. Information Fusion, 2020, 53:123-133.
[21] ZHU Z,DONG S,YU C,et al. A text hybrid clustering algorithm based on HowNet semantics[J]. Key Engineering Materials, 2011,474/475/476:2071-2078.

Online federated incremental learning algorithm for blockchain

面向区块链的在线联邦增量学习算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	GUO Mian, ZHANG Jinyou. Computation offloading policy for machine learning in mobile edge computing environments [J]. Journal of Computer Applications, 2021, 41(9): 2639-2645.
[2]	MAO Mingze, CAO Ruihao, YAN Chungang. Semi-supervised classification algorithm based on weight diversity [J]. Journal of Computer Applications, 2021, 41(9): 2473-2480.
[3]	GE Jihong, SHEN Tao. Energy data access control method based on blockchain [J]. Journal of Computer Applications, 2021, 41(9): 2615-2622.
[4]	SHEN Yumin, WANG Jinlong, HU Diankai, LIU Xingyu. Multi-person collaborative creation system of building information modeling drawings based on blockchain [J]. Journal of Computer Applications, 2021, 41(8): 2338-2345.
[5]	QING Xinyi, CHEN Yuling, ZHOU Zhengqiang, TU Yuanchao, LI Tao. Blockchain storage expansion model based on Chinese remainder theorem [J]. Journal of Computer Applications, 2021, 41(7): 1977-1982.
[6]	YANG Longhai, WANG Xueyuan, JIANG Hesong. Blockchain digital signature scheme with improved SM2 signature method [J]. Journal of Computer Applications, 2021, 41(7): 1983-1988.
[7]	CHEN Weiwei, CAO Li, GU Xiang. E-forensics model for internet of vehicles based on blockchain [J]. Journal of Computer Applications, 2021, 41(7): 1989-1995.
[8]	DONG Wentao, LI Zhuo, CHEN Xin. Online short video content distribution strategy based on federated learning [J]. Journal of Computer Applications, 2021, 41(6): 1551-1556.
[9]	WANG Jiarui, TAN Guoping, ZHOU Siyuan. Clustered wireless federated learning algorithm in high-speed internet of vehicles scenes [J]. Journal of Computer Applications, 2021, 41(6): 1546-1550.
[10]	LIU Hongyu, LIANG Xiubo, WU Junhan. Kubernetes-based Fabric chaincode management and high availability technology [J]. Journal of Computer Applications, 2021, 41(4): 956-962.
[11]	LI Bei, ZHANG Wenyin, WANG Jiuru, ZHAO Wei, WANG Haifeng. Sealed-bid auction scheme based on blockchain [J]. Journal of Computer Applications, 2021, 41(4): 999-1004.
[12]	TIAN Zhihong, ZHAO Jindong. Overview of blockchain consensus mechanism for internet of things [J]. Journal of Computer Applications, 2021, 41(4): 917-929.
[13]	ZHANG Xuewang, YIN Zijie, FENG Jiaqi, YE Caijin, FU Kang. Data trading scheme based on blockchain and trusted computing [J]. Journal of Computer Applications, 2021, 41(4): 939-944.
[14]	ZHANG Guochao, TANG Huayun, CHEN Jianhai, SHEN Rui, HE Qinming, HUANG Butian. Digital music copyright management system based on blockchain [J]. Journal of Computer Applications, 2021, 41(4): 945-955.
[15]	YU Dongchang, ZHAO Wenfang, NIE Kai, ZHANG Ge. Visibility forecast model based on LightGBM algorithm [J]. Journal of Computer Applications, 2021, 41(4): 1035-1041.