• •    

基于双流网络的个性化联邦学习

沈哲远,杨珂珂,李京   

  1. 中国科学技术大学
  • 收稿日期:2023-09-06 修回日期:2023-11-13 发布日期:2023-12-18
  • 通讯作者: 李京

Dual stream neural network in personalized federated learning

  • Received:2023-09-06 Revised:2023-11-13 Online:2023-12-18
  • Contact: jing Li

摘要: 摘 要: 经典的联邦学习算法在数据高度异构的场景下难以取得较好的效果。个性化联邦学习针对数据异构问题,提出了新的解决方案,即为每个客户端“量身定做”专属模型,拥有较好的性能,但引出了难以将联邦学习扩展到新客户端上的问题。针对个性化联邦学习中,性能与扩展的难题展开研究,提出基于双流网络结构的联邦学习模型。双流网络模型通过增加一个用于分析客户端个性化特征的编码器,既能拥有个性化模型的性能,同时又便于扩展到新客户端。实验表明,在MNIST,CIFAR10,FashionMNIST 等数据集任务上相比经典联邦平均算法能够提升十个百分点,且同时解决了新客户端难以扩展的问题。

关键词: 关键词: 个性化联邦学习,数据异构,双流网络,新客户端问题

Abstract: Abstract: Classic federated learning algorithms are difficult to achieve good results in scenarios where data is highly heterogeneous and unevenly distributed. Personalized federated learning proposes a new solution to the problem of data heterogeneity in federated learning, which is to "tailor" a dedicated model for each client, which has good performance. However, this raises the issue of difficulty in extending federated learning to new clients. This paper focuses on the challenges of performance and scalability in personalized federated learning, and proposes a federated learning model based on a dual stream network structure. The dual stream network model can not only have the performance of personalized models but also be easily extended to new clients by adding an encoder for analyzing the clients. Experiments have shown that in dataset tasks such as MNIST, CIFAR10, and FashionMNIST, there is an improvement of more than ten percentage points compared to the classic federated average algorithm, while also solving the problem of difficult scalability for new clients.

Key words: personalized federated learning , data heterogeneous , dual stream neural network ,new client

中图分类号: