LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

FLAS: Computation and Communication Efficient Federated Learning via Adaptive Sampling

Photo from wikipedia

Federated learning enables collaborative deep learning over multiple clients without sharing their local data, and it becomes increasingly popular due to the good balance between data privacy and model usability.… Click to show full abstract

Federated learning enables collaborative deep learning over multiple clients without sharing their local data, and it becomes increasingly popular due to the good balance between data privacy and model usability. Generally, it faces the heavy communication overhead when a large number of clients are involved and the low convergence rate incurred by non-IID data. However, few existing solutions cannot simultaneously address the communication and statistic challenges. In this paper, we propose a computation and communication efficient federated learning via adaptive sampling. By capturing different data distribution among clients, we utilize the concept of self-paced learning to adaptively adjust thresholds to filter training data for each client and also to select suitable clients to be involved in each global learning round. We prove its correctness through theoretical analysis and also evaluate its performance through experimental evaluations on real-world datasets. Detailed experimental results show that it can effectively reduce the communication cost while achieving the good trade-off between accuracy and efficiency.

Keywords: communication efficient; communication; federated learning; efficient federated; learning via; computation communication

Journal Title: IEEE Transactions on Network Science and Engineering
Year Published: 2022

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.