LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

Decentralized federated meta‐learning framework for few‐shot multitask learning

Photo by stevencornfield from unsplash

Federated learning is increasingly attractive, however as the number of training samples on a single device is too small and the training tasks of the devices are different, it faces… Click to show full abstract

Federated learning is increasingly attractive, however as the number of training samples on a single device is too small and the training tasks of the devices are different, it faces the few‐shot multitask learning problem. Moreover, federated learning frameworks are usually vulnerable to malicious attacks of the central server and diverse clients. To address these problems, we propose a decentralized federated meta‐learning framework (DFMLF) for few‐shot multitask learning. In DFMLF, the devices take the rapid adaptation as objective and learn the meta‐knowledge shared by tasks to deal with the few‐shot multitask problem. In addition, DFMLF conducts cross‐validation and secure aggregation mechanism by a small number of committee nodes, which not only eliminates the central server to avoid the security risks brought by the malicious central server, but also avoids the attack of malicious devices. Moreover, to address the extra communication cost brought by the committee strategy, we propose a communication‐efficient method to make the training and aggregation carried out in parallel. We conduct extensive experiments based on real‐world data sets, and the experimental results demonstrate the effectiveness, robustness, and efficiency of our framework.

Keywords: multitask; shot multitask; decentralized federated; multitask learning; federated meta

Journal Title: International Journal of Intelligent Systems
Year Published: 2022

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.