FedFly: Toward Migration in Edge-Based Distributed Federated Learning

Rehmat Ullah*, Di Wu, Paul Harvey, Peter Kilpatrick, Ivor Spence, Blesson Varghese

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

6 Citations (Scopus)

Abstract

Federated learning (FL) is a privacy-preserving distributed machine learning technique that trains models while keeping all the original data generated on devices locally. Since devices may be resource-constrained, offloading can be used to improve FL performance by transferring computational workload from devices to edge servers. However, due to mobility, devices participating in FL may leave the network during training and need to connect to a different edge server. This is challenging because the offloaded computations from an edge server need to be migrated. In line with this assertion, we present FedFly, which is, to the best of our knowledge, the first work to migrate a deep neural network (ONN) when devices move between edge servers during FL training. Our empirical results on the CIFAR-10 dataset, with both balanced and imbalanced data distribution, support our claims that FedFly can reduce training time by up to 33 percent when a device moves after 50 percent of the training is completed, and by up to 45 percent when 90 percent of the training is completed when compared to the state-of-the-art offloading approach in FL. FedFly has negligible overhead of up to two seconds and does not compromise accuracy. Finally, we highlight a number of open research issues for further investigation.

Original languageEnglish
Pages (from-to)42-48
Number of pages7
JournalIEEE Communications Magazine
Volume60
Issue number11
DOIs
Publication statusPublished - 1 Aug 2022
Externally publishedYes

Cite this