Joint Dynamic Grouping and Gradient Coding for Time-Critical Distributed Machine Learning in Heterogeneous Edge Networks
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Internet of Things Journal"
DOI: 10.1109/jiot.2022.3182394
Abstract: In edge networks, distributed computing resources have been widely utilized to collaboratively perform a machine learning task by multiple nodes. However, the model training time in heterogeneous edge networks is becoming longer because of excessive… read more here.
Keywords: gradient coding; time; edge networks; dynamic grouping ... See more keywords
Distributed Learning Based on 1-Bit Gradient Coding in the Presence of Stragglers
Sign Up to like & getrecommendations! Published in 2024 at "IEEE Transactions on Communications"
DOI: 10.1109/tcomm.2024.3377715
Abstract: This paper considers the problem of distributed learning (DL) in the presence of stragglers. For this problem, DL methods based on gradient coding have been widely investigated, which redundantly distribute the training data to the… read more here.
Keywords: gradient coding; bit; presence stragglers; distributed learning ... See more keywords
Adaptive Gradient Coding
Sign Up to like & getrecommendations! Published in 2022 at "IEEE/ACM Transactions on Networking"
DOI: 10.1109/tnet.2021.3122873
Abstract: This paper focuses on mitigating the impact of stragglers in distributed learning system. Unlike the existing results designated for a fixed number of stragglers, we develop a new scheme called Adaptive Gradient Coding (AGC) with… read more here.
Keywords: adaptive gradient; number stragglers; communication cost; gradient coding ... See more keywords
Byzantine-Resilient Gradient Coding Through Local Gradient Computations
Sign Up to like & getrecommendations! Published in 2024 at "IEEE Transactions on Information Theory"
DOI: 10.48550/arxiv.2401.02380
Abstract: We consider gradient coding in the presence of an adversary controlling so-called malicious workers trying to corrupt the computations. Previous works propose the use of MDS codes to treat the responses from malicious workers as… read more here.
Keywords: gradient coding; inline formula; malicious workers; tex math ... See more keywords