Staleness Analysis in Asynchronous Optimization
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Transactions on Signal and Information Processing over Networks"
DOI: 10.1109/tsipn.2022.3163931
Abstract: Distributed optimization is widely used to solve large-scale optimization problems by parallelizing gradient-based algorithms across multiple computing nodes. In asynchronous optimization, the optimization parameter is updated using stale gradients, which are gradients computed with respect… read more here.
Keywords: system parameters; convergence; staleness; asynchronous optimization ... See more keywords