Accelerated First-Order Optimization Algorithms for Machine Learning
Sign Up to like & getrecommendations! Published in 2020 at "Proceedings of the IEEE"
DOI: 10.1109/jproc.2020.3007634
Abstract: Numerical optimization serves as one of the pillars of machine learning. To meet the demands of big data applications, lots of efforts have been put on designing theoretically and practically fast algorithms. This article provides… read more here.
Keywords: first order; optimization; machine learning; accelerated first ... See more keywords
Restart of accelerated first order methods with linear convergence under a quadratic functional growth condition
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Transactions on Automatic Control"
DOI: 10.1109/tac.2022.3146054
Abstract: Accelerated first order methods, also called fast gradient methods, are popular optimization methods in the field of convex optimization. However, they are prone to suffer from oscillatory behaviour that slows their convergence when medium to… read more here.
Keywords: convergence; restart; order; order methods ... See more keywords