Stochastic analysis of an adaptive cubic regularization method under inexact gradient evaluations and dynamic Hessian accuracy
Sign Up to like & getrecommendations! Published in 2020 at "Optimization"
DOI: 10.1080/02331934.2021.1892104
Abstract: We here adapt an extended version of the adaptive cubic regularization method with dynamic inexact Hessian information for nonconvex optimization in Bellavia et al. [Adaptive cubic regularization methods with dynamic inexact hessian information and applications… read more here.
Keywords: analysis; regularization method; cubic regularization; adaptive cubic ... See more keywords
AdaCN: An Adaptive Cubic Newton Method for Nonconvex Stochastic Optimization
Sign Up to like & getrecommendations! Published in 2021 at "Computational Intelligence and Neuroscience"
DOI: 10.1155/2021/5790608
Abstract: In this work, we introduce AdaCN, a novel adaptive cubic Newton method for nonconvex stochastic optimization. AdaCN dynamically captures the curvature of the loss landscape by diagonally approximated Hessian plus the norm of difference between… read more here.
Keywords: method nonconvex; cubic newton; adaptive cubic; newton method ... See more keywords