PACL: Piecewise Arc Cotangent Decay Learning Rate for Deep Neural Network Training
Sign Up to like & getrecommendations! Published in 2020 at "IEEE Access"
DOI: 10.1109/access.2020.3002884
Abstract: Deep neural networks (DNNs) are currently the best-performing method for many classification problems. For training DNNs, the learning rate is the most important hyper-parameter, choice of which affects the performance of the model greatly. In… read more here.
Keywords: piecewise arc; deep neural; rate; cotangent decay ... See more keywords