Incremental PID Controller-Based Learning Rate Scheduler for Stochastic Gradient Descent.
Sign Up to like & getrecommendations! Published in 2022 at "IEEE transactions on neural networks and learning systems"
DOI: 10.1109/tnnls.2022.3213677
Abstract: As we all know, the learning rate plays a vital role in deep neural network (DNN) training. This study introduces an incremental proportional-integral-derivative (PID) controller widely used in automatic control as a learning rate scheduler… read more here.
Keywords: incremental pid; pid controller; learning rate; learning rates ... See more keywords