Incremental PID Controller-Based Learning Rate Scheduler for Stochastic Gradient Descent.
Sign Up to like & getrecommendations! Published in 2022 at "IEEE transactions on neural networks and learning systems"
DOI: 10.1109/tnnls.2022.3213677
Abstract: As we all know, the learning rate plays a vital role in deep neural network (DNN) training. This study introduces an incremental proportional-integral-derivative (PID) controller widely used in automatic control as a learning rate scheduler… read more here.
Keywords: incremental pid; pid controller; learning rate; learning rates ... See more keywords
Efficient Training of Deep Spiking Neural Networks Using a Modified Learning Rate Scheduler
Sign Up to like & getrecommendations! Published in 2025 at "Mathematics"
DOI: 10.3390/math13081361
Abstract: Deep neural networks (DNNs) have achieved high accuracy in various applications, but with the rapid growth of AI and the increasing scale and complexity of datasets, their computational cost and power consumption have become even… read more here.
Keywords: rate scheduler; spiking neural; neural networks; learning rate ... See more keywords