LAUSR

Preconditioned Stochastic Gradient Descent

Sign Up to like & get
recommendations!
0 Published in 2018 at "IEEE Transactions on Neural Networks and Learning Systems"

DOI: 10.1109/tnnls.2017.2672978

Abstract: Stochastic gradient descent (SGD) still is the workhorse for many practical problems. However, it converges slow, and can be difficult to tune. It is possible to precondition SGD to accelerate its convergence remarkably. But many… read more here.

Keywords: preconditioned stochastic; gradient descent; preconditioner; gradient ... See more keywords