Beyond Backpropagation: Bilevel Optimization Through Implicit Differentiation and Equilibrium Propagation
Sign Up to like & getrecommendations! Published in 2022 at "Neural Computation"
DOI: 10.1162/neco_a_01547
Abstract: Abstract This review examines gradient-based techniques to solve bilevel optimization problems. Bilevel optimization extends the loss minimization framework underlying statistical learning to systems that are implicitly defined through a quantity they minimize. This characterization can… read more here.
Keywords: bilevel optimization; implicit differentiation; equilibrium propagation;