Understanding Implicit Regularization in Over-Parameterized Single Index Model
Sign Up to like & getrecommendations! Published in 2022 at "Journal of the American Statistical Association"
DOI: 10.1080/01621459.2022.2044824
Abstract: In this paper, we leverage over-parameterization to design regularization-free algorithms for the high-dimensional single index model and provide theoretical guarantees for the induced implicit regularization phenomenon. Specifically, we study both vector and matrix single index… read more here.
Keywords: single index; regularization; index model; implicit regularization ... See more keywords
On Generalization Bounds for Deep Networks Based on Loss Surface Implicit Regularization
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Transactions on Information Theory"
DOI: 10.1109/tit.2022.3215088
Abstract: The classical statistical learning theory implies that fitting too many parameters leads to overfitting and poor performance. That modern deep neural networks generalize well despite a large number of parameters contradicts this finding and constitutes… read more here.
Keywords: neural networks; loss; geometry; implicit regularization ... See more keywords
A Brief Review of Implicit Regularization and Its Connection with the BPHZ Theorem
Sign Up to like & getrecommendations! Published in 2021 at "Symmetry"
DOI: 10.3390/sym13060956
Abstract: Quantum Field Theory, as the keystone of particle physics, has allowed great insights to deciphering the core of Nature. Despite its striking success, by adhering to local interactions, Quantum Field Theory suffers from the appearance… read more here.
Keywords: bphz theorem; implicit regularization; review implicit; regularization ... See more keywords