Knowledge Distillation Based on Narrow-Deep Networks
Sign Up to like & getrecommendations! Published in 2024 at "Neural Processing Letters"
DOI: 10.1007/s11063-024-11646-5
Abstract: Deep neural networks perform better than shallow neural networks, but the former tends to be deeper or wider, introducing large numbers of parameters and computations. We know that networks that are too wide have a… read more here.
Keywords: narrow deep; deep networks; knowledge distillation; distillation based ... See more keywords