NeuRes: Highly Activated Neurons Responses Transfer via Distilling Sparse Activation Maps
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Access"
DOI: 10.1109/access.2022.3227804
Abstract: In recent years, Knowledge Distillation has obtained a significant interest in mobile, edge, and IoT devices due to its ability to transfer knowledge from the large and complex teacher to the lightweight student network. Intuitively,… read more here.
Keywords: distillation; sparse activation; highly activated; student ... See more keywords