A theory of initialisation’s impact on specialisation
Sign Up to like & getrecommendations! Published in 2025 at "Journal of Statistical Mechanics: Theory and Experiment"
DOI: 10.1088/1742-5468/ae1214
Abstract: Prior work has demonstrated a consistent tendency in neural networks engaged in continual learning tasks, wherein intermediate task similarity results in the highest levels of catastrophic interference. This phenomenon is attributed to the network’s tendency… read more here.
Keywords: theory initialisation; specialisation; initialisation impact; impact specialisation ... See more keywords