Deep networks on toroids: removing symmetries reveals the structure of flat regions in the landscape geometry
Sign Up to like & getrecommendations! Published in 2022 at "Journal of Statistical Mechanics: Theory and Experiment"
DOI: 10.1088/1742-5468/ac9832
Abstract: We systematize the approach to the investigation of deep neural network landscapes by basing it on the geometry of the space of implemented functions rather than the space of parameters. Grouping classifiers into equivalence classes,… read more here.
Keywords: deep networks; removing symmetries; space; geometry ... See more keywords