Incremental Learning With Adaptive Model Search and a Nominal Loss Model
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Access"
DOI: 10.1109/access.2022.3149598
Abstract: This paper addresses an incremental learning problem, in which tasks are learned sequentially without access to the previously trained dataset. Catastrophic forgetting is a significant bottleneck to incremental learning as the network performs poorly on… read more here.
Keywords: incremental learning; loss; model; model search ... See more keywords
Single-head lifelong learning based on distilling knowledge
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Access"
DOI: 10.1109/access.2022.3155451
Abstract: Within the machine learning field, the main purpose of lifelong learning, also known as continuous learning, is to enable neural networks to learn continuously, as humans do. Lifelong learning accumulates the knowledge learned from previous… read more here.
Keywords: previous tasks; head lifelong; knowledge; single head ... See more keywords