Preventing Vanishing Gradient Problem of Hardware Neuromorphic System by Implementing Imidazole-Based Memristive ReLU Activation Neuron.
Sign Up to like & getrecommendations! Published in 2023 at "Advanced materials"
DOI: 10.1002/adma.202300023
Abstract: With advances in artificial intelligent services, brain-inspired neuromorphic systems with synaptic devices have recently attracted significant interest to circumvent the von Neumann bottleneck. However, the increasing trend of deep neural network parameters causes huge power… read more here.
Keywords: vanishing gradient; relu activation; gradient problem;