Toward Practical Usage of the Attention Mechanism as a Tool for Interpretability
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Access"
DOI: 10.1109/access.2022.3169772
Abstract: Natural language processing (NLP) has been one of the subfields of artificial intelligence much affected by the recent neural revolution. Architectures such as recurrent neural networks (RNNs) and attention-based transformers helped propel the state of… read more here.
Keywords: interpretability; attention mechanism; attention weights; toward practical ... See more keywords
Neuron synchronization analyzed through spatial-temporal attention
Sign Up to like & getrecommendations! Published in 2024 at "Frontiers in Computational Neuroscience"
DOI: 10.3389/fncom.2025.1655462
Abstract: Across diverse organisms, the temporal dynamics of spiking responses between neurons, the neural synchrony, is crucial for encoding different stimuli. Neural synchrony is especially important in the insect antennal (olfactory) lobe (AL). Previous studies on… read more here.
Keywords: neuron synchronization; synchronization; attention; temporal attention ... See more keywords