Articles with "multihead attention" as a keyword



Regional zenith tropospheric delay prediction using DBO-optimized CNN-LSTM with multihead attention

Sign Up to like & get
recommendations!
Published in 2025 at "Scientific Reports"

DOI: 10.1038/s41598-025-15376-z

Abstract: Zenith Total Delay (ZTD) is integral to applications such as atmospheric water vapor inversion and precise positioning in the Global Navigation Satellite System (GNSS). The development of high-precision regional ZTD models has emerged as a… read more here.

Keywords: multihead attention; ztd; cnn lstm; prediction ... See more keywords

Convolutional Neural Network With Multihead Attention for Human Activity Recognition

Sign Up to like & get
recommendations!
Published in 2024 at "IEEE Internet of Things Journal"

DOI: 10.1109/jiot.2023.3294421

Abstract: Convolutional neural networks (CNNs) have shown great promise in human activity recognition (HAR), but long-term dependencies in time series data can be difficult to capture using standard CNNs. This study introduces a new CNN architecture… read more here.

Keywords: convolutional neural; multihead attention; human activity; attention ... See more keywords

AMAP: Automatic Multihead Attention Pruning by Similarity-Based Pruning Indicator.

Sign Up to like & get
recommendations!
Published in 2025 at "IEEE transactions on neural networks and learning systems"

DOI: 10.1109/tnnls.2025.3606750

Abstract: Despite the strong performance of transformers, quadratic computation complexity of self-attention presents challenges in applying them to vision tasks. Linear attention reduces this complexity from quadratic to linear, offering a strong computation–performance tradeoff. To further… read more here.

Keywords: pruning indicator; similarity based; multihead attention; attention ... See more keywords

Enhanced Thermal Modeling of Electric Vehicle Motors Using a Multihead Attention Mechanism

Sign Up to like & get
recommendations!
Published in 2024 at "Energies"

DOI: 10.3390/en17122976

Abstract: The rapid advancement of electric vehicles (EVs) accentuates the criticality of efficient thermal management systems for electric motors, which are pivotal for performance, reliability, and longevity. Traditional thermal modeling techniques often struggle with the dynamic… read more here.

Keywords: temperature; thermal modeling; multihead attention; attention mechanism ... See more keywords