Articles with "step attention" as a keyword



Sleep Staging Using Compressed Vision Transformer With Novel Two-Step Attention Weighted Sum

Sign Up to like & get
recommendations!
Published in 2025 at "IEEE Access"

DOI: 10.1109/access.2025.3561310

Abstract: Automatic sleep staging is crucial for diagnosing sleep disorders, however, existing inter-epoch feature extraction schemes such as RNN-based networks or transformers often struggle with long sleep sequences due to overfitting. This study presents a novel… read more here.

Keywords: two step; step attention; transformer; sleep staging ... See more keywords
Photo by ernys from unsplash

Enhancing Fruit Fly Detection in Complex Backgrounds Using Transformer Architecture with Step Attention Mechanism

Sign Up to like & get
recommendations!
Published in 2024 at "Agriculture"

DOI: 10.3390/agriculture14030490

Abstract: This study introduces a novel high-accuracy fruit fly detection model based on the Transformer structure, specifically aimed at addressing the unique challenges in fruit fly detection such as identification of small targets and accurate localization… read more here.

Keywords: detection; step attention; complex backgrounds; fruit fly ... See more keywords