MCWS-Transformers: Towards an Efficient Modeling of Protein Sequences via Multi Context-Window Based Scaled Self-Attention
Sign Up to like & getrecommendations! Published in 2022 at "IEEE/ACM Transactions on Computational Biology and Bioinformatics"
DOI: 10.1109/tcbb.2022.3173789
Abstract: This paper advances the self-attention mechanism in the standard transformer network specific to the modeling of the protein sequences. We introduce a novel context-window based scaled self-attention mechanism for processing protein sequences that is based… read more here.
Keywords: window based; self attention; protein sequences; context window ... See more keywords