Articles with "sparse transformers" as a keyword



An Algorithm–Hardware Co-Optimized Framework for Accelerating N:M Sparse Transformers

Sign Up to like & get
recommendations!
Published in 2022 at "IEEE Transactions on Very Large Scale Integration (VLSI) Systems"

DOI: 10.1109/tvlsi.2022.3197282

Abstract: The Transformer has been an indispensable staple in deep learning. However, for real-life applications, it is very challenging to deploy efficient Transformers due to the immense parameters and operations of models. To relieve this burden,… read more here.

Keywords: inline formula; sparse transformers; algorithm hardware; tex math ... See more keywords