Full-stack Optimizing Transformer Inference on ARM Many-core CPU
Sign Up to like & getrecommendations! Published in 2023 at "IEEE Transactions on Parallel and Distributed Systems"
DOI: 10.1109/tpds.2023.3280805
Abstract: The past several years have witnessed tremendous success of transformer models in natural language processing (NLP), and their current landscape is increasingly diverse. Although GPU gradually becomes the dominating workhorse and de facto standard for… read more here.
Keywords: transformer inference; cpu; core; arm many ... See more keywords