Articles with "biomedical transformers" as a keyword



Photo by theshuttervision from unsplash

On the effectiveness of compact biomedical transformers

Sign Up to like & get
recommendations!
Published in 2022 at "Bioinformatics"

DOI: 10.1093/bioinformatics/btad103

Abstract: Abstract Motivation Language models pre-trained on biomedical corpora, such as BioBERT, have recently shown promising results on downstream biomedical tasks. Many existing pre-trained models, on the other hand, are resource-intensive and computationally heavy owing to… read more here.

Keywords: biomedical transformers; effectiveness compact; compact biomedical; biomedical tasks ... See more keywords