Can language representation models think in bets?
Sign Up to like & getrecommendations! Published in 2022 at "Royal Society Open Science"
DOI: 10.1098/rsos.221585
Abstract: In recent years, transformer-based language representation models (LRMs) have achieved state-of-the-art results on difficult natural language understanding problems, such as question answering and text summarization. As these models are integrated into real-world applications, evaluating their… read more here.
Keywords: representation models; think bets; language; decision making ... See more keywords
Discourse-Aware Language Representation.
Sign Up to like & getrecommendations! Published in 2025 at "IEEE transactions on pattern analysis and machine intelligence"
DOI: 10.1109/tpami.2025.3621229
Abstract: Recent Transformer-based language representation techniques have commonly adopted a straightforward approach to modeling textual context as a linear sequence of successive tokens. However, this sequential modeling strategy falls short in actively exploring intermediate structures present… read more here.
Keywords: aware language; discourse aware; language; language representation ... See more keywords
Language Representation Models: An Overview
Sign Up to like & getrecommendations! Published in 2021 at "Entropy"
DOI: 10.3390/e23111422
Abstract: In the last few decades, text mining has been used to extract knowledge from free texts. Applying neural networks and deep learning to natural language processing (NLP) tasks has led to many accomplishments for real-world… read more here.
Keywords: language representation; models overview; representation models; language ... See more keywords