LAUSR

About LAUSR
Donate
Contact Us

Follow us:

You are not signed in:

Sign Up!


   Articles with "transformer architecture" as a keyword



Perspectives and Prospects on Transformer Architecture for Cross-Modal Tasks with Language and Vision

Sign Up to like & get
recommendations! Published in 2022 at "International Journal of Computer Vision"

DOI: 10.1007/s11263-021-01547-8

Abstract: Transformer architectures have brought about fundamental changes to computational linguistic field, which had been dominated by recurrent neural networks for many years. Its success also implies drastic changes in cross-modal tasks with language and vision,… read more here.

Keywords: tasks language; transformer architecture; language vision; cross modal ... See more keywords

MoleculeFormer is a GCN-transformer architecture for molecular property prediction

Sign Up to like & get
recommendations! Published in 2025 at "Communications Biology"

DOI: 10.1038/s42003-025-09064-x

Abstract: Artificial intelligence is increasingly important in drug discovery, particularly in molecular property prediction. Graph Neural Networks can model molecular structures as graphs, using structural data to predict molecular properties and biological activities effectively. However, molecular… read more here.

Keywords: transformer architecture; prediction; transformer; property prediction ... See more keywords
Photo from wikipedia

Paraphrase Generation Model Integrating Transformer Architecture, Part-of-Speech Features, and Pointer Generator Network

Sign Up to like & get
recommendations! Published in 2023 at "IEEE Access"

DOI: 10.1109/access.2023.3260849

Abstract: In recent years, hardware advancements have enabled natural language processing tasks that were previously difficult to achieve due to their intense computing requirements. This study focuses on paraphrase generation, which entails rewriting a sentence using… read more here.

Keywords: transformer architecture; generation; generation model; model ... See more keywords

Adaptive Renewable Energy Forecasting Utilizing a Data-Driven PCA-Transformer Architecture

Sign Up to like & get
recommendations! Published in 2024 at "IEEE Access"

DOI: 10.1109/access.2024.3440226

Abstract: The incorporation of renewable energy sources into the power grid has necessitated the development of sophisticated forecasting models that can effectively handle the inherent fluctuation and uncertainty associated with renewable energy generation. In this study,… read more here.

Keywords: transformer architecture; pca transformer; energy; renewable energy ... See more keywords

Visual Self-Positioning of Low-Altitude Urban UAV Based on Improved Transformer Architecture

Sign Up to like & get
recommendations! Published in 2025 at "IEEE Internet of Things Journal"

DOI: 10.1109/jiot.2025.3599506

Abstract: With the development of the Internet of Things, cross-view geolocation of satellite images and uncrewed aerial vehicles (UAVs) aerial images is gaining attention due to its significant potential in denied-navigation environments under global navigation satellite… read more here.

Keywords: navigation; transformer architecture; based improved; improved transformer ... See more keywords

Multiscale Spatial-Channel Transformer Architecture Search for Remote Sensing Image Change Detection

Sign Up to like & get
recommendations! Published in 2024 at "IEEE Geoscience and Remote Sensing Letters"

DOI: 10.1109/lgrs.2023.3347765

Abstract: Deep learning-based approaches play important roles and achieve impressive performances in remote sensing image change detection. Most of the networks are designed by the researchers with rich experiences. It is difficult to design the fixed… read more here.

Keywords: change detection; search; transformer architecture; remote sensing ... See more keywords

Multimodal-Guided Transformer Architecture for Remote Sensing Salient Object Detection

Sign Up to like & get
recommendations! Published in 2025 at "IEEE Geoscience and Remote Sensing Letters"

DOI: 10.1109/lgrs.2025.3601083

Abstract: The latest remote sensing image saliency detectors primarily rely on RGB information alone. However, spatial and geometric information embedded in depth images is robust to variations in lighting and color. Integrating depth information with RGB… read more here.

Keywords: detection; information; guided transformer; transformer architecture ... See more keywords

Training-Free Transformer Architecture Search With Zero-Cost Proxy Guided Evolution

Sign Up to like & get
recommendations! Published in 2024 at "IEEE Transactions on Pattern Analysis and Machine Intelligence"

DOI: 10.1109/tpami.2024.3378781

Abstract: Transformers have shown remarkable performance, however, their architecture design is a time-consuming process that demands expertise and trial-and-error. Thus, it is worthwhile to investigate efficient methods for automatically searching high-performance Transformers via Transformer Architecture Search… read more here.

Keywords: training free; architecture search; search; transformer architecture ... See more keywords

Hybrid Transferable Deep Reinforcement Learning and Transformer Architecture for Enhanced Lithology Identification From Well‐Logging Data

Sign Up to like & get
recommendations! Published in 2025 at "Geophysical Prospecting"

DOI: 10.1111/1365-2478.70083

Abstract: This research presents an innovative framework for lithology detection that combines domain adaptation, an Actor–Critic reinforcement learning (RL) architecture and Transformer‐based sequence modelling to enhance log interpretation reliability in complex depositional environments. The study first… read more here.

Keywords: hybrid transferable; architecture; transformer architecture; lithology ... See more keywords

Analysis of multipath effects in global trade networks based on multimodal, high dimensional, heterogeneous transformer architecture: Deconstruction of nonlinear cascade and dynamic chain reaction

Sign Up to like & get
recommendations! Published in 2025 at "PLOS One"

DOI: 10.1371/journal.pone.0328687

Abstract: This paper proposes a multi-path effect analysis model for major economies in the global trade network based on the MH-DP Transformer architecture. The global trade network comprises interconnected nodes, with interactions among major economies (China,… read more here.

Keywords: trade; transformer architecture; global trade; trade networks ... See more keywords

Multi-Head Transformer Architecture with Higher Dimensional Feature Representation for Massive MIMO CSI Feedback

Sign Up to like & get
recommendations! Published in 2024 at "Applied Sciences"

DOI: 10.3390/app14041356

Abstract: To achieve the anticipated performance of massive multiple input multiple output (MIMO) systems in wireless communication, it is imperative that the user equipment (UE) accurately feeds the channel state information (CSI) back to the base… read more here.

Keywords: transformer architecture; multi head; csi feedback; csi ... See more keywords