LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

STransUNet: A Siamese TransUNet-Based Remote Sensing Image Change Detection Network

Photo by rossfindon from unsplash

In modern remote sensing image change detection (CD), convolution neural network (CNN), especially U-shaped structure (UNet), has achieved great success due to their powerful discriminative ability. However, UNet-based CNN networks… Click to show full abstract

In modern remote sensing image change detection (CD), convolution neural network (CNN), especially U-shaped structure (UNet), has achieved great success due to their powerful discriminative ability. However, UNet-based CNN networks usually have limitations in modeling global dependencies due to the intrinsic locality of convolution operations. Transformer has recently emerged as an alternative architecture for dense prediction tasks due to the global self-attention mechanism. However, due to the limitation of hardware resources, pure Transformer methods generally lack the ability to capture global information at a low level. Based on these existing problems, we propose STransUNet, which combines Transformer and UNet architecture. STransUNet can not only capture shallow detail features at an early stage but also model global context in high-level feature. In addition, we design an efficient feature fusion module named cross-enhanced adaptive fusion (CEAF). Our model mainly consists of three parts: encoder, fusion module, and decoder. The decoder is a CNN-Transformer hybrid structure. CNN extracts multilevel feature information. Transformer encodes tokenized sequence to capture global context. CEAF module cross-enhances and adaptively fuses bitemporal features to enhance feature representation. In the decoding stage, we introduce a cascaded upsampling decoder (CUP). CUP progressively aggregates low-level CNN features and high-level Transformer features to full resolution. On four public CD datasets, our STransUNet achieves better CD results than six state-of-the-art algorithms.

Keywords: change detection; remote sensing; cnn; image change; sensing image

Journal Title: IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Year Published: 2022

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.