LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

HiCT: Hierarchical Comprehend of Transformer for Weakly Supervised Object Localization

Photo by florianklauer from unsplash

The weakly supervised object localization (WSOL) has always been a very challenging research subject in the field of computer vision, which aims to predict the localization of objects in an… Click to show full abstract

The weakly supervised object localization (WSOL) has always been a very challenging research subject in the field of computer vision, which aims to predict the localization of objects in an image using only an image-level class labeling approach. The traditional convolutional neural network (CNN) based approaches utilize the local class activation and discrimination for classification guidance, and the biggest drawback of CNN is that it cannot capture the remote feature dependencies between pixels. Recently, the transformer architecture has been deployed in the WSOL, but the transformer cannot well capture local features. To address the above problems, we propose a hierarchical comprehend of the transformer (HiCT), a simple and effective visual converter variation method. Moreover, we also propose a discriminative-based attention layer (DAL), which aims to mine the local feature information by utilizing the global token attention graph mechanism. To further improve the coverage of object localization, we introduce the spatial aware digging module (SADM). In addition, a set of complementarity loss calculators to patch hierarchy is proposed to improve the sample class aggregation capability of our model. Finally, we conducted experiments on two commonly used datasets of CUB-200-2011 and imagenet large scale visual recognition challenge (ILSVRC), so as to verify the effectiveness of our method.

Keywords: localization; weakly supervised; supervised object; object localization; transformer; hierarchical comprehend

Journal Title: IEEE Transactions on Instrumentation and Measurement
Year Published: 2023

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.