LAUSR

Weakly supervised object localization (WSOL) tasks aim to classify and locate a single object under the supervision of only image-level labels. Pseudo-supervised learning methods have been shown to be effective for WSOL. These methods divide WSOL tasks into two decoupled subtasks: classification and localization. The decoupled framework has been proven to be effective in improving the performance of the localization subtask, but the predicted localizations are not robust enough due to the noise of pseudo-labels. Based on the assumption that the localization model should make similar predictions on different versions of the same image, we propose an additional refinement stage to learn more consistent localization. In the refinement stage, we propose a simple and effective method for evaluating the confidence of pseudo-labels based on classification discrimination. By learning consistency from high-confidence pseudo-labels, we further refine the localization model to obtain more consistent and more accurate predictions. Additionally, in the initialization stage, we propose a mask-based pseudo-label generator to initialize the localization model. We conducted experiments on two benchmark datasets: CUB-200-2011 and ImageNet-1k. The experimental results show that our two-stage approach achieved 94.01% GT-Konwn localization accuracy on the CUB-200-2011 testing dataset and 65.23% GT-Konwn localization accuracy on the ImageNet-1k validation dataset. Moreover, when directly applied to the pseudo-supervised localization model, our refinement stage achieved 94.05% and 67.13% GT-Konwn localization accuracy on the CUB-200-2011 and ImageNet-1k datasets, respectively, which outperforms the corresponding pseudo-supervised localization model with an accuracy improvement of 3.34% and 2.34%, respectively.