Multi-Scale Fine-Grained Alignments for Image and Sentence Matching
Sign Up to like & getrecommendations! Published in 2023 at "IEEE Transactions on Multimedia"
DOI: 10.1109/tmm.2021.3128744
Abstract: Image and sentence matching is a critical task to bridge the visual and textual discrepancy due to the heterogeneous modalities. Great progress has been made by exploring the coarse-grained relationships between images and sentences or… read more here.
Keywords: multi scale; scale; scale fine; image sentence ... See more keywords
Image and Sentence Matching via Semantic Concepts and Order Learning
Sign Up to like & getrecommendations! Published in 2020 at "IEEE Transactions on Pattern Analysis and Machine Intelligence"
DOI: 10.1109/tpami.2018.2883466
Abstract: Image and sentence matching has made great progress recently, but it remains challenging due to the existing large visual-semantic discrepancy. This mainly arises from two aspects: 1) images consist of unstructured content which is not… read more here.
Keywords: sentence; order; sentence matching; image ... See more keywords
Efficient Image and Sentence Matching
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Transactions on Pattern Analysis and Machine Intelligence"
DOI: 10.1109/tpami.2022.3178485
Abstract: Recently, the accuracy of image and sentence matching has been continuously improved by larger and larger models. However, such large models not only need huge storage space but also slow down inference speed, which are… read more here.
Keywords: student; image sentence; sentence matching; model ... See more keywords