Accelerated masked transformer for dense video captioning
Sign Up to like & getrecommendations! Published in 2021 at "Neurocomputing"
DOI: 10.1016/j.neucom.2021.03.026
Abstract: Abstract Dense video captioning aims to generate dense descriptions for all possible events in an untrimmed video. The task is challenging that it requires accurately localizing events in the video and simultaneously describe each event… read more here.
Keywords: video; accelerated masked; masked transformer; video captioning ... See more keywords
Parallel Pathway Dense Video Captioning With Deformable Transformer
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Access"
DOI: 10.1109/access.2022.3228821
Abstract: Dense video captioning is a very challenging task because it requires a high-level understanding of the video story, as well as pinpointing details such as objects and motions for a consistent and fluent description of… read more here.
Keywords: video captioning; parallel pathway; pathway dense; dense video ... See more keywords
Environment-Aware Dense Video Captioning for IoT-Enabled Edge Cameras
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Internet of Things Journal"
DOI: 10.1109/jiot.2021.3104289
Abstract: In recent years, the Artificial Intelligence of Things (AIoT) has led to the rapid development of edge computing, and existing video-captioning systems can be deployed directly on AIoT-enabled cameras (hereafter referred to as edge cameras),… read more here.
Keywords: environment; edge cameras; video captioning; video ... See more keywords
Average Sparse Attention for Dense Video Captioning From Multiperspective Edge-Computing Cameras
Sign Up to like & getrecommendations! Published in 2024 at "IEEE Systems Journal"
DOI: 10.1109/jsyst.2024.3456864
Abstract: In recent years, the artificial intelligence of things (AIoT) has accelerated the development of edge computing. Since existing edge computing for dense video captioning has only explored single-camera decision-making, we propose a lightweight image stitching… read more here.
Keywords: video; edge computing; attention; dense video ... See more keywords
Show, Tell and Summarize: Dense Video Captioning Using Visual Cue Aided Sentence Summarization
Sign Up to like & getrecommendations! Published in 2020 at "IEEE Transactions on Circuits and Systems for Video Technology"
DOI: 10.1109/tcsvt.2019.2936526
Abstract: In this work, we propose a division-and-summarization (DaS) framework for dense video captioning. After partitioning each untrimmed long video as multiple event proposals, where each event proposal consists of a set of short video segments,… read more here.
Keywords: video; event proposal; sentence; video captioning ... See more keywords
Event-Centric Hierarchical Representation for Dense Video Captioning
Sign Up to like & getrecommendations! Published in 2021 at "IEEE Transactions on Circuits and Systems for Video Technology"
DOI: 10.1109/tcsvt.2020.3014606
Abstract: Dense video captioning aims to localize and describe multiple events in untrimmed videos, which is a challenging task that draws attention recently in computer vision. Although existing methods have achieved impressive performance, most of them… read more here.
Keywords: representation; video captioning; hierarchical representation; event ... See more keywords
Global-Shared Text Representation Based Multi-Stage Fusion Transformer Network for Multi-Modal Dense Video Captioning
Sign Up to like & getrecommendations! Published in 2024 at "IEEE Transactions on Multimedia"
DOI: 10.1109/tmm.2023.3307972
Abstract: Dense video captioning aims to detect all events of an uncropped video and generate corresponding textual captions for each event. Multi-modal information is essential to improve the performance of this task, but the existing methods… read more here.
Keywords: video; multi; dense video; multi modal ... See more keywords