Articles with "positional encoding" as a keyword



Photo by jareddrice from unsplash

Convolution-Embedded Vision Transformer With Elastic Positional Encoding for Pansharpening

Sign Up to like & get
recommendations!
Published in 2022 at "IEEE Transactions on Geoscience and Remote Sensing"

DOI: 10.1109/tgrs.2022.3227405

Abstract: Transformer, especially vision transformer (ViT), is attracting increasing attention in various computer vision (CV) tasks. However, two urgent problems exist for the ViT: 1) owing to its attending to an image in the patch level,… read more here.

Keywords: positional encoding; vision transformer; elastic positional; vit ... See more keywords
Photo by heftiba from unsplash

NGD-Transformer: Navigation Geodesic Distance Positional Encoding with Self-Attention Pooling for Graph Transformer on 3D Triangle Mesh

Sign Up to like & get
recommendations!
Published in 2022 at "Symmetry"

DOI: 10.3390/sym14102050

Abstract: Following the significant success of the transformer in NLP and computer vision, this paper attempts to extend it to 3D triangle mesh. The aim is to determine the shape’s global representation using the transformer and… read more here.

Keywords: positional encoding; mesh; geodesic distance; navigation geodesic ... See more keywords