Spotting words in silent speech videos: a retrieval-based approach
Sign Up to like & getrecommendations! Published in 2019 at "Machine Vision and Applications"
DOI: 10.1007/s00138-019-01006-y
Abstract: Our goal is to spot words in silent speech videos without explicitly recognizing the spoken words, where the lip motion of the speaker is clearly visible and audio is absent. Existing work in this domain… read more here.
Keywords: word; words silent; speech; speech videos ... See more keywords
Silent Speech Interface With Vocal Speaker Assistance Based on Convolution-Augmented Transformer
Sign Up to like & getrecommendations! Published in 2023 at "IEEE Transactions on Instrumentation and Measurement"
DOI: 10.1109/tim.2023.3273660
Abstract: Silent Speech Interface (SSI) based on neuromuscular signals has become popular in Human–Computer Interaction. Articulatory neuromuscular activity can be captured with surface electromyography (sEMG). However, in the absence of acoustic sounds, it remains challenging to… read more here.
Keywords: speech interface; speech; vocal speaker; silent speech ... See more keywords
Recent results in silent speech interfaces
Sign Up to like & getrecommendations! Published in 2017 at "Journal of the Acoustical Society of America"
DOI: 10.1121/1.4987881
Abstract: Silent Speech Interfaces (SSI) are sensor-based communication systems in which a speaker articulates normally but does not activate their vocal chords, creating a natural user interface that does not disturb the ambient audio environment or… read more here.
Keywords: speech; results silent; silent speech; recent results ... See more keywords
Design and Evaluation of a Silent Speech-Based Selection Method for Eye-Gaze Pointing
Sign Up to like & getrecommendations! Published in 2022 at "Proceedings of the ACM on Human-Computer Interaction"
DOI: 10.1145/3567723
Abstract: We investigate silent speech as a hands-free selection method in eye-gaze pointing. We first propose a stripped-down image-based model that can recognize a small number of silent commands almost as fast as state-of-the-art speech recognition… read more here.
Keywords: speech; silent speech; method; eye gaze ... See more keywords