Semantic‐enhanced multimodal fusion network for fake news detection
Sign Up to like & getrecommendations! Published in 2022 at "International Journal of Intelligent Systems"
DOI: 10.1002/int.23084
Abstract: The increasing popularity of social media facilitates the propagation of fake news, posing a major threat to the government and journalism, and thereby making how to detect fake news from social media an urgent requirement.… read more here.
Keywords: news; multimodal fusion; fusion network; fake news ... See more keywords
Weakly paired multimodal fusion using multilayer extreme learning machine
Sign Up to like & getrecommendations! Published in 2018 at "Soft Computing"
DOI: 10.1007/s00500-018-3108-y
Abstract: Multimodal data have recently become nearly ubiquitous in the real world. Exploring the multimodal fusion is beneficial to improve the performance of the system. However, it is difficult to ensure that data collected from different… read more here.
Keywords: multimodal fusion; extreme learning; paired multimodal; weakly paired ... See more keywords
Object affordance based multimodal fusion for natural Human-Robot interaction
Sign Up to like & getrecommendations! Published in 2019 at "Cognitive Systems Research"
DOI: 10.1016/j.cogsys.2018.12.010
Abstract: Abstract Spoken language based natural Human-Robot Interaction (HRI) requires robots to have the ability to understand spoken language, and extract the intention-related information from the working scenario. For grounding the intention-related object in the working… read more here.
Keywords: multimodal fusion; affordance; natural human; object affordance ... See more keywords
Multimodal fusion with deep neural networks for leveraging CT imaging and electronic health record: a case-study in pulmonary embolism detection
Sign Up to like & getrecommendations! Published in 2020 at "Scientific Reports"
DOI: 10.1038/s41598-020-78888-w
Abstract: Recent advancements in deep learning have led to a resurgence of medical imaging and Electronic Medical Record (EMR) models for a variety of applications, including clinical decision support, automated workflow triage, clinical prediction and more.… read more here.
Keywords: multimodal fusion; pulmonary embolism; record; imaging electronic ... See more keywords
HFBSurv: hierarchical multimodal fusion with factorized bilinear models for cancer survival prediction
Sign Up to like & getrecommendations! Published in 2022 at "Bioinformatics"
DOI: 10.1093/bioinformatics/btac113
Abstract: Abstract Motivation Cancer survival prediction can greatly assist clinicians in planning patient treatments and improving their life quality. Recent evidence suggests the fusion of multimodal data, such as genomic data and pathological images, is crucial… read more here.
Keywords: factorized bilinear; fusion; multimodal fusion; multimodal ... See more keywords
ECG Heartbeat Classification Using Multimodal Fusion
Sign Up to like & getrecommendations! Published in 2021 at "IEEE Access"
DOI: 10.1109/access.2021.3097614
Abstract: Electrocardiogram (ECG) is an authoritative source to diagnose and counter critical cardiovascular syndromes such as arrhythmia and myocardial infarction (MI). Current machine learning techniques either depend on manually extracted features or large and complex deep… read more here.
Keywords: classification using; fusion; multimodal fusion; ecg heartbeat ... See more keywords
Adaptive Multimodal Fusion With Attention Guided Deep Supervision Net for Grading Hepatocellular Carcinoma
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Journal of Biomedical and Health Informatics"
DOI: 10.1109/jbhi.2022.3161466
Abstract: Multimodal medical imaging plays a crucial role in the diagnosis and characterization of lesions. However, challenges remain in lesion characterization based on multimodal feature fusion. First, current fusion methods have not thoroughly studied the relative… read more here.
Keywords: fusion; deep supervision; multimodal fusion; attention guided ... See more keywords
MF-BERT: Multimodal Fusion in Pre-Trained BERT for Sentiment Analysis
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Signal Processing Letters"
DOI: 10.1109/lsp.2021.3139856
Abstract: Multimodal sentiment analysis mainly concentrates on language, acoustic and visual information. Previous work based on BERT utilizes only text (language) representation to fine-tune BERT, while ignoring the importance of nonverbal information. Due to the fact… read more here.
Keywords: bert; sentiment analysis; pre trained; multimodal fusion ... See more keywords
Language Reinforced Superposition Multimodal Fusion for Sentiment Analysis
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Signal Processing Letters"
DOI: 10.1109/lsp.2022.3180668
Abstract: Nowadays, BERT has been effective in context extraction and widely utilized in multimodal fusion. However, many multimodal learning systems with BERT consider different modalities equally important, which ignores the huge capability difference between the pre-trained… read more here.
Keywords: information; superposition; fusion; language ... See more keywords
Multimodal Fusion-Based Deep Learning Network for Effective Diagnosis of Alzheimer’s Disease
Sign Up to like & getrecommendations! Published in 2022 at "IEEE MultiMedia"
DOI: 10.1109/mmul.2022.3156471
Abstract: Alzheimer’s disease (AD) is a prevalent, irreversible, chronic, and degenerative disorder whose diagnosis at the prodromal stage is critical. Mostly, single modality data, such as magnetic resonance imaging (MRI) or positron emission tomography (PET), are… read more here.
Keywords: fusion based; fusion; diagnosis; alzheimer disease ... See more keywords
Multimodal Fusion for Objective Assessment of Cognitive Workload: A Review
Sign Up to like & getrecommendations! Published in 2021 at "IEEE Transactions on Cybernetics"
DOI: 10.1109/tcyb.2019.2939399
Abstract: Considerable progress has been made in improving the estimation accuracy of cognitive workload using various sensor technologies. However, the overall performance of different algorithms and methods remain suboptimal in real-world applications. Some studies in the… read more here.
Keywords: fusion objective; review; cognitive workload; workload ... See more keywords