RMAN: Relational multi-head attention neural network for joint extraction of entities and relations
Sign Up to like & getrecommendations! Published in 2022 at "Applied Intelligence"
DOI: 10.1007/s10489-021-02600-2
Abstract: The task of extracting entities and relations has evolved from distributed extraction to joint extraction. The joint model overcomes the disadvantages of distributed extraction method and strengthens the information interaction between entities and relations. However,… read more here.
Keywords: extraction entities; joint extraction; attention; entities relations ... See more keywords
Hierarchical multi-head attention LSTM for polyphonic symbolic melody generation
Sign Up to like & getrecommendations! Published in 2024 at "Multimedia Tools and Applications"
DOI: 10.1007/s11042-024-18491-7
Abstract: Creating symbolic melodies with machine learning is challenging because it requires an understanding of musical structure and the handling of inter-dependencies and long-term dependencies. Learning the relationship between events that occur far apart in time… read more here.
Keywords: polyphonic symbolic; hierarchical multi; attention lstm; head attention ... See more keywords
On the diversity of multi-head attention
Sign Up to like & getrecommendations! Published in 2021 at "Neurocomputing"
DOI: 10.1016/j.neucom.2021.04.038
Abstract: Abstract Multi-head attention is appealing for the ability to jointly attend to information from different representation subspaces at different positions. In this work, we propose two approaches to better exploit such diversity for multi-head attention,… read more here.
Keywords: attention; diversity multi; head; head attention ... See more keywords
Intelligent Bearing Fault Diagnosis Using Multi-Head Attention-Based CNN
Sign Up to like & getrecommendations! Published in 2020 at "Procedia Manufacturing"
DOI: 10.1016/j.promfg.2020.07.005
Abstract: Abstract Aiming at automatic feature extraction and fault recognition of rolling bearings, a new data-driven intelligent fault diagnosis approach using multi-head attention and convolutional neural network (CNN) is proposed. Firstly, a simple signal-to-image spatial transform… read more here.
Keywords: fault; multi head; diagnosis; bearing fault ... See more keywords
Performance prediction of sintered NdFeB magnet using multi-head attention regression models
Sign Up to like & getrecommendations! Published in 2024 at "Scientific Reports"
DOI: 10.1038/s41598-024-79435-7
Abstract: The preparation of sintered NdFeB magnets is complex, time-consuming, and costly. Data-driven machine learning methods can enhance the efficiency of material synthesis and performance optimization. Traditional machine learning models based on mathematical and statistical principles… read more here.
Keywords: attention; ndfeb magnet; head attention; sintered ndfeb ... See more keywords
A deep learning model for prediction of lysine crotonylation sites by fusing multi-features based on multi-head self-attention mechanism
Sign Up to like & getrecommendations! Published in 2025 at "Scientific Reports"
DOI: 10.1038/s41598-025-04058-5
Abstract: Lysine crotonylation (Kcr) is an important post-translational modification, which is present in both histone and non-histone proteins, and plays a key role in a variety of biological processes such as metabolism and cell differentiation. Therefore,… read more here.
Keywords: deep learning; lysine crotonylation; fusing multi; language ... See more keywords
A multi-head YOLOv12 with self-supervised pretraining for urinary sediment particle detection
Sign Up to like & getrecommendations! Published in 2025 at "Scientific Reports"
DOI: 10.1038/s41598-025-25339-z
Abstract: Automatic and reliable urine sediment analysis is essential for timely diagnosis and management of renal and urinary disorders. However, manual methods are time-consuming, subjective, and limited by operator abilities. In this study, we propose a… read more here.
Keywords: detection; self supervised; sediment; head yolov12 ... See more keywords
Heuristically enhanced multi-head attention based recurrent neural network for denial of wallet attacks detection on serverless computing environment
Sign Up to like & getrecommendations! Published in 2025 at "Scientific Reports"
DOI: 10.1038/s41598-025-87636-x
Abstract: Denial of Wallet (DoW) attacks are a cyber threat designed to utilize and deplete an organization’s financial resources by generating excessive prices or charges in their cloud computing (CC) and serverless computing platforms. These threats… read more here.
Keywords: detection; denial wallet; serverless computing; serverless ... See more keywords
Enhanced Mamba model with multi-head attention mechanism and learnable scaling parameters for remaining useful life prediction
Sign Up to like & getrecommendations! Published in 2025 at "Scientific Reports"
DOI: 10.1038/s41598-025-91815-1
Abstract: Prognostics and health management (PHM) technology aims to analyze and diagnose the state of equipment using a large amount of data, predict potential failures, and adopt corresponding maintenance and repair strategies to enhance equipment reliability,… read more here.
Keywords: attention mechanism; prediction; model; head attention ... See more keywords
An intelligent ransomware based cyberthreat detection model using multi head attention-based recurrent neural networks with optimization algorithm in IoT environment
Sign Up to like & getrecommendations! Published in 2025 at "Scientific Reports"
DOI: 10.1038/s41598-025-92711-4
Abstract: The rapid growth of the Internet of Things (IoT) and its extensive use in many regions, such as smart homes, healthcare, and vehicles, have made IoT security increasingly critical. Ransomware is an advanced and adjustable… read more here.
Keywords: ransomware; model; head attention; ransomware detection ... See more keywords
Multi-head spatial atomic layer deposition: a robust approach for precise doping and nanolaminate fabrication in open-air environments.
Sign Up to like & getrecommendations! Published in 2025 at "Nanoscale"
DOI: 10.1039/d5nr01812a
Abstract: Open-air manufacture of functional nanolaminates demands rapid and scalable methods that maintain nanoscale precision across individual layers. Conventional spatial atomic layer deposition (SALD) employs a single deposition head, and the concurrent exposure to mutually reactive… read more here.
Keywords: layer; open air; deposition; head ... See more keywords