LAUSR

Existing driving fatigue detection methods rarely consider how to effectively fuse the advantages of the electroencephalogram (EEG) and electrocardiogram (ECG) signals to enhance detection performance under noise conditions. To address the issues, this article proposes a new type of the deep learning (DL) framework based on EEG and ECG called the product fuzzy convolutional network (PFCN). It should be noted that this article first investigates how to fuse EEG and ECG signals to deal with driving fatigue detection under noise conditions in both simulated and real-field driving environments. Specifically, the PFCN includes three subnetworks. The first uses a fuzzy neural network (FNN) with feedback and a product layer, effectively capturing the particularity and temporal variation of high-dimensional EEG signals and reducing the time-space complexity. The second subnetwork uses a 1-D convolution to convert the ECG data into feature sequences, providing high accuracy and low computational complexity in ECG data classification. The third subnetwork proposes a fusion-separation mechanism to effectively fuse the extracted ECG and EEG features, suppressing the noise interference and ensuring higher detection accuracy. To evaluate the performance of PFCN, a series of experiments has been set up in both simulated and real-field driving environments. The results indicate that the proposed PFCN model has better robustness and detection accuracy compared with several mainstream fatigue detection models.