Driver Monitoring of Automated Vehicles by Classification of Driver Drowsiness Using a Deep Convolutional Neural Network Trained by Scalograms of ECG Signals

Driver drowsiness is one of the leading causes of traffic accidents. This paper proposes a new method for classifying driver drowsiness using deep convolution neural networks trained by wavelet scalogram images of electrocardiogram (ECG) signals. Three different classes were defined for drowsiness based on video observation of driving tests performed in a simulator for manual and automated modes. The Bayesian optimization method is employed to optimize the hyperparameters of the designed neural networks, such as the learning rate and the number of neurons in every layer. To assess the results of the deep network method, heart rate variability (HRV) data is derived from the ECG signals, some features are extracted from this data, and finally, random forest and k-nearest neighbors (KNN) classifiers are used as two traditional methods to classify the drowsiness levels. Results show that the trained deep network achieves balanced accuracies of about 77% and 79% in the manual and automated modes, respectively. However, the best obtained balanced accuracies using traditional methods are about 62% and 64%. We conclude that designed deep networks working with wavelet scalogram images of ECG signals significantly outperform KNN and random forest classifiers which are trained on HRV-based features.

Survey on Driver Drowsiness Detection System

We proposed to use this system to minimise the frequency of accidents caused by driver exhaustion, hence improving road safety. This device uses optical information and artificial intelligence to identify driver sleepiness automatically. We use Softmax to find, monitor, and analyse the driver's face and eyes in order to calculate PERCLOS (% of eye closure). It will also employ alcohol pulse detection to determine whether or not the person is normal. Due to extended driving durations and boredom in crowded settings, driver weariness is one of the leading causes of traffic accidents, particularly for drivers of big vehicles (such as buses and heavy trucks). Keywords: Driver Drowsiness, OpenCV, TensorFlow, Image Processing, Computer Vision

EEG based Drowsiness Prediction Using Machine Learning Approach

Drowsiness is the main cause of road accidents and it leads to severe physical injury, death, and significant economic losses. To monitor driver drowsiness various methods like Behaviour measures, Vehicle measures, Physiological measures and Hybrid measures have been used in previous research. This paper mainly focuses on physiological methods to predict the driver’s drowsiness. Several physiological methods are used to predict drowsiness. Among those methods, Electroencephalography is one of the non-invasive physiological methods to measure the brain activity of the subject. EEG brain signal extracted from the human scalp is analysed with various features and used for various health application like predicting drowsiness, fatigue etc. The main objective of the proposed system is to early predict the driver drowsiness with high accuracy so that we have divided our work into two steps. The first step is to collect the publicly available dataset of EEG based Eye state as (Eye open and Eye closed) where the signal acquisition process was done from Emotiv EEG Neuroheadset (14 electrodes) and analysed various feature engineering techniques and statistical techniques. The second step was applied with the machine learning classification model as K-NN and performance-based predicting models are used. In the Existing System, they used various machine learning classification models like K-NN and SVM for EEG Eye state classification and produced results around 80% -97%. Compared to the Existing system our proposed method produced better classification models for predicting driver drowsiness using different Feature engineering process and classification models as K-NN produced 98% of accuracy.