Multimodal Drowsiness Detection Using HM-LSTM Network

Author(s):  
Siddharth Sharma ◽  
Ranit Dua ◽  
Aniket ◽  
Vinod Kumar
Author(s):  
Prasanna Lakshmi Kompalli ◽  
Padma Vallakati ◽  
Ganapathi Raju Nadimpalli ◽  
Vinod Mahesh Jain ◽  
Samuel Annepogu

Background: Road accidents are major cause of deaths worldwide. This is enormously due to fatigue, drowsiness and microsleep of the drivers. This don’t just risk the life of driver and copassengers but also a great threat to the vehicles and humans moving around that vehicle. Methods: Research, online content and previously published paper related to drowsiness are reviewed. Using the facial landmarks DAT file, the prototype will locate and get the eye coordinates and it will calculate Eye Aspect Ratio (EAR). The EAR indicates whether the driver is drowsy or not based on the result various sensors gets activated such as Alarm generator, LED Indicators, LCD message scroll, message sent to owner and engine gets locked. Results: The prototype is able to locate eyes in the frame and detect whether the person is sleepy or not. Whenever the person is feeling drowsy alarm gets generated in the cabinet on further if the person is feeling drowsy, LED indicators will start glowing, messaging will be scrolling at the rear part of vehicle so that other vehicles and humans gets cautioned and vehicle slows down and engine gets locked. Conclusion: This prototype will help in reduction of road accidents due to human intervention. It is not only helpful to the person who install it in their vehicles but also for the other vehicles and humans moving around it.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Abdulkadir Tasdelen ◽  
Baha Sen

AbstractmiRNAs (or microRNAs) are small, endogenous, and noncoding RNAs construct of about 22 nucleotides. Cumulative evidence from biological experiments shows that miRNAs play a fundamental and important role in various biological processes. Therefore, the classification of miRNA is a critical problem in computational biology. Due to the short length of mature miRNAs, many researchers are working on precursor miRNAs (pre-miRNAs) with longer sequences and more structural features. Pre-miRNAs can be divided into two groups as mirtrons and canonical miRNAs in terms of biogenesis differences. Compared to mirtrons, canonical miRNAs are more conserved and easier to be identified. Many existing pre-miRNA classification methods rely on manual feature extraction. Moreover, these methods focus on either sequential structure or spatial structure of pre-miRNAs. To overcome the limitations of previous models, we propose a nucleotide-level hybrid deep learning method based on a CNN and LSTM network together. The prediction resulted in 0.943 (%95 CI ± 0.014) accuracy, 0.935 (%95 CI ± 0.016) sensitivity, 0.948 (%95 CI ± 0.029) specificity, 0.925 (%95 CI ± 0.016) F1 Score and 0.880 (%95 CI ± 0.028) Matthews Correlation Coefficient. When compared to the closest results, our proposed method revealed the best results for Acc., F1 Score, MCC. These were 2.51%, 1.00%, and 2.43% higher than the closest ones, respectively. The mean of sensitivity ranked first like Linear Discriminant Analysis. The results indicate that the hybrid CNN and LSTM networks can be employed to achieve better performance for pre-miRNA classification. In future work, we study on investigation of new classification models that deliver better performance in terms of all the evaluation criteria.


2021 ◽  
Vol 13 (12) ◽  
pp. 6953
Author(s):  
Yixing Du ◽  
Zhijian Hu

Data-driven methods using synchrophasor measurements have a broad application prospect in Transient Stability Assessment (TSA). Most previous studies only focused on predicting whether the power system is stable or not after disturbance, which lacked a quantitative analysis of the risk of transient stability. Therefore, this paper proposes a two-stage power system TSA method based on snapshot ensemble long short-term memory (LSTM) network. This method can efficiently build an ensemble model through a single training process, and employ the disturbed trajectory measurements as the inputs, which can realize rapid end-to-end TSA. In the first stage, dynamic hierarchical assessment is carried out through the classifier, so as to screen out credible samples step by step. In the second stage, the regressor is used to predict the transient stability margin of the credible stable samples and the undetermined samples, and combined with the built risk function to realize the risk quantification of transient angle stability. Furthermore, by modifying the loss function of the model, it effectively overcomes sample imbalance and overlapping. The simulation results show that the proposed method can not only accurately predict binary information representing transient stability status of samples, but also reasonably reflect the transient safety risk level of power systems, providing reliable reference for the subsequent control.


Agriculture ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. 359
Author(s):  
Kai Ye ◽  
Yangheran Piao ◽  
Kun Zhao ◽  
Xiaohui Cui

Forecasting the prices of hogs has always been a popular field of research. Such information has played an essential role in decision-making for farmers, consumers, corporations, and governments. It is hard to predict hog prices because too many factors can influence them. Some of the factors are easy to quantify, but some are not. Capturing the characteristics behind the price data is also tricky considering their non-linear and non-stationary nature. To address these difficulties, we propose Heterogeneous Graph-enhanced LSTM (HGLTSM), which is a method that predicts weekly hog price. In this paper, we first extract the historical prices of necessary agricultural products in recent years. Then, we utilize discussions from the online professional community to build heterogeneous graphs. These graphs have rich information of both discussions and the engaged users. Finally, we construct HGLSTM to make the prediction. The experimental results demonstrate that forum discussions are beneficial to hog price prediction. Moreover, our method exhibits a better performance than existing methods.


Sign in / Sign up

Export Citation Format

Share Document