scholarly journals Detection of Safe Passage for Trains at Rail Level Crossings Using Deep Learning

Sensors ◽  
2021 ◽  
Vol 21 (18) ◽  
pp. 6281
Author(s):  
Teresa Pamuła ◽  
Wiesław Pamuła
Keyword(s):  
Deep Learning ◽  
Control Systems ◽  
Traffic Control ◽  
Region Of Interest ◽  
Weather Conditions ◽  
The State ◽  
Video Data ◽  
Sensor Data ◽  
Level Crossings ◽  
Safety Standards

The detection of obstacles at rail level crossings (RLC) is an important task for ensuring the safety of train traffic. Traffic control systems require reliable sensors for determining the state of anRLC. Fusion of information from a number of sensors located at the site increases the capability for reacting to dangerous situations. One such source is video from monitoring cameras. This paper presents a method for processing video data, using deep learning, for the determination of the state of the area (region of interest—ROI) vital for a safe passage of the train. The proposed approach is validated using video surveillance material from a number of RLC sites in Poland. The films include 24/7 observations in all weather conditions and in all seasons of the year. Results show that the recall values reach 0.98 using significantly reduced processing resources. The solution can be used as an auxiliary source of signals for train control systems, together with other sensor data, and the fused dataset can meet railway safety standards.

scholarly journals Representation Learning for Fine-Grained Change Detection

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4486
Author(s):  
Niall O’Mahony ◽  
Sean Campbell ◽  
Lenka Krpalkova ◽  
Anderson Carvalho ◽  
Joseph Walsh ◽  
...  
Keyword(s):  
Deep Learning ◽  
Change Detection ◽  
Model Calibration ◽  
State Of The Art ◽  
Representation Learning ◽  
Machine Intelligence ◽  
The State ◽  
Sensor Data ◽  
Fine Grained ◽  
Learning Techniques

Fine-grained change detection in sensor data is very challenging for artificial intelligence though it is critically important in practice. It is the process of identifying differences in the state of an object or phenomenon where the differences are class-specific and are difficult to generalise. As a result, many recent technologies that leverage big data and deep learning struggle with this task. This review focuses on the state-of-the-art methods, applications, and challenges of representation learning for fine-grained change detection. Our research focuses on methods of harnessing the latent metric space of representation learning techniques as an interim output for hybrid human-machine intelligence. We review methods for transforming and projecting embedding space such that significant changes can be communicated more effectively and a more comprehensive interpretation of underlying relationships in sensor data is facilitated. We conduct this research in our work towards developing a method for aligning the axes of latent embedding space with meaningful real-world metrics so that the reasoning behind the detection of change in relation to past observations may be revealed and adjusted. This is an important topic in many fields concerned with producing more meaningful and explainable outputs from deep learning and also for providing means for knowledge injection and model calibration in order to maintain user confidence.

State-of-the-Art Deep Learning: Evolving Machine Intelligence Toward Tomorrow’s Intelligent Network Traffic Control Systems

2017 ◽  
Vol 19 (4) ◽  
pp. 2432-2455 ◽  
Author(s):  
Zubair Md. Fadlullah ◽  
Fengxiao Tang ◽  
Bomin Mao ◽  
Nei Kato ◽  
Osamu Akashi ◽  
...  
Keyword(s):  
Deep Learning ◽  
Control Systems ◽  
Network Traffic ◽  
Traffic Control ◽  
State Of The Art ◽  
Machine Intelligence ◽  
Intelligent Network

scholarly journals Fast body part segmentation and tracking of neonatal video data using deep learning

2020 ◽  
Vol 58 (12) ◽  
pp. 3049-3061
Author(s):  
Christoph Hoog Antink ◽  
Joana Carlos Mesquita Ferreira ◽  
Michael Paul ◽  
Simon Lyra ◽  
Konrad Heimann ◽  
...  
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Neonatal Intensive Care ◽  
Near Infrared ◽  
Data Augmentation ◽  
Region Of Interest ◽  
Semantic Segmentation ◽  
Body Part ◽  
Video Data ◽  
Computational Time

AbstractPhotoplethysmography imaging (PPGI) for non-contact monitoring of preterm infants in the neonatal intensive care unit (NICU) is a promising technology, as it could reduce medical adhesive-related skin injuries and associated complications. For practical implementations of PPGI, a region of interest has to be detected automatically in real time. As the neonates’ body proportions differ significantly from adults, existing approaches may not be used in a straightforward way, and color-based skin detection requires RGB data, thus prohibiting the use of less-intrusive near-infrared (NIR) acquisition. In this paper, we present a deep learning-based method for segmentation of neonatal video data. We augmented an existing encoder-decoder semantic segmentation method with a modified version of the ResNet-50 encoder. This reduced the computational time by a factor of 7.5, so that 30 frames per second can be processed at 960 × 576 pixels. The method was developed and optimized on publicly available databases with segmentation data from adults. For evaluation, a comprehensive dataset consisting of RGB and NIR video recordings from 29 neonates with various skin tones recorded in two NICUs in Germany and India was used. From all recordings, 643 frames were manually segmented. After pre-training the model on the public adult data, parts of the neonatal data were used for additional learning and left-out neonates are used for cross-validated evaluation. On the RGB data, the head is segmented well (82% intersection over union, 88% accuracy), and performance is comparable with those achieved on large, public, non-neonatal datasets. On the other hand, performance on the NIR data was inferior. By employing data augmentation to generate additional virtual NIR data for training, results could be improved and the head could be segmented with 62% intersection over union and 65% accuracy. The method is in theory capable of performing segmentation in real time and thus it may provide a useful tool for future PPGI applications.

Recognition of classroom student state features based on deep learning algorithms and machine learning

2020 ◽  
pp. 1-12
Author(s):  
Hu Jingchao ◽  
Haiying Zhang
Keyword(s):  
Deep Learning ◽  
Feature Recognition ◽  
Subjective Evaluation ◽  
Recognition Algorithm ◽  
Video Data ◽  
State Recognition ◽  
Detection Model ◽  
State Classification ◽  
Intelligent Models ◽  
Model Recognition

The difficulty in class student state recognition is how to make feature judgments based on student facial expressions and movement state. At present, some intelligent models are not accurate in class student state recognition. In order to improve the model recognition effect, this study builds a two-level state detection framework based on deep learning and HMM feature recognition algorithm, and expands it as a multi-level detection model through a reasonable state classification method. In addition, this study selects continuous HMM or deep learning to reflect the dynamic generation characteristics of fatigue, and designs random human fatigue recognition experiments to complete the collection and preprocessing of EEG data, facial video data, and subjective evaluation data of classroom students. In addition to this, this study discretizes the feature indicators and builds a student state recognition model. Finally, the performance of the algorithm proposed in this paper is analyzed through experiments. The research results show that the algorithm proposed in this paper has certain advantages over the traditional algorithm in the recognition of classroom student state features.

Safety assessment of biological raw materials in the system of medicines quality assurance

2020 ◽  
pp. 63-72
Author(s):  
Yu. Olefir ◽  
E. Sakanyan ◽  
I. Osipova ◽  
V. Dobrynin ◽  
M. Smirnova ◽  
...  
Keyword(s):  
Raw Materials ◽  
State Level ◽  
The State ◽  
Spongiform Encephalopathy ◽  
Safety Standards ◽  
Wide Range ◽  
The Russian Federation ◽  
Key Aspects ◽  
First Time ◽  
Medicines Quality

The entry of a wide range of biotechnological products into the pharmaceutical market calls for rein-forcement of the quality, efficacy and safety standards at the state level. The following general monographs have been elaborated for the first time to be included into the State Pharmacopoeia of the Russian Federation, XIV edition: "Viral safety" and "Reduction of the risk of transmitting animal spongiform encephalopathy via medicinal products". These general monographs were elaborated taking into account the requirements of foreign pharmacopoeias and the WHO recommendations. The present paper summarises the key aspects of the monographs.

A Study on the Auxiliary Diagnosis of Thyroid Disease Images Based on Multiple Dimensional Deep Learning Algorithms

2020 ◽  
Vol 16 (3) ◽  
pp. 199-205
Author(s):  
Yuejun Liu ◽  
Yifei Xu ◽  
Xiangzheng Meng ◽  
Xuguang Wang ◽  
Tianxu Bai
Keyword(s):  
Deep Learning ◽  
Learning Algorithms ◽  
Region Of Interest ◽  
Classification Performance ◽  
Thyroid Diseases ◽  
Great Success ◽  
Learning Models ◽  
Good Classification Performance ◽  
Spect Images

Background: Medical imaging plays an important role in the diagnosis of thyroid diseases. In the field of machine learning, multiple dimensional deep learning algorithms are widely used in image classification and recognition, and have achieved great success. Objective: The method based on multiple dimensional deep learning is employed for the auxiliary diagnosis of thyroid diseases based on SPECT images. The performances of different deep learning models are evaluated and compared. Methods: Thyroid SPECT images are collected with three types, they are hyperthyroidism, normal and hypothyroidism. In the pre-processing, the region of interest of thyroid is segmented and the amount of data sample is expanded. Four CNN models, including CNN, Inception, VGG16 and RNN, are used to evaluate deep learning methods. Results: Deep learning based methods have good classification performance, the accuracy is 92.9%-96.2%, AUC is 97.8%-99.6%. VGG16 model has the best performance, the accuracy is 96.2% and AUC is 99.6%. Especially, the VGG16 model with a changing learning rate works best. Conclusion: The standard CNN, Inception, VGG16, and RNN four deep learning models are efficient for the classification of thyroid diseases with SPECT images. The accuracy of the assisted diagnostic method based on deep learning is higher than that of other methods reported in the literature.

Human Activity Recognition using Fourier Transform Inspired Deep Learning Combination Model

2019 ◽  
Vol 9 (1) ◽  
pp. 16-31
Author(s):  
Kyungkoo Jun
Keyword(s):  
Fourier Transform ◽  
Deep Learning ◽  
Short Term Memory ◽  
Window Size ◽  
Sensor Data ◽  
Data Sets ◽  
Data Set ◽  
Proposed Model ◽  
Testing Data ◽  
Labeling Scheme

Background & Objective: This paper proposes a Fourier transform inspired method to classify human activities from time series sensor data. Methods: Our method begins by decomposing 1D input signal into 2D patterns, which is motivated by the Fourier conversion. The decomposition is helped by Long Short-Term Memory (LSTM) which captures the temporal dependency from the signal and then produces encoded sequences. The sequences, once arranged into the 2D array, can represent the fingerprints of the signals. The benefit of such transformation is that we can exploit the recent advances of the deep learning models for the image classification such as Convolutional Neural Network (CNN). Results: The proposed model, as a result, is the combination of LSTM and CNN. We evaluate the model over two data sets. For the first data set, which is more standardized than the other, our model outperforms previous works or at least equal. In the case of the second data set, we devise the schemes to generate training and testing data by changing the parameters of the window size, the sliding size, and the labeling scheme. Conclusion: The evaluation results show that the accuracy is over 95% for some cases. We also analyze the effect of the parameters on the performance.

State Estimation Using Randomly Delayed Measurements

1993 ◽  
Vol 115 (1) ◽  
pp. 19-26 ◽  
Author(s):  
A. Ray ◽  
L. W. Liou ◽  
J. H. Shen
Keyword(s):  
State Estimation ◽  
Minimum Variance ◽  
The State ◽  
Sensor Data ◽  
State Estimator ◽  
Uniform Asymptotic Stability ◽  
Simulation Experiments ◽  
State Estimate ◽  
Sampling Instant ◽  
Recursive Relations

This paper presents a modification of the conventional minimum variance state estimator to accommodate the effects of randomly varying delays in arrival of sensor data at the controller terminal. In this approach, the currently available sensor data is used at each sampling instant to obtain the state estimate which, in turn, can be used to generate the control signal. Recursive relations for the filter dynamics have been derived, and the conditions for uniform asymptotic stability of the filter have been conjectured. Results of simulation experiments using a flight dynamic model of advanced aircraft are presented for performance evaluation of the state estimation filter.

Sign in / Sign up

Export Citation Format

Share Document