scholarly journals A machine learning joint lidar and radar classification system in urban automotive scenarios

2019 ◽  
Vol 17 ◽  
pp. 129-136 ◽  
Author(s):  
Rodrigo Pérez ◽  
Falk Schubert ◽  
Ralph Rasshofer ◽  
Erwin Biebl
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Moving Objects ◽  
Region Of Interest ◽  
Radar Sensor ◽  
Test Vehicle ◽  
Road Users ◽  
Using Data ◽  
Measurement Frame ◽  
Dimensional Range

Abstract. This work presents an approach to classify road users as pedestrians, cyclists or cars using a lidar sensor and a radar sensor. The lidar is used to detect moving road users in the surroundings of the car. A 2-dimensional range-Doppler window, a so called region of interest, of the radar power spectrum centered at the object's position is cut out and fed into a convolutional neural network to be classified. With this approach it is possible to classify multiple moving objects within a single radar measurement frame. The convolutional neural network is trained using data gathered with a test vehicle in real urban scenarios. An overall classification accuracy as high as 0.91 is achieved with this approach. The accuracy can be improved to 0.94 after applying a discrete Bayes filter on top of the classifier.

An Integrated Approach for Traffic Scene Understanding from Monocular Cameras

2021 ◽  
Author(s):  
Malte Oeljeklaus
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Scene Perception ◽  
Integrated Approach ◽  
Image Features ◽  
Road Users ◽  
Environment Model ◽  
Computational Performance ◽  
Spatial Reconstruction ◽  
The Individual

This thesis investigates methods for traffic scene perception with monocular cameras for a basic environment model in the context of automated vehicles. The developed approach is designed with special attention to the computational limitations present in practical systems. For this purpose, three different scene representations are investigated. These consist of the prevalent road topology as the global scene context, the drivable road area and the detection and spatial reconstruction of other road users. An approach is developed that allows for the simultaneous perception of all environment representations based on a multi-task convolutional neural network. The obtained results demonstrate the efficiency of the multi-task approach. In particular, the effects of shareable image features for the perception of the individual scene representations were found to improve the computational performance. Contents Nomenclature VII 1 Introduction 1 1.1 Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 Outline and contributions . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 2 Related Work and Fundamental Background 8 2.1 Advances in CNN...

scholarly journals Multi-Scale Convolutional Neural Network for Accurate Corneal Segmentation in Early Detection of Fungal Keratitis

2021 ◽  
Vol 7 (10) ◽  
pp. 850
Author(s):  
Veena Mayya ◽  
Sowmya Kamath Shevgoor ◽  
Uma Kulkarni ◽  
Manali Hazarika ◽  
Prabal Datta Barua ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Region Of Interest ◽  
Cost Effective ◽  
Fungal Keratitis ◽  
Contact Lens Wear ◽  
Multi Scale ◽  
Effective Interventions ◽  
Prolonged Contact ◽  
Segmented Images

Microbial keratitis is an infection of the cornea of the eye that is commonly caused by prolonged contact lens wear, corneal trauma, pre-existing systemic disorders and other ocular surface disorders. It can result in severe visual impairment if improperly managed. According to the latest World Vision Report, at least 4.2 million people worldwide suffer from corneal opacities caused by infectious agents such as fungi, bacteria, protozoa and viruses. In patients with fungal keratitis (FK), often overt symptoms are not evident, until an advanced stage. Furthermore, it has been reported that clear discrimination between bacterial keratitis and FK is a challenging process even for trained corneal experts and is often misdiagnosed in more than 30% of the cases. However, if diagnosed early, vision impairment can be prevented through early cost-effective interventions. In this work, we propose a multi-scale convolutional neural network (MS-CNN) for accurate segmentation of the corneal region to enable early FK diagnosis. The proposed approach consists of a deep neural pipeline for corneal region segmentation followed by a ResNeXt model to differentiate between FK and non-FK classes. The model trained on the segmented images in the region of interest, achieved a diagnostic accuracy of 88.96%. The features learnt by the model emphasize that it can correctly identify dominant corneal lesions for detecting FK.

Damage Detection of Composite Materials Using Data Fusion With Deep Neural Networks

2020 ◽  
Author(s):  
Shweta Dabetwar ◽  
Stephen Ekwaro-Osire ◽  
João Paulo Dias
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Composite Materials ◽  
Data Fusion ◽  
Damage Detection ◽  
Convolutional Neural Network ◽  
Deep Neural Networks ◽  
Mixed Data ◽  
Image Encoding ◽  
Using Data

Abstract Composite materials have enormous applications in various fields. Thus, it is important to have an efficient damage detection method to avoid catastrophic failures. Due to the existence of multiple damage modes and the availability of data in different formats, it is important to employ efficient techniques to consider all the types of damage. Deep neural networks were seen to exhibit the ability to address similar complex problems. The research question in this work is ‘Can data fusion improve damage classification using the convolutional neural network?’ The specific aims developed were to 1) assess the performance of image encoding algorithms, 2) classify the damage using data from separate experimental coupons, and 3) classify the damage using mixed data from multiple experimental coupons. Two different experimental measurements were taken from NASA Ames Prognostic Repository for Carbon Fiber Reinforced polymer. To use data fusion, the piezoelectric signals were converted into images using Gramian Angular Field (GAF) and Markov Transition Field. Using data fusion techniques, the input dataset was created for a convolutional neural network with three hidden layers to determine the damage states. The accuracies of all the image encoding algorithms were compared. The analysis showed that data fusion provided better results as it contained more information on the damages modes that occur in composite materials. Additionally, GAF was shown to perform the best. Thus, the combination of data fusion and deep neural network techniques provides an efficient method for damage detection of composite materials.

scholarly journals Reinforcement learning and convolutional neural network system for firefighting rescue robot

2018 ◽  
Vol 161 ◽  
pp. 03028 ◽  
Author(s):  
Tien Kun Yu ◽  
Yang Ming Chieh ◽  
Hooman Samani
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Region Of Interest ◽  
Infrared Sensors ◽  
Sliding Windows ◽  
Q Learning ◽  
Rescue Robot ◽  
Neural Network System ◽  
The Face ◽  
Color Sensors

In this paper, we combine the machine learning and neural network to build some modules for the fire rescue robot application. In our research, we build the robot legs module with Q-learning. We also finish the face detection with color sensors and infrared sensors. It is usual that image fusion is done when we want to use two kinds of sensors. Kalman filter is chosen to meet our requirement. After we finish some indispensable steps, we use sliding windows to choose our region of interest to make the system’s calculation lower. The least step is convolutional neural network. We design a seven layers neural network to find the face feature and distinguish it or not.

scholarly journals A Deep Learning-Based Approach for the Detection of Early Signs of Gingivitis in Orthodontic Patients Using Faster Region-Based Convolutional Neural Networks

2020 ◽  
Vol 17 (22) ◽  
pp. 8447
Author(s):  
Dima M. Alalharith ◽  
Hajar M. Alharthi ◽  
Wejdan M. Alghamdi ◽  
Yasmine M. Alsenbel ◽  
Nida Aslam ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Periodontal Disease ◽  
Convolutional Neural Network ◽  
Region Of Interest ◽  
Training Dataset ◽  
Detection Accuracy ◽  
Detection Model ◽  
Art Object ◽  
Orthodontic Patients

Computer-based technologies play a central role in the dentistry field, as they present many methods for diagnosing and detecting various diseases, such as periodontitis. The current study aimed to develop and evaluate the state-of-the-art object detection and recognition techniques and deep learning algorithms for the automatic detection of periodontal disease in orthodontic patients using intraoral images. In this study, a total of 134 intraoral images were divided into a training dataset (n = 107 [80%]) and a test dataset (n = 27 [20%]). Two Faster Region-based Convolutional Neural Network (R-CNN) models using ResNet-50 Convolutional Neural Network (CNN) were developed. The first model detects the teeth to locate the region of interest (ROI), while the second model detects gingival inflammation. The detection accuracy, precision, recall, and mean average precision (mAP) were calculated to verify the significance of the proposed model. The teeth detection model achieved an accuracy, precision, recall, and mAP of 100 %, 100%, 51.85%, and 100%, respectively. The inflammation detection model achieved an accuracy, precision, recall, and mAP of 77.12%, 88.02%, 41.75%, and 68.19%, respectively. This study proved the viability of deep learning models for the detection and diagnosis of gingivitis in intraoral images. Hence, this highlights its potential usability in the field of dentistry and aiding in reducing the severity of periodontal disease globally through preemptive non-invasive diagnosis.

Sign in / Sign up

Export Citation Format

Share Document