scholarly journals Hybrid Multi-Sensor Integration for Static or Dynamic Obstacle Detection, Tracking and Classification for Autonomous Vehicle

2021 ◽  
Vol 23 (06) ◽  
pp. 1288-1293
Author(s):  
Dr. S. Rajkumar ◽  
◽  
Aklilu Teklemariam ◽  
Addisalem Mekonnen ◽  
◽  
...  
Keyword(s):  
Object Detection ◽  
Real Time ◽  
Autonomous Vehicles ◽  
Detection System ◽  
Autonomous Vehicle ◽  
Obstacle Detection ◽  
Multiple Sensors ◽  
Environment Perception ◽  
Hybrid Sensors ◽  
The Individual

Autonomous Vehicles (AV) reduces human intervention by perceiving the vehicle’s location with respect to the environment. In this regard, utilization of multiple sensors corresponding to various features of environment perception yields not only detection but also enables tracking and classification of the object leading to high security and reliability. Therefore, we propose to deploy hybrid multi-sensors such as Radar, LiDAR, and camera sensors. However, the data acquired with these hybrid sensors overlaps with the wide viewing angles of the individual sensors, and hence convolutional neural network and Kalman Filter (KF) based data fusion framework was implemented with a goal to facilitate a robust object detection system to avoid collisions inroads. The complete system tested over 1000 road scenarios for real-time environment perception showed that our hardware and software configurations outperformed numerous other conventional systems. Hence, this system could potentially find its application in object detection, tracking, and classification in a real-time environment.

scholarly journals Real-Time Hybrid Multi-Sensor Fusion Framework for Perception in Autonomous Vehicles

Sensors ◽  
2019 ◽  
Vol 19 (20) ◽  
pp. 4357 ◽  
Author(s):  
Babak Shahian Jahromi ◽  
Theja Tulabandhula ◽  
Sabri Cetin
Keyword(s):  
Real Time ◽  
Sensor Fusion ◽  
Autonomous Vehicles ◽  
Autonomous Vehicle ◽  
Obstacle Detection ◽  
Sensor Data ◽  
Detection Accuracy ◽  
System Solution ◽  
Environment Perception ◽  
Fusion Framework

There are many sensor fusion frameworks proposed in the literature using different sensors and fusion methods combinations and configurations. More focus has been on improving the accuracy performance; however, the implementation feasibility of these frameworks in an autonomous vehicle is less explored. Some fusion architectures can perform very well in lab conditions using powerful computational resources; however, in real-world applications, they cannot be implemented in an embedded edge computer due to their high cost and computational need. We propose a new hybrid multi-sensor fusion pipeline configuration that performs environment perception for autonomous vehicles such as road segmentation, obstacle detection, and tracking. This fusion framework uses a proposed encoder-decoder based Fully Convolutional Neural Network (FCNx) and a traditional Extended Kalman Filter (EKF) nonlinear state estimator method. It also uses a configuration of camera, LiDAR, and radar sensors that are best suited for each fusion method. The goal of this hybrid framework is to provide a cost-effective, lightweight, modular, and robust (in case of a sensor failure) fusion system solution. It uses FCNx algorithm that improve road detection accuracy compared to benchmark models while maintaining real-time efficiency that can be used in an autonomous vehicle embedded computer. Tested on over 3K road scenes, our fusion algorithm shows better performance in various environment scenarios compared to baseline benchmark networks. Moreover, the algorithm is implemented in a vehicle and tested using actual sensor data collected from a vehicle, performing real-time environment perception.

scholarly journals Computer vision based obstacle detection and target tracking for autonomous vehicles

2021 ◽  
Vol 336 ◽  
pp. 07004
Author(s):  
Ruoyu Fang ◽  
Cheng Cai
Keyword(s):  
Neural Network ◽  
Computer Vision ◽  
Deep Learning ◽  
Target Tracking ◽  
Real Time ◽  
Autonomous Vehicles ◽  
Autonomous Vehicle ◽  
Obstacle Detection ◽  
Pid Algorithm ◽  
Deep Learning Neural Network

Obstacle detection and target tracking are two major issues for intelligent autonomous vehicles. This paper proposes a new scheme to achieve target tracking and real-time obstacle detection of obstacles based on computer vision. ResNet-18 deep learning neural network is utilized for obstacle detection and Yolo-v3 deep learning neural network is employed for real-time target tracking. These two trained models can be deployed on an autonomous vehicle equipped with an NVIDIA Jetson Nano motherboard. The autonomous vehicle moves to avoid obstacles and follow tracked targets by camera. Adjusting the steering and movement of the autonomous vehicle according to the PID algorithm during the movement, therefore, will help the proposed vehicle achieve stable and precise tracking.

scholarly journals Opportunities and Challenges of Machine Vision for Navigation and Obstacle Detection in Autonomous Ground Vehicles

2019 ◽  
Vol 8 (2S8) ◽  
pp. 1598-1601
Keyword(s):  
Machine Vision ◽  
Object Detection ◽  
Traffic Congestion ◽  
Autonomous Vehicles ◽  
Autonomous Vehicle ◽  
Obstacle Detection ◽  
Conventional Vehicle ◽  
Object Detection And Tracking ◽  
Detection And Tracking ◽  
Autonomous Cars

Autonomous vehicles are the future of transport and also it is expected to become a fully-fledged reality within a decade. All the major giants in the automotive industry are hard pressing their transition from conventional vehicle to autonomous vehicles. The state of Karnataka, for instance, had approximately 205,200 registered taxis higher than Madhya Pradesh 174,900 registered cabs from 2014 to 2015. This presents a great deal of opportunities for autonomous cars and need for technologies. Autonomous cars reduces the accidents rate, stress free parking, saves time, reduces traffic congestion, improve fuel economy etc. It is so sophisticated to the level of easy prediction of physical objects, behavioural elements such as driving speed limits and driving rules between the physical world and its map. Autonomous vehicle have grown to an extent of updating its own information and also based on the cloud, benefitting the systems of all other cars on the network. Machine vision is the most crucial aspect which gives the autonomous vehicles the knowledge of its surrounding. This paper deals with the different approaches of machine vision that helps the vehicle in lane and obstacle detections. Few methods of obstacle detection like Single Object Detection and tracking (SODT) and Multiple Object Detection and tracking (MODT) are compared and contrasted in this paper. Despite the enormous advantages, there are still some challenges of autonomous which needs to be addressed. The challenges that the field will face, especially in relevance with India, along with the suggestion for improvement is also discussed.

Vision-Based Navigation of Autonomous Vehicles in Roadway Environments with Unexpected Hazards

2019 ◽  
Vol 2673 (12) ◽  
pp. 494-507 ◽  
Author(s):  
Mhafuzul Islam ◽  
Mashrur Chowdhury ◽  
Hongda Li ◽  
Hongxin Hu
Keyword(s):  
Object Detection ◽  
Autonomous Vehicles ◽  
Autonomous Vehicle ◽  
Semantic Segmentation ◽  
Steering Wheel ◽  
Potential Hazard ◽  
Driving System ◽  
Hazardous Object ◽  
Vision Based Navigation ◽  
Navigational System

Vision-based navigation of autonomous vehicles primarily depends on the deep neural network (DNN) based systems in which the controller obtains input from sensors/detectors, such as cameras, and produces a vehicle control output, such as a steering wheel angle to navigate the vehicle safely in a roadway traffic environment. Typically, these DNN-based systems in the autonomous vehicle are trained through supervised learning; however, recent studies show that a trained DNN-based system can be compromised by perturbation or adverse inputs. Similarly, this perturbation can be introduced into the DNN-based systems of autonomous vehicles by unexpected roadway hazards, such as debris or roadblocks. In this study, we first introduce a hazardous roadway environment that can compromise the DNN-based navigational system of an autonomous vehicle, and produce an incorrect steering wheel angle, which could cause crashes resulting in fatality or injury. Then, we develop a DNN-based autonomous vehicle driving system using object detection and semantic segmentation to mitigate the adverse effect of this type of hazard, which helps the autonomous vehicle to navigate safely around such hazards. We find that our developed DNN-based autonomous vehicle driving system, including hazardous object detection and semantic segmentation, improves the navigational ability of an autonomous vehicle to avoid a potential hazard by 21% compared with the traditional DNN-based autonomous vehicle driving system.

scholarly journals Rapid Foreign Object Detection System on Seaweed Using VNIR Hyperspectral Imaging

Sensors ◽  
2021 ◽  
Vol 21 (16) ◽  
pp. 5279
Author(s):  
Dong-Hoon Kwak ◽  
Guk-Jin Son ◽  
Mi-Kyung Park ◽  
Young-Duk Kim
Keyword(s):  
Object Detection ◽  
Real Time ◽  
Hyperspectral Imaging ◽  
High Speed ◽  
Detection System ◽  
Imaging Techniques ◽  
Foreign Object ◽  
Subtraction Method ◽  
Foreign Objects ◽  
Time Operation

The consumption of seaweed is increasing year by year worldwide. Therefore, the foreign object inspection of seaweed is becoming increasingly important. Seaweed is mixed with various materials such as laver and sargassum fusiforme. So it has various colors even in the same seaweed. In addition, the surface is uneven and greasy, causing diffuse reflections frequently. For these reasons, it is difficult to detect foreign objects in seaweed, so the accuracy of conventional foreign object detectors used in real manufacturing sites is less than 80%. Supporting real-time inspection should also be considered when inspecting foreign objects. Since seaweed requires mass production, rapid inspection is essential. However, hyperspectral imaging techniques are generally not suitable for high-speed inspection. In this study, we overcome this limitation by using dimensionality reduction and using simplified operations. For accuracy improvement, the proposed algorithm is carried out in 2 stages. Firstly, the subtraction method is used to clearly distinguish seaweed and conveyor belts, and also detect some relatively easy to detect foreign objects. Secondly, a standardization inspection is performed based on the result of the subtraction method. During this process, the proposed scheme adopts simplified and burdenless calculations such as subtraction, division, and one-by-one matching, which achieves both accuracy and low latency performance. In the experiment to evaluate the performance, 60 normal seaweeds and 60 seaweeds containing foreign objects were used, and the accuracy of the proposed algorithm is 95%. Finally, by implementing the proposed algorithm as a foreign object detection platform, it was confirmed that real-time operation in rapid inspection was possible, and the possibility of deployment in real manufacturing sites was confirmed.

scholarly journals Real Time Object Detection Canbe Embedded on Low Powered Devices

2019 ◽  
Author(s):  
Jimut Bahan Pal
Keyword(s):  
Neural Networks ◽  
Object Detection ◽  
Open Source ◽  
Real Time ◽  
Detection System ◽  
Computing Power ◽  
Convolution Neural Networks ◽  
Real Challenge ◽  
New Algorithms

It has been a real challenge for computers with low computing power and memory to detect objects in real time. After the invention of Convolution Neural Networks (CNN) it is easy for computers to detect images and recognize them. There are several technologies and models which can detect objects in real time, but most of them require high end technologies in terms of GPUs and TPUs. Though, recently many new algorithms and models have been proposed, which runs on low resources. In this paper we studied MobileNets to detect objects using webcam to successfully build a real time objectdetection system. We observed the pre trained model of the famous MS COCO dataset to achieve our purpose. Moreover, we applied Google’s open source TensorFlow as our back end. This real time object detection system may help in future to solve various complex vision problems.

Sign in / Sign up

Export Citation Format

Share Document