scholarly journals Research on Comparison of LiDAR and Camera in Autonomous Driving

2021 ◽  
Vol 2093 (1) ◽  
pp. 012032
Author(s):  
Peide Wang
Keyword(s):  
Decision Making ◽  
Autonomous Vehicles ◽  
Autonomous Driving ◽  
Environmental Perception ◽  
Information Collection ◽  
Digital Signals ◽  
Perception System ◽  
Key Technologies ◽  
And Control ◽  
Research Hotspots

Abstract With the improvement of vehicles automation, autonomous vehicles become one of the research hotspots. Key technologies of autonomous vehicles mainly include perception, decision-making, and control. Among them, the environmental perception system, which can convert the physical world’s information collection into digital signals, is the basis of the hardware architecture of autonomous vehicles. At present, there are two major schools in the field of environmental perception: camera which is dominated by computer vision and LiDAR. This paper analyzes and compares the two majors schools in the field of environmental perception and concludes that multi-sensor fusion is the solution for future autonomous driving.

scholarly journals Deep Learning Based Data Fusion for Sensor Fault Diagnosis and Tolerance in Autonomous Vehicles

2020 ◽  
Author(s):  
Huihui Pan ◽  
Weichao Sun ◽  
Qiming Sun ◽  
Huijun Gao
Keyword(s):  
Fault Diagnosis ◽  
Data Fusion ◽  
Real Time ◽  
Autonomous Vehicles ◽  
Autonomous Driving ◽  
Environmental Perception ◽  
Sensor Data ◽  
Time Data ◽  
Multiple Sensors ◽  
Perception System

Abstract Environmental perception is one of the key technologies to realize autonomous vehicles. Autonomous vehicles are often equipped with multiple sensors to form a multi-source environmental perception system. Those sensors are very sensitive to light or background conditions, which will introduce a variety of global and local fault signals that bring great safety risks to autonomous driving system during long-term running. In this paper, a real-time data fusion network with fault diagnosis and fault tolerance mechanism is designed. By introducing prior features to realize the lightweight of the backbone network, the features of the input data can be extracted in real time accurately. Through the temporal and spatial correlation between sensor data, the sensor redundancy is utilized to diagnose the local and global condence of sensor data in real time, eliminate the fault data, and ensure the accuracy and reliability of data fusion. Experiments show that the network achieves the state-of-the-art results in speed and accuracy, and can accurately detect the location of the target when some sensors are out of focus or out of order.

scholarly journals Hybrid Verification Technique for Decision-Making of Self-Driving Vehicles

2021 ◽  
Vol 10 (3) ◽  
pp. 42
Author(s):  
Mohammed Al-Nuaimi ◽  
Sapto Wibowo ◽  
Hongyang Qu ◽  
Jonathan Aitken ◽  
Sandor Veres
Keyword(s):  
Decision Making ◽  
Autonomous Vehicle ◽  
Autonomous Driving ◽  
Practical Implementation ◽  
Model Checker ◽  
Multi Agent Systems ◽  
Time Operation ◽  
Bdi Agent ◽  
Perception System ◽  
Probability Of Success

The evolution of driving technology has recently progressed from active safety features and ADAS systems to fully sensor-guided autonomous driving. Bringing such a vehicle to market requires not only simulation and testing but formal verification to account for all possible traffic scenarios. A new verification approach, which combines the use of two well-known model checkers: model checker for multi-agent systems (MCMAS) and probabilistic model checker (PRISM), is presented for this purpose. The overall structure of our autonomous vehicle (AV) system consists of: (1) A perception system of sensors that feeds data into (2) a rational agent (RA) based on a belief–desire–intention (BDI) architecture, which uses a model of the environment and is connected to the RA for verification of decision-making, and (3) a feedback control systems for following a self-planned path. MCMAS is used to check the consistency and stability of the BDI agent logic during design-time. PRISM is used to provide the RA with the probability of success while it decides to take action during run-time operation. This allows the RA to select movements of the highest probability of success from several generated alternatives. This framework has been tested on a new AV software platform built using the robot operating system (ROS) and virtual reality (VR) Gazebo Simulator. It also includes a parking lot scenario to test the feasibility of this approach in a realistic environment. A practical implementation of the AV system was also carried out on the experimental testbed.

Development and Testing of an Autonomous Driving Module for Critical Driving Conditions

2008 ◽  
Author(s):  
Francesco Biral ◽  
Enrico Bertolazzi ◽  
Daniele Bortoluzzi ◽  
Paolo Bosetti
Keyword(s):  
Autonomous Vehicles ◽  
Gasoline Engine ◽  
Autonomous Driving ◽  
Great Effort ◽  
Control Laws ◽  
Test Platform ◽  
High Level ◽  
And Control ◽  
Nonlinear Receding Horizon Control ◽  
High Range

In the last years a great effort has been devoted to the development of autonomous vehicles able to drive in a high range of speeds in semi-structured and unstructured environments. This article presents and discusses the software framework for Hardware-In-the-Loop (HIL) and Software-In-the-Loop (SIL) analysis that has been designed for developing and testing of control laws and mission functionalities of semi-autonomous and autonomous vehicles. The ultimate goal of this project is to develop a robotic system, named RUMBy, able to autonomously plan and execute accurate optimal manoeuvres both in normal and in critical driving situations and to be used as a test platform for advanced decision and autonomous driving algorithms. RUMBy’s hardware is a 1:6 scale gasoline engine R/C car with onboard telemetry and control systems. RUMBy’s software consists of three main modules: the manager module that coordinates the other modules and take high level decision; the motion planner module which is based on a Nonlinear Receding Horizon Control (NRHC) algorithm; the actuation module that produces the driving command for the vehicle. The article describes the details of RUMBy architecture and discusses its modular configuration that easily allows HIL and SIL tests.

scholarly journals Algorithmic Decision-Making in AVs: Understanding Ethical and Technical Concerns for Smart Cities

2019 ◽  
Vol 11 (20) ◽  
pp. 5791 ◽  
Author(s):  
Hazel Si Min Lim ◽  
Araz Taeihagh
Keyword(s):  
Decision Making ◽  
Autonomous Vehicles ◽  
Ethical Issues ◽  
Smart Cities ◽  
Environmental Benefits ◽  
Sustainable Cities ◽  
Safety Risks ◽  
Verification Methods ◽  
Perverse Incentives ◽  
And Control

Autonomous Vehicles (AVs) are increasingly embraced around the world to advance smart mobility and more broadly, smart, and sustainable cities. Algorithms form the basis of decision-making in AVs, allowing them to perform driving tasks autonomously, efficiently, and more safely than human drivers and offering various economic, social, and environmental benefits. However, algorithmic decision-making in AVs can also introduce new issues that create new safety risks and perpetuate discrimination. We identify bias, ethics, and perverse incentives as key ethical issues in the AV algorithms’ decision-making that can create new safety risks and discriminatory outcomes. Technical issues in the AVs’ perception, decision-making and control algorithms, limitations of existing AV testing and verification methods, and cybersecurity vulnerabilities can also undermine the performance of the AV system. This article investigates the ethical and technical concerns surrounding algorithmic decision-making in AVs by exploring how driving decisions can perpetuate discrimination and create new safety risks for the public. We discuss steps taken to address these issues, highlight the existing research gaps and the need to mitigate these issues through the design of AV’s algorithms and of policies and regulations to fully realise AVs’ benefits for smart and sustainable cities.

scholarly journals Autonomous Driving—A Crash Explained in Detail

2019 ◽  
Vol 9 (23) ◽  
pp. 5126 ◽  
Author(s):  
Betz ◽  
Heilmeier ◽  
Wischnewski ◽  
Stahl ◽  
Lienkamp
Keyword(s):  
Autonomous Vehicles ◽  
Autonomous Vehicle ◽  
Autonomous Driving ◽  
Software Test ◽  
Planning And Control ◽  
Modular Software ◽  
Fatal Crash ◽  
Detailed Explanation ◽  
A Minor ◽  
And Control

Since 2017, a research team from the Technical University of Munich has developed a software stack for autonomous driving. The software was used to participate in the Roborace Season Alpha Championship. The championship aims to achieve autonomous race cars competing with different software stacks against each other. In May 2019, during a software test in Modena, Italy, the greatest danger in autonomous driving became reality: A minor change in environmental influences led an extensively tested software to crash into a barrier at speed. Crashes with autonomous vehicles have happened before but a detailed explanation of why software failed and what part of the software was not working correctly is missing in research articles. In this paper we present a general method that can be used to display an autonomous vehicle disengagement to explain in detail what happened. This method is then used to display and explain the crash from Modena. Firstly a brief introduction into the modular software stack that was used in the Modena event, consisting of three individual parts—perception, planning, and control—is given. Furthermore, the circumstancescausing the crash are elaborated in detail. By presented and explaining in detail which softwarepart failed and contributed to the crash we can discuss further software improvements. As a result, we present necessary functions that need to be integrated in an autonomous driving software stack to prevent such a vehicle behavior causing a fatal crash. In addition we suggest an enhancement of the current disengagement reports for autonomous driving regarding a detailed explanation of the software part that was causing the disengagement. In the outlook of this paper we present two additional software functions for assessing the tire and control performance of the vehicle to enhance the autonomous.

scholarly journals Deep, Consistent Behavioral Decision Making with Planning Features for Autonomous Vehicles

Electronics ◽  
2019 ◽  
Vol 8 (12) ◽  
pp. 1492 ◽  
Author(s):  
Lilin Qian ◽  
Xin Xu ◽  
Yujun Zeng ◽  
Junwen Huang
Keyword(s):  
Decision Making ◽  
Path Planning ◽  
Optimal Policy ◽  
Autonomous Vehicles ◽  
Partial Information ◽  
Strong Dependence ◽  
Autonomous Driving ◽  
Gradient Algorithm ◽  
Main Trend ◽  
Behavioral Decision

Autonomous driving promises to be the main trend in the future intelligent transportation systems due to its potentiality for energy saving, and traffic and safety improvements. However, traditional autonomous vehicles’ behavioral decisions face consistency issues between behavioral decision and trajectory planning and shows a strong dependence on the human experience. In this paper, we present a planning-feature-based deep behavior decision method (PFBD) for autonomous driving in complex, dynamic traffic. We used a deep reinforcement learning (DRL) learning framework with the twin delayed deep deterministic policy gradient algorithm (TD3) to exploit the optimal policy. We took into account the features of topological routes in the decision making of autonomous vehicles, through which consistency between decision making and path planning layers can be guaranteed. Specifically, the features of a route extracted from path planning space are shared as the input states for the behavioral decision. The actor-network learns a near-optimal policy from the feasible and safe candidate emulated routes. Simulation tests on three typical scenarios have been performed to demonstrate the performance of the learning policy, including the comparison with a traditional rule-based expert algorithm and the comparison with the policy considering partial information of a contour. The results show that the proposed approach can achieve better decisions. Real-time test on an HQ3 (HongQi the third ) autonomous vehicle also validated the effectiveness of PFBD.

scholarly journals End-to-End Deep Neural Network Architectures for Speed and Steering Wheel Angle Prediction in Autonomous Driving

Electronics ◽  
2021 ◽  
Vol 10 (11) ◽  
pp. 1266
Author(s):  
Pedro J. Navarro ◽  
Leanne Miller ◽  
Francisca Rosique ◽  
Carlos Fernández-Isla ◽  
Alberto Gila-Navarro
Keyword(s):  
Autonomous Vehicles ◽  
High Performance ◽  
Autonomous Driving ◽  
Optimization Process ◽  
Mixed Data ◽  
Steering Wheel ◽  
Driver Assistance Systems ◽  
Convolutional Networks ◽  
Perception System ◽  
End To End

The complex decision-making systems used for autonomous vehicles or advanced driver-assistance systems (ADAS) are being replaced by end-to-end (e2e) architectures based on deep-neural-networks (DNN). DNNs can learn complex driving actions from datasets containing thousands of images and data obtained from the vehicle perception system. This work presents the classification, design and implementation of six e2e architectures capable of generating the driving actions of speed and steering wheel angle directly on the vehicle control elements. The work details the design stages and optimization process of the convolutional networks to develop six e2e architectures. In the metric analysis the architectures have been tested with different data sources from the vehicle, such as images, XYZ accelerations and XYZ angular speeds. The best results were obtained with a mixed data e2e architecture that used front images from the vehicle and angular speeds to predict the speed and steering wheel angle with a mean error of 1.06%. An exhaustive optimization process of the convolutional blocks has demonstrated that it is possible to design lightweight e2e architectures with high performance more suitable for the final implementation in autonomous driving.

scholarly journals Clothoid: An Integrated Hierarchical Framework for Autonomous Driving in a Dynamic Urban Environment

Sensors ◽  
2020 ◽  
Vol 20 (18) ◽  
pp. 5053 ◽  
Author(s):  
Saba Arshad ◽  
Muhammad Sualeh ◽  
Dohyeong Kim ◽  
Dinh Van Nam ◽  
Gon-Woo Kim
Keyword(s):  
Path Planning ◽  
Autonomous Vehicles ◽  
Autonomous Vehicle ◽  
Autonomous Driving ◽  
Unified Framework ◽  
Human Errors ◽  
Safe Driving ◽  
Planning And Control ◽  
Starting Point ◽  
And Control

In recent years, research and development of autonomous driving technology have gained much interest. Many autonomous driving frameworks have been developed in the past. However, building a safely operating fully functional autonomous driving framework is still a challenge. Several accidents have been occurred with autonomous vehicles, including Tesla and Volvo XC90, resulting in serious personal injuries and death. One of the major reasons is the increase in urbanization and mobility demands. The autonomous vehicle is expected to increase road safety while reducing road accidents that occur due to human errors. The accurate sensing of the environment and safe driving under various scenarios must be ensured to achieve the highest level of autonomy. This research presents Clothoid, a unified framework for fully autonomous vehicles, that integrates the modules of HD mapping, localization, environmental perception, path planning, and control while considering the safety, comfort, and scalability in the real traffic environment. The proposed framework enables obstacle avoidance, pedestrian safety, object detection, road blockage avoidance, path planning for single-lane and multi-lane routes, and safe driving of vehicles throughout the journey. The performance of each module has been validated in K-City under multiple scenarios where Clothoid has been driven safely from the starting point to the goal point. The vehicle was one of the top five to successfully finish the autonomous vehicle challenge (AVC) in the Hyundai AVC.

Research on Integrated Decision Control Algorithm for Autonomous Vehicles Under Multi-Task Hybrid Constraints in Intelligent Transportation Scenarios

2022 ◽  
Author(s):  
Zonghuan Guo ◽  
Dihua Sun ◽  
Lin Zhou
Keyword(s):  
Decision Making ◽  
Autonomous Vehicles ◽  
Control Algorithm ◽  
Process Analysis ◽  
Autonomous Driving ◽  
Test Method ◽  
Control Effect ◽  
Simulation Test ◽  
Intelligent Decision Making ◽  
Integrated Decision Making

In order to improve the decision-making and control effect of autonomous vehicles, in this paper, combined with literature research and process analysis, the control algorithm of autopilot vehicle is analyzed, and the driving process is analyzed combined with the flow method. In order to improve the effect of autonomous driving, with the support of improved algorithms, an integrated decision-making control system for autonomous vehicles under multi-task constraints in intelligent traffic scenarios is constructed, and system performance is improved by simulating autonomous driving decisions in a variety of complex situations. Moreover, this paper designs the road driving model according to actual needs, sets the functional modules of the entire system, and build the overall framework of the system. Finally, in order to study the integrated decision-making effect of this system, this paper conducts test research by designing a simulation test method. From the simulation test results, it can be seen that the intelligent decision-making system for autonomous vehicles constructed in this paper has certain effects.

scholarly journals Intention-Aware Autonomous Driving Decision-Making in an Uncontrolled Intersection

2016 ◽  
Vol 2016 ◽  
pp. 1-15 ◽  
Author(s):  
Weilong Song ◽  
Guangming Xiong ◽  
Huiyan Chen
Keyword(s):  
Decision Making ◽  
Autonomous Vehicles ◽  
Driving Simulator ◽  
Autonomous Vehicle ◽  
Transition Process ◽  
Autonomous Driving ◽  
Driving Safety ◽  
Time Step ◽  
Reward Function ◽  
Pass Through

Autonomous vehicles need to perform social accepted behaviors in complex urban scenarios including human-driven vehicles with uncertain intentions. This leads to many difficult decision-making problems, such as deciding a lane change maneuver and generating policies to pass through intersections. In this paper, we propose an intention-aware decision-making algorithm to solve this challenging problem in an uncontrolled intersection scenario. In order to consider uncertain intentions, we first develop a continuous hidden Markov model to predict both the high-level motion intention (e.g., turn right, turn left, and go straight) and the low level interaction intentions (e.g., yield status for related vehicles). Then a partially observable Markov decision process (POMDP) is built to model the general decision-making framework. Due to the difficulty in solving POMDP, we use proper assumptions and approximations to simplify this problem. A human-like policy generation mechanism is used to generate the possible candidates. Human-driven vehicles’ future motion model is proposed to be applied in state transition process and the intention is updated during each prediction time step. The reward function, which considers the driving safety, traffic laws, time efficiency, and so forth, is designed to calculate the optimal policy. Finally, our method is evaluated in simulation with PreScan software and a driving simulator. The experiments show that our method could lead autonomous vehicle to pass through uncontrolled intersections safely and efficiently.

Sign in / Sign up

Export Citation Format

Share Document