scholarly journals Autonomous Driving Control Using the DDPG and RDPG Algorithms

2021 ◽  
Vol 11 (22) ◽  
pp. 10659
Author(s):  
Che-Cheng Chang ◽  
Jichiang Tsai ◽  
Jun-Han Lin ◽  
Yee-Ming Ooi

Recently, autonomous driving has become one of the most popular topics for smart vehicles. However, traditional control strategies are mostly rule-based, which have poor adaptability to the time-varying traffic conditions. Similarly, they have difficulty coping with unexpected situations that may occur any time in the real-world environment. Hence, in this paper, we exploited Deep Reinforcement Learning (DRL) to enhance the quality and safety of autonomous driving control. Based on the road scenes and self-driving simulation modules provided by AirSim, we used the Deep Deterministic Policy Gradient (DDPG) and Recurrent Deterministic Policy Gradient (RDPG) algorithms, combined with the Convolutional Neural Network (CNN), to realize the autonomous driving control of self-driving cars. In particular, by using the real-time images of the road provided by AirSim as the training data, we carefully formulated an appropriate reward-generation method to improve the convergence speed of the adopted DDPG and RDPG models and the control performance of moving driverless cars.

2015 ◽  
Vol 27 (6) ◽  
pp. 660-670 ◽  
Author(s):  
Udara Eshan Manawadu ◽  
◽  
Masaaki Ishikawa ◽  
Mitsuhiro Kamezaki ◽  
Shigeki Sugano ◽  
...  

<div class=""abs_img""><img src=""[disp_template_path]/JRM/abst-image/00270006/08.jpg"" width=""300"" /> Driving simulator</div>Intelligent passenger vehicles with autonomous capabilities will be commonplace on our roads in the near future. These vehicles will reshape the existing relationship between the driver and vehicle. Therefore, to create a new type of rewarding relationship, it is important to analyze when drivers prefer autonomous vehicles to manually-driven (conventional) vehicles. This paper documents a driving simulator-based study conducted to identify the preferences and individual driving experiences of novice and experienced drivers of autonomous and conventional vehicles under different traffic and road conditions. We first developed a simplified driving simulator that could connect to different driver-vehicle interfaces (DVI). We then created virtual environments consisting of scenarios and events that drivers encounter in real-world driving, and we implemented fully autonomous driving. We then conducted experiments to clarify how the autonomous driving experience differed for the two groups. The results showed that experienced drivers opt for conventional driving overall, mainly due to the flexibility and driving pleasure it offers, while novices tend to prefer autonomous driving due to its inherent ease and safety. A further analysis indicated that drivers preferred to use both autonomous and conventional driving methods interchangeably, depending on the road and traffic conditions.


2019 ◽  
Vol 1 ◽  
pp. 1-2
Author(s):  
Márton Pál ◽  
Fanni Vörös ◽  
István Elek ◽  
Béla Kovács

<p><strong>Abstract.</strong> A self-driving car is a vehicle that is able to perceive its surroundings and navigate in it without human action. Radar sensors, lasers, computer vision and GPS technologies help it to drive individually (Figure 1). They interpret the sensed information to calculate routes and navigate between obstacles and traffic elements.</p><p>Sufficiently accurate navigation and information about the current position of the vehicle are indispensable for transport. These expectations are fulfilled in the case of a human driver: the knowledge on traffic rules and signs make possible to navigate through even difficult situations. Self-driving systems substitute humans by monitoring and evaluating the surrounding environment and its objects without the background information of the driver. This analysing process is vulnerable. Sudden or unexpected situations may occur but high precision navigation and background GPS databases can complement sensor-detected data.</p><p>The assistance of global navigation has been used in cars for decades. Drivers can easily plan their routes and reach their destination by using car GPS units. However, these devices do not provide accurate positioning: there may be a difference of several metres from the real location. Self-driving cars also use navigation to complement sensor data. Although there are already autonomous system tests on motorways and countryside roads, in densely built-in areas this technology faces complications due to accuracy problems. The dilution of precision (DOP) values can be extremely high in larger settlements because high buildings may hide southern sky (where satellite signs are sensed from on our latitude).</p><p>We can achieve centimetre-level accuracy (if the conditions are ideal) with geodesic RTK (real-time kinematic) GPS systems. This high-precision position data is derived from satellite-based positioning systems. Measurements of the phase of the signal’s carrier wave are real-time corrected by a single reference or an interpolated virtual station.</p><p>In this research we use RTK GPS technology in order to work out a spatial database. These measurements can also be less precise in dense cities, but there is time during fieldwork to try to eliminate inaccuracy. We have chosen a sample area in the inner city of Budapest, Hungary where we located all traffic signs, pedestrian crossings and other important elements. As self-driving cars need precise position data of these terrain objects, we have tried to work with a maximum error of a few decimetres.</p><p>We have examined online map providers if they have feasible data structure and some base data. The implemented structure is similar to OpenStreetMap DB, in which there are already some traffic lights in important crossings. With this preliminary test database, we would like to filter out dangerous situations. If the camera of the car does not see a traffic sign because of a tree or a truck, information about it will be available from the database. If a pedestrian crossing is hardly visible and the sensor does not recognize it, the background GIS data will warn the car that there may be inattentive people on the road.</p><p>A test application has also been developed (Figure 2.), in which our Postgres/Postgis database records have been inserted. In the next phase of the project we try to test our database in the traffic. We plan to drive through the sample area and observe the GPS accuracy in the recognition of the located signs.</p><p>This research aims to achieve higher safety in the field of autonomous driving. By having a refreshable cartographic GIS database in the memory of a self-driving car, there is a smaller chance of risking human life. However, the maintenance demands a high amount of work. Because of this we should concentrate only on the most important signs. Even the cars can be able to supervise the content of the database if there is a large number of them on the road. The frequent production and analysis of point clouds is also an option to get nearer to safe automatized traffic.</p>


Author(s):  
László Orgován ◽  
Tamás Bécsi ◽  
Szilárd Aradi

Autonomous vehicles or self-driving cars are prevalent nowadays, many vehicle manufacturers, and other tech companies are trying to develop autonomous vehicles. One major goal of the self-driving algorithms is to perform manoeuvres safely, even when some anomaly arises. To solve these kinds of complex issues, Artificial Intelligence and Machine Learning methods are used. One of these motion planning problems is when the tires lose their grip on the road, an autonomous vehicle should handle this situation. Thus the paper provides an Autonomous Drifting algorithm using Reinforcement Learning. The algorithm is based on a model-free learning algorithm, Twin Delayed Deep Deterministic Policy Gradients (TD3). The model is trained on six different tracks in a simulator, which is developed specifically for autonomous driving systems; namely CARLA.


2019 ◽  
Vol 12 (2) ◽  
pp. 120-127 ◽  
Author(s):  
Wael Farag

Background: In this paper, a Convolutional Neural Network (CNN) to learn safe driving behavior and smooth steering manoeuvring, is proposed as an empowerment of autonomous driving technologies. The training data is collected from a front-facing camera and the steering commands issued by an experienced driver driving in traffic as well as urban roads. Methods: This data is then used to train the proposed CNN to facilitate what it is called “Behavioral Cloning”. The proposed Behavior Cloning CNN is named as “BCNet”, and its deep seventeen-layer architecture has been selected after extensive trials. The BCNet got trained using Adam’s optimization algorithm as a variant of the Stochastic Gradient Descent (SGD) technique. Results: The paper goes through the development and training process in details and shows the image processing pipeline harnessed in the development. Conclusion: The proposed approach proved successful in cloning the driving behavior embedded in the training data set after extensive simulations.


Author(s):  
Geetha A. ◽  
Subramani C.

<p><span>The modeling of a car is essentially done by taking into consideration the driving terrain, traffic conditions, driver’s behavior and various other factors which may directly or indirectly affect the vehicle’s performance. A vehicle is modeled for given specifications and constraints like maximum speed, maximum acceleration, and braking time, appropriate suspension for the gradient of the road and fuel consumption. Henceforth, a profound study and analysis of different drive cycles are essential. A time dependent drive cycle is a condensed form of data that helps us to determine the time taken to conduct the driving test on the road. This article highlights the development of a real driving cycle in the area of Tamilnadu, India. On-road vehicle’s speeds versus time data were obtained along the selected route. The data obtained were analyzed first and then a new driving cycle was developed.</span></p>


Worldview ◽  
1976 ◽  
Vol 19 (9) ◽  
pp. 4-9
Author(s):  
Mark A. Bruzonsky

The real crunch for Israel will probably come during 1977 if Ford is elected—it will be delayed by only a few months if a Democratic candidate wins.” So writes Wolf Blitzer, editor of the “Jewish lobby's” Washington publication Near East Report, in a recent issue of the Jerusalem Post.With the same sense of urgency Abba Eban insists that “Time is of the essence, and unhappily for us, time is running out. We ought to grasp the central issues now and involve the United States in resolving them.” He and a growing number of his colleagues fear that should Israel not choose to “cooperate” with the U.S., the Americans might run right over Israel on the road to Geneva and some form of imposed settlement.


2015 ◽  
Vol 776 ◽  
pp. 95-100
Author(s):  
I. Gusti Raka Purbanto

Motorcycle dominates traffic in Bali, particularly in urban roads, which occupy more than 85% of mode share. The three types of vehicles, i.e. motorcycles, heavy and light vehicles share the roadways together. Under mixed traffic conditions, motorcycle may be travelling in between and alongside two consecutive motor vehicles. Considering such a situation, passenger car equivalent values should be examined thoroughly. This study aims to determine passenger car equivalent (PCEs) of motorcycle at mid-block of Sesetan Road. Three approaches are used to examine the PCEs values. This study found that the PCE of motorcycles are in a range between 0.2 and 0.4. This values are about the same to the existing PCE of the Indonesian Highway Capacity Manual (1997). This study also pointed out that motorcyclists and car drivers may behave differently to the existence of motorcycles. Car drivers are more aware than motorcyclists on the existence of motorcycle on the road. Further, more samples are required to obtain comprehensive results. In addition, the presence of heavy vehicles need to be considered for future study.


Sensors ◽  
2018 ◽  
Vol 18 (9) ◽  
pp. 3145 ◽  
Author(s):  
Kichun Jo ◽  
Chansoo Kim ◽  
Myoungho Sunwoo

High Definition (HD) maps are becoming key elements of the autonomous driving because they can provide information about the surrounding environment of the autonomous car without being affected by the real-time perception limit. To provide the most recent environmental information to the autonomous driving system, the HD map must maintain up-to-date data by updating changes in the real world. This paper presents a simultaneous localization and map change update (SLAMCU) algorithm to detect and update the HD map changes. A Dempster–Shafer evidence theory is applied to infer the HD map changes based on the evaluation of the HD map feature existence. A Rao–Blackwellized particle filter (RBPF) approach is used to concurrently estimate the vehicle position and update the new map state. The detected and updated map changes by the SLAMCU are reported to the HD map database in order to reflect the changes to the HD map and share the changing information with the other autonomous cars. The SLAMCU was evaluated through experiments using the HD map of traffic signs in the real traffic conditions.


Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-17
Author(s):  
Yongchao Song ◽  
Jieru Yao ◽  
Yongfeng Ju ◽  
Yahong Jiang ◽  
Kai Du

In order to solve the problems of traffic object detection, fuzzification, and simplification in real traffic environment, an automatic detection and classification algorithm for roads, vehicles, and pedestrians with multiple traffic objects under the same framework is proposed. We construct the final V view through a considerate U-V view method, which determines the location of the horizon and the initial contour of the road. Road detection results are obtained through error label reclassification, omitting point reassignment, and so an. We propose a peripheral envelope algorithm to determine sources of vehicles and pedestrians on the road. The initial segmentation results are determined by the regional growth of the source point through the minimum neighbor similarity algorithm. Vehicle detection results on the road are confirmed by combining disparity and color energy minimum algorithms with the object window aspect ratio threshold method. A method of multifeature fusion is presented to obtain the pedestrian target area, and the pedestrian detection results on the road are accurately segmented by combining the disparity neighbor similarity and the minimum energy algorithm. The algorithm is tested in three datasets of Enpeda, KITTI, and Daimler; then, the corresponding results prove the efficiency and accuracy of the proposed approach. Meanwhile, the real-time analysis of the algorithm is performed, and the average time efficiency is 13 pfs, which can realize the real-time performance of the detection process.


Author(s):  
Jeremy J. Dawkins ◽  
Sameer G. Shah ◽  
Robert L. Jackson

This paper investigates some of the modeling techniques available for predicting the real area of contact between two surfaces. These models are then applied to an idealized case of a rubber block in contact with a rough surface representing a tire on the road. A description of how the models work is presented. The various contact models are compared and analyzed. Qualitatively the models compare very well. Several models also compare well quantitatively.


Sign in / Sign up

Export Citation Format

Share Document