End-to-End Learning for Autonomous Driving in Secured Smart Cities

Author(s):  
Dapeng Guo ◽  
Melody Moh ◽  
Teng-Sheng Moh
Author(s):  
Edgar Cortés Gallardo Medina ◽  
Victor Miguel Velazquez Espitia ◽  
Daniela Chípuli Silva ◽  
Sebastián Fernández Ruiz de las Cuevas ◽  
Marco Palacios Hirata ◽  
...  

Autonomous driving systems are increasingly becoming a necessary trend towards building smart cities of the future. Numerous proposals have been presented in recent years to tackle particular aspects of the working pipeline towards creating a functional end-to-end system, such as object detection, tracking, path planning, sentiment or intent detection. Nevertheless, few efforts have been made to systematically compile all of these systems into a single proposal that effectively considers the real challenges these systems will have on the road, such as real-time computation, hardware capabilities, etc. This paper has reviewed various techniques towards proposing our own end-to-end autonomous vehicle system, considering the latest state on the art on computer vision, DSs, path planning, and parallelization.


Author(s):  
Kuan-Hui Lee ◽  
Matthew Kliemann ◽  
Adrien Gaidon ◽  
Jie Li ◽  
Chao Fang ◽  
...  

2021 ◽  
Vol 740 (1) ◽  
pp. 012022
Author(s):  
A I Guseva ◽  
V S Kireev ◽  
P V Bochkarev ◽  
I A Kuznetsov ◽  
S A Filippov

Author(s):  
Baiyu Peng ◽  
Qi Sun ◽  
Shengbo Eben Li ◽  
Dongsuk Kum ◽  
Yuming Yin ◽  
...  

AbstractRecent years have seen the rapid development of autonomous driving systems, which are typically designed in a hierarchical architecture or an end-to-end architecture. The hierarchical architecture is always complicated and hard to design, while the end-to-end architecture is more promising due to its simple structure. This paper puts forward an end-to-end autonomous driving method through a deep reinforcement learning algorithm Dueling Double Deep Q-Network, making it possible for the vehicle to learn end-to-end driving by itself. This paper firstly proposes an architecture for the end-to-end lane-keeping task. Unlike the traditional image-only state space, the presented state space is composed of both camera images and vehicle motion information. Then corresponding dueling neural network structure is introduced, which reduces the variance and improves sampling efficiency. Thirdly, the proposed method is applied to The Open Racing Car Simulator (TORCS) to demonstrate its great performance, where it surpasses human drivers. Finally, the saliency map of the neural network is visualized, which indicates the trained network drives by observing the lane lines. A video for the presented work is available online, https://youtu.be/76ciJmIHMD8 or https://v.youku.com/v_show/id_XNDM4ODc0MTM4NA==.html.


2021 ◽  
Vol 11 (7) ◽  
pp. 2925
Author(s):  
Edgar Cortés Gallardo Medina ◽  
Victor Miguel Velazquez Espitia ◽  
Daniela Chípuli Silva ◽  
Sebastián Fernández Ruiz de las Cuevas ◽  
Marco Palacios Hirata ◽  
...  

Autonomous vehicles are increasingly becoming a necessary trend towards building the smart cities of the future. Numerous proposals have been presented in recent years to tackle particular aspects of the working pipeline towards creating a functional end-to-end system, such as object detection, tracking, path planning, sentiment or intent detection, amongst others. Nevertheless, few efforts have been made to systematically compile all of these systems into a single proposal that also considers the real challenges these systems will have on the road, such as real-time computation, hardware capabilities, etc. This paper reviews the latest techniques towards creating our own end-to-end autonomous vehicle system, considering the state-of-the-art methods on object detection, and the possible incorporation of distributed systems and parallelization to deploy these methods. Our findings show that while techniques such as convolutional neural networks, recurrent neural networks, and long short-term memory can effectively handle the initial detection and path planning tasks, more efforts are required to implement cloud computing to reduce the computational time that these methods demand. Additionally, we have mapped different strategies to handle the parallelization task, both within and between the networks.


Author(s):  
Wenhao Deng ◽  
Skyler Moore ◽  
Jonathan Bush ◽  
Miles Mabey ◽  
Wenlong Zhang

In recent years, researchers from both academia and industry have worked on connected and automated vehicles and they have made great progress toward bringing them into reality. Compared to automated cars, bicycles are more affordable to daily commuters, as well as more environmentally friendly. When comparing the risk posed by autonomous vehicles to pedestrians and motorists, automated bicycles are much safer than autonomous cars, which also allows potential applications in smart cities, rehabilitation, and exercise. The biggest challenge in automating bicycles is the inherent problem of staying balanced. This paper presents a modified electric bicycle to allow real-time monitoring of the roll angles and motor-assisted steering. Stable and robust steering controllers for bicycle are designed and implemented to achieve self-balance at different forward speeds. Tests at different speeds have been conducted to verify the effectiveness of hardware development and controller design. The preliminary design using a control moment gyroscope (CMG) to achieve self-balancing at lower speeds are also presented in this work. This work can serve as a solid foundation for future study of human-robot interaction and autonomous driving.


2021 ◽  
Author(s):  
FARZAN SHENAVARMASOULEH ◽  
Farid Ghareh Mohammadi ◽  
M. Hadi Amini ◽  
Hamid R. Arabnia

<div>A smart city can be seen as a framework, comprised of Information and Communication Technologies (ICT). An intelligent network of connected devices that collect data with their sensors and transmit them using wireless and cloud technologies in order to communicate with other assets in the ecosystem plays a pivotal role in this framework. Maximizing the quality of life of citizens, making better use of available resources, cutting costs, and improving sustainability are the ultimate goals that a smart city is after. Hence, data collected from these connected devices will continuously get thoroughly analyzed to gain better insights into the services that are being offered across the city; with this goal in mind that they can be used to make the whole system more efficient.</div><div>Robots and physical machines are inseparable parts of a smart city. Embodied AI is the field of study that takes a deeper look into these and explores how they can fit into real-world environments. It focuses on learning through interaction with the surrounding environment, as opposed to Internet AI which tries to learn from static datasets. Embodied AI aims to train an agent that can See (Computer Vision), Talk (NLP), Navigate and Interact with its environment (Reinforcement Learning), and Reason (General Intelligence), all at the same time. Autonomous driving cars and personal companions are some of the examples that benefit from Embodied AI nowadays.</div><div>In this paper, we attempt to do a concise review of this field. We will go through its definitions, its characteristics, and its current achievements along with different algorithms, approaches, and solutions that are being used in different components of it (e.g. Vision, NLP, RL). We will then explore all the available simulators and 3D interactable databases that will make the research in this area feasible. Finally, we will address its challenges and identify its potentials for future research.</div>


2020 ◽  
Vol 10 (20) ◽  
pp. 7091
Author(s):  
Mário Marques da Silva ◽  
João Guerreiro

This article provides an overview of the fifth generation of cellular communications (5G) and beyond. It presents the transmission techniques of current 5G communications and those expected of future developments, namely a brief study of non-orthogonal multiple access (NOMA) using the single carrier with frequency domain equalization (SC-FDE) block transmission technique, evidencing its added value in terms of spectral efficiency. An introduction to the sixth generation of cellular communications (6G) is also provided. The insertion of 5G and 6G within the Fourth Industrial Revolution framework (also known as Industry 4.0) is also dealt with. Consisting of a change in paradigm, when compared to previous generations, 5G supports a myriad of new services based on the Internet of things (IoT) and on vehicle-to-vehicle (V2V) communications, supporting technologies such as autonomous driving, smart cities, and remote surgery. The new services provided by 5G are supported by new techniques, such as millimeter waves (mm-wave), in addition to traditional microwave communication, and by massive multiple-input multiple-output (m-MIMO) technology. These techniques were not employed in the fourth generation of cellular communications (4G). While 5G plays an important role in the initial implementation of the Fourth Industrial Revolution, 6G will address a number of new services such as virtual reality (VR), augmented reality (AR), holographic services, the advanced Internet of things (IoT), AI-infused applications, wireless brain–computer interaction (BCI), and mobility at higher speeds. The current research on systems beyond 5G indicates that these applications shall be supported by new MIMO techniques and make use of terahertz (THz) bands.


Sign in / Sign up

Export Citation Format

Share Document