scholarly journals A Multimodal Approach for Monitoring Driving Behavior and Emotions

2020 ◽  
Author(s):  
Vahid Balali ◽  
Arash Tavakoli ◽  
Arsalan Heydarian

Studies have indicated that emotions can significantly be influenced by environmental factors; these factors can also significantly influence drivers’ emotional state and, accordingly, their driving behavior. Furthermore, as the demand for autonomous vehicles is expected to significantly increase within the next decade, a proper understanding of drivers’/passengers’ emotions, behavior, and preferences will be needed in order to create an acceptable level of trust with humans. This paper proposes a novel semi-automated approach for understanding the effect of environmental factors on drivers’ emotions and behavioral changes through a naturalistic driving study. This setup includes a frontal road and facial camera, a smart watch for tracking physiological measurements, and a Controller Area Network (CAN) serial data logger. The results suggest that the driver’s affect is highly influenced by the type of road and the weather conditions, which have the potential to change driving behaviors. For instance, when the research defines emotional metrics as valence and engagement, results reveal there exist significant differences between human emotion in different weather conditions and road types. Participants’ engagement was higher in rainy and clear weather compared to cloudy weather. More-over, engagement was higher on city streets and highways compared to one-lane roads and two-lane highways.

Author(s):  
Xiao Qi ◽  
Ying Ni ◽  
Yiming Xu ◽  
Ye Tian ◽  
Junhua Wang ◽  
...  

A large portion of the accidents involving autonomous vehicles (AVs) are not caused by the functionality of AV, but rather because of human intervention, since AVs’ driving behavior was not properly understood by human drivers. Such misunderstanding leads to dangerous situations during interaction between AV and human-driven vehicle (HV). However, few researches considered HV-AV interaction safety in AV safety evaluation processes. One of the solutions is to let AV mimic a normal HV’s driving behavior so as to avoid misunderstanding to the most extent. Therefore, to evaluate the differences of driving behaviors between existing AV and HV is necessary. DRIVABILITY is defined in this study to characterize the similarity between AV’s driving behaviors and expected behaviors by human drivers. A driving behavior spectrum reference model built based on human drivers’ behaviors is proposed to evaluate AVs’ car-following drivability. The indicator of the desired reaction time (DRT) is proposed to characterize the car-following drivability. Relative entropy between the DRT distribution of AV and that of the entire human driver population are used to quantify the differences between driving behaviors. A human driver behavior spectrum was configured based on naturalistic driving data by human drivers collected in Shanghai, China. It is observed in the numerical test that amongst all three types of preset AVs in the well-received simulation package VTD, the brisk AV emulates a normal human driver to the most extent (ranking at 55th percentile), while the default AV and the comfortable AV rank at 35th and 8th percentile, respectively.


Author(s):  
Bashar Dhahir ◽  
Yasser Hassan

Many studies have been conducted to develop models to predict speed and driver comfort thresholds on horizontal curves, and to evaluate design consistency. The approaches used to develop these models differ from one another in data collection, data processing, assumptions, and analysis. However, some issues might be associated with the data collection that can affect the reliability of collected data and developed models. In addition, analysis of speed behavior on the assumption that vehicles traverse horizontal curves at a constant speed is far from actual driving behavior. Using the Naturalistic Driving Study (NDS) database can help overcome problems associated with data collection. This paper aimed at using NDS data to investigate driving behavior on horizontal curves in terms of speed, longitudinal acceleration, and comfort threshold. The NDS data were valuable in providing clear insight on drivers’ behavior during daytime and favorable weather conditions. A methodology was developed to evaluate driver behavior and was coded in Matlab. Sensitivity analysis was performed to recommend values for the parameters that can affect the output. Analysis of the drivers’ speed behavior and comfort threshold highlighted several issues that describe how drivers traverse horizontal curves that need to be considered in horizontal curve design and consistency evaluation.


Sensors ◽  
2019 ◽  
Vol 19 (6) ◽  
pp. 1356 ◽  
Author(s):  
Jun Zhang ◽  
ZhongCheng Wu ◽  
Fang Li ◽  
Chengjun Xie ◽  
Tingting Ren ◽  
...  

Human driving behaviors are personalized and unique, and the automobile fingerprint of drivers could be helpful to automatically identify different driving behaviors and further be applied in fields such as auto-theft systems. Current research suggests that in-vehicle Controller Area Network-BUS (CAN-BUS) data can be used as an effective representation of driving behavior for recognizing different drivers. However, it is difficult to capture complex temporal features of driving behaviors in traditional methods. This paper proposes an end-to-end deep learning framework by fusing convolutional neural networks and recurrent neural networks with an attention mechanism, which is more suitable for time series CAN-BUS sensor data. The proposed method can automatically learn features of driving behaviors and model temporal features without professional knowledge in features modeling. Moreover, the method can capture salient structure features of high-dimensional sensor data and explore the correlations among multi-sensor data for rich feature representations of driving behaviors. Experimental results show that the proposed framework performs well in the real world driving behavior identification task, outperforming the state-of-the-art methods.


2018 ◽  
Vol 2018 ◽  
pp. 1-10 ◽  
Author(s):  
Changxi Ma ◽  
Wei Hao ◽  
Wang Xiang ◽  
Wei Yan

The effect of aggressive driving behavior on driver’s injury severity is analyzed by considering a comprehensive set of variables at highway-rail grade crossings in the US. In doing so, we are able to use a mixed logit modelling approach; the study explores the determinants of driver-injury severity with and without aggressive driving behaviors at highway-rail grade crossings. Significant differences exist between drivers’ injury severity with and without aggressive driving behaviors at highway-rail grade crossings. The level of injury for younger male drivers increases a lot if they are with aggressive driving behavior. In addition, driving during peak-hour is found to be a statistically significant predictor of high level injury severity with aggressive driving behavior. Moreover, environmental factors are also found to be statistically significant. The increased level of injury severity accidents happened for drivers with aggressive driving behavior in the morning peak (6-9 am), and the probability of fatality increases in both snow and fog condition. Driving in open space area is also found to be a significant factor of high level injury severity with aggressive driving behaviors. Bad weather conditions are found to increase the probability of drivers’ high level injury severity for drivers with aggressive driving behaviors.


2021 ◽  
Author(s):  
Arash Tavakoli ◽  
Vahid Balali ◽  
Arsalan Heydarian

Studies have shown that environmental factors affect driving behaviors. For instance, weather conditions and the presence of a passenger have been shown to significantly affect the speed of the driver. As one of the important measures of driving behavior is the gaze and head movements of the driver, such metrics can be potentially used towards understanding the effects of environmental factors on the driver’s behavior in real-time. In this study, using a naturalistic study platform, videos have been collected from six participants for more than four weeks of a fully naturalistic driving scenario. The videos of both the participants’ faces and roads have been cleaned and manually categorized depending on weather, road type, and passenger conditions. Facial videos have been analyzed using OpenFace to retrieve the gaze direction and head movements of the driver. Results, overall, suggest that the gaze direction and head movements of the driver are affected by a combination of environmental factors and individual differences. Specifically, results depict the distracting effect of the passenger on some individuals. In addition, it shows that highways and city streets are the cause for maximum distraction on the driver’s gaze.


Author(s):  
Jeremy A. Decker ◽  
Samantha H. Haus ◽  
Rini Sherony ◽  
Hampton C. Gabler

In 2015, there were 319,195 police reported vehicle-animal crashes, resulting in 275 vehicle occupant fatalities. Animal-detecting automatic emergency braking (AEB) systems are a promising active safety measure which could potentially avoid or mitigate many of these crashes by warning the driver, utilizing automatic braking, or both. The purpose of this study was to develop and characterize a target population of vehicle-animal crashes applicable to AEB systems and to analyze the potential benefits of an animal-detecting AEB system. The study was based on two nationally representative databases, Fatality Analysis Reporting System and the National Automotive Sampling System’s General Estimates System, and a naturalistic driving study, SHRP 2. The target population was restricted to vehicle-animal crashes that were forward impacts or road departures and involved cars and light trucks, with no loss of control. Crash characteristics which may influence the performance of AEB such as lighting, weather, pre-crash movement, relation to junction, and first and worst harmful events, were analyzed. The study found that the major influences on the effectiveness of animal AEB systems were: weather, lighting, pre-crash movements, and the crash location. Six potential target populations were used to analyze the potential effectiveness of an animal AEB system, with effectiveness ranging between 21.6% and 97% of police reported crashes and between 4.1% and 50.8% of fatal vehicle-animal crashes. An AEB system’s ability to function in low light and poor weather conditions may enable it to avoid a substantially higher proportion of crashes.


Smart Cities ◽  
2021 ◽  
Vol 4 (1) ◽  
pp. 314-335
Author(s):  
Hafiz Usman Ahmed ◽  
Ying Huang ◽  
Pan Lu

The platform of a microscopic traffic simulation provides an opportunity to study the driving behavior of vehicles on a roadway system. Compared to traditional conventional cars with human drivers, the car-following behaviors of autonomous vehicles (AVs) and connected autonomous vehicles (CAVs) would be quite different and hence require additional modeling efforts. This paper presents a thorough review of the literature on the car-following models used in prevalent micro-simulation tools for vehicles with both human and robot drivers. Specifically, the car-following logics such as the Wiedemann model and adaptive cruise control technology were reviewed based on the vehicle’s dynamic behavior and driving environments. In addition, some of the more recent “AV-ready (autonomous vehicles ready) tools” in micro-simulation platforms are also discussed in this paper.


2021 ◽  
Vol 10 (2) ◽  
pp. 77
Author(s):  
Yitong Gan ◽  
Hongchao Fan ◽  
Wei Jiao ◽  
Mengqi Sun

In China, the traditional taxi industry is conforming to the trend of the times, with taxi drivers working with e-hailing applications. This reform is of great significance, not only for the taxi industry, but also for the transportation industry, cities, and society as a whole. Our goal was to analyze the changes in driving behavior since taxi drivers joined e-hailing platforms. Therefore, this paper mined taxi trajectory data from Shanghai and compared the data of May 2015 with those of May 2017 to represent the before-app stage and the full-use stage, respectively. By extracting two-trip events (i.e., vacant trip and occupied trip) and two-spot events (i.e., pick-up spot and drop-off spot), taxi driving behavior changes were analyzed temporally, spatially, and efficiently. The results reveal that e-hailing applications mine more long-distance rides and new pick-up locations for drivers. Moreover, driver initiative have increased at night since using e-hailing applications. Furthermore, mobile payment facilities save time that would otherwise be taken sorting out change. Although e-hailing apps can help citizens get taxis faster, from the driver’s perspective, the apps do not reduce their cruising time. In general, e-hailing software reduces the unoccupied ratio of taxis and improves the operating ratio. Ultimately, new driving behaviors can increase the driver’s revenue. This work is meaningful for the formulation of reasonable traffic laws and for urban traffic decision-making.


2020 ◽  
Vol 0 (0) ◽  
Author(s):  
Abolfazl Mohammadbeigi ◽  
Salman Khazaei ◽  
Hamidreza Heidari ◽  
Azadeh Asgarian ◽  
Shahram Arsangjang ◽  
...  

AbstractObjectivesLeishmaniasis is a neglected and widespread parasitic disease that can lead to serious health problems. The current review study aimed to synthesize the relationship between ecologic and environmental factors (e.g., weather conditions, climatology, temperature and topology) and the incidence of cutaneous leishmaniasis (CL) in the Old World.ContentA systematic review was conducted based on English, and Persian articles published from 2015 to 2020 in PubMed/Medline, Science Direct, Web of Science and Google Scholar. Keywords used to search articles were leishmaniasis, environmental factors, weather condition, soil, temperature, land cover, ecologic* and topogr*. All articles were selected and assessed for eligibility according to the titles or abstracts. The quality screening process of articles was carried out by two independent authors. The selected articles were checked according to the inclusion and exclusion criteria.Summary and outlookA total of 827 relevant records in 2015–2020 were searched and after evaluating the articles, 23 articles met the eligibility criteria; finally, 14 full-text articles were included in the systematic review. Two different categories of ecologic/environmental factors (weather conditions, temperature, rainfall/precipitation and humidity) and land characteristics (land cover, slope, elevation and altitude, earthquake and cattle sheds) were the most important factors associated with CL incidence.ConclusionsTemperature and rainfall play an important role in the seasonal cycle of CL as many CL cases occurred in arid and semiarid areas in the Old World. Moreover, given the findings of this study regarding the effect of weather conditions on CL, it can be concluded that designing an early warning system is necessary to predict the incidence of CL based on different weather conditions.


2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 465-465
Author(s):  
Jennifer Zakrajsek ◽  
Lisa Molnar ◽  
David Eby ◽  
David LeBlanc ◽  
Lidia Kostyniuk ◽  
...  

Abstract Motor vehicle crashes represent a significant public health problem. Efforts to improve driving safety are multifaceted, focusing on vehicles, roadways, and drivers with risky driving behaviors playing integral roles in each area. As part of a study to create guidelines for developing risky driving countermeasures, 480 drivers (118 young/18-25, 183 middle-aged/35-55, 179 older/65 and older) completed online surveys measuring driving history, risky driving (frequency of engaging in distracted [using cell phone, texting, eating/drinking, grooming, reaching/interacting] and reckless/aggressive [speeding, tailgating, failing to yield right-of-way, maneuvering unsafely, rolling stops] driving behaviors), and psychosocial characteristics. A cluster analysis using frequency of the risky behaviors and seat belt use identified five risky behavior-clusters: 1) rarely/never distracted-rarely/never reckless/aggressive (n=392); 2) sometimes distracted-rarely/never reckless/aggressive (n=33); 3) sometimes distracted-sometimes reckless/aggressive (n=40); 4) often/always distracted-often/always reckless/aggressive (n=11); 5) no pattern (n=4). Older drivers were more likely in the first/lowest cluster (93.8% of older versus 84.2% of middle-aged and 59.3% of young drivers; p<.0001). Fifteen older drivers participated in a follow-up study in which their vehicles were equipped with a data acquisition system that collected objective driving and video data of all trips for three weeks. Analysis of video data from 145 older driver trips indicated that older drivers engaged in at least one distracted behavior in 115 (79.3%) trips. While preliminary, this suggests considerably more frequent engagement in distracted driving than self-reported and that older drivers should not be excluded from consideration when developing risky driving behavior countermeasures. Full study results and implications will be presented.


Sign in / Sign up

Export Citation Format

Share Document