scholarly journals User interface for in-vehicle systems with on-wheel finger spreading gestures and head-up displays

2020 ◽  
Vol 7 (6) ◽  
pp. 700-721
Author(s):  
Sang Hun Lee ◽  
Se-One Yoon

Abstract Interacting with an in-vehicle system through a central console is known to induce visual and biomechanical distractions, thereby delaying the danger recognition and response times of the driver and significantly increasing the risk of an accident. To address this problem, various hand gestures have been developed. Although such gestures can reduce visual demand, they are limited in number, lack passive feedback, and can be vague and imprecise, difficult to understand and remember, and culture-bound. To overcome these limitations, we developed a novel on-wheel finger spreading gestural interface combined with a head-up display (HUD) allowing the user to choose a menu displayed in the HUD with a gesture. This interface displays audio and air conditioning functions on the central console of a HUD and enables their control using a specific number of fingers while keeping both hands on the steering wheel. We compared the effectiveness of the newly proposed hybrid interface against a traditional tactile interface for a central console using objective measurements and subjective evaluations regarding both the vehicle and driver behaviour. A total of 32 subjects were recruited to conduct experiments on a driving simulator equipped with the proposed interface under various scenarios. The results showed that the proposed interface was approximately 20% faster in emergency response than the traditional interface, whereas its performance in maintaining vehicle speed and lane was not significantly different from that of the traditional one.

Author(s):  
George D. Park ◽  
R. Wade Allen ◽  
Theodore J. Rosenthal ◽  
Dary Fiorentino

Driver performance effects were compared between two configuration types: 1) a low-cost, three-monitor, 135 degree field-of-view (FOV), PC desktop with PC gaming steering wheel controls and 2) a medium-cost, fixed-based, projected image, 135 degree FOV, instrumented vehicle cab. The experiment was part of a larger novice driver training experiment with teenage drivers who had yet to receive their license to drive (Allen, Park, et al. 2003). Participants drove a minimum of six training trial runs on either the three-monitor configuration (N = 180) or the vehicle cab configuration (N = 143). A 2 times 6 (configuration type x training trial runs) analysis of variance was performed for a variety of performance measures as well as a one-way analysis of variance to assess the graduation rates between the two configurations. Significant differences were found for certain performance measures suggesting that handling behaviors (i.e. braking and steering) were largely affected by the difference in controls while lane position, vehicle speed, time-to-collision, and simulator sickness ratings were largely affected by the difference in graphical display. However, non-significant differences in certain performance measures (e.g. total accidents and graduation rates) suggested that the three-monitor configuration may be as useful of a tool for driver training, assessment, and research as a higher fidelity vehicle cab.


Author(s):  
Nathan Hatfield ◽  
Yusuke Yamani ◽  
Dakota B. Palmer ◽  
Sarah Yahoodik ◽  
Veronica Vasquez ◽  
...  

Automated driving systems (ADS) partially or fully perform driving functions. Yet, the effects of ADS on drivers’ visual sampling patterns to the forward roadway remain underexplored. This study examined the eye movements of 24 young drivers during either manual (L0) or partially automated driving (L2) in a driving simulator. After completing a hazard anticipation training program, Road Awareness and Perception Training, drivers in both groups navigated a single simulated drive consisting of four environment types: highway, town, rural, and residential. Drivers of the simulated L2 system were instructed to keep their hands on the steering wheel and told that the system controls the speed and lateral positioning of the vehicle while avoiding potential threats on the forward roadway. The data indicate that the drivers produced fewer fixations during automated driving compared with manual driving. However, the breadth of horizontal and vertical eye movements and the mean fixation durations did not strongly support the null results between the two conditions. Existing hazard anticipation training programs may effectively protect drivers of partially automated systems from inattention to the forward roadway.


Author(s):  
Dengbo He ◽  
Birsen Donmez

The anticipation of future events in traffic can allow potential gains in recognition and response times. Anticipatory actions (i.e., actions in preparation for a potential upcoming conflict) have been found to be more prevalent among experienced drivers in a driving simulator study where driving was the sole task. The influence of secondary tasks on anticipatory driving has not yet been investigated, despite the prevalence and negative effects of distraction widely documented in the literature. A driving simulator experiment was conducted with 16 experienced and 16 novice drivers to address this gap with half of the participants provided with a self-paced visual-manual secondary task. More anticipatory actions were observed among experienced drivers in general compared to novices; experienced drivers also exhibited more efficient visual scanning behaviors. Secondary task engagement reduced anticipatory actions for both experienced and novice drivers.


Energies ◽  
2021 ◽  
Vol 14 (24) ◽  
pp. 8429
Author(s):  
Liang Chen ◽  
Jiming Xie ◽  
Simin Wu ◽  
Fengxiang Guo ◽  
Zheng Chen ◽  
...  

With their advantages of high experimental safety, convenient setting of scenes, and easy extraction of control parameters, driving simulators play an increasingly important role in scientific research, such as in road traffic environment safety evaluation and driving behavior characteristics research. Meanwhile, the demand for the validation of driving simulators is increasing as its applications are promoted. In order to validate a driving simulator in a complex environment, curve road conditions with different radii are considered as experimental evaluation scenarios. To attain this, this paper analyzes the reliability and accuracy of the experimental vehicle speed of a driving simulator. Then, qualitative and quantitative analysis of the lateral deviation of the vehicle trajectory is carried out, applying the cosine similarity method. Furthermore, a data-driven method was adopted which takes the longitudinal displacement, lateral displacement, vehicle speed and steering wheel angle of the vehicle as inputs and the lateral offset as the output. Thus, a curve trajectory planning model, a more comprehensive and human-like operation, is established. Based on directional long short-term memory (Bi–LSTM) and a recurrent neural network (RNN), a multiple Bi–LSTM (Mul–Bi–LSTM) is proposed. The prediction performance of LSTM, MLP model and Mul–Bi–LSTM are compared in detail on the validation set and testing set. The results show that the Mul–Bi–LSTM model can generate a trajectory which is very similar to the driver’s curve driving and have a preferable generalization performance. Therefore, this method can solve problems which cannot be realized in real complex scenes in the simulator validation. Selecting the trajectory as the validation parameter can more comprehensively and intuitively reflect the simulator’s curve driving state. Using a speed model and trajectory model instead of a real car experiment can improve the efficiency of simulator validation and lay a foundation for the standardization of simulator validation.


1980 ◽  
Vol 24 (1) ◽  
pp. 471-475 ◽  
Author(s):  
R. Wade Allen ◽  
Zareh Parseghian ◽  
Paul G. Van Valkenburgh

The use of symbolic road signs is proliferating on the highways, and there is some concern in their effectiveness, particularly by elderly drivers. This paper describes an experimental study of problems encountered by a broad age range of drivers in learning and retaining symbolic information. A driving simulator was used to present 72 symbol signs to subjects during 25 minutes “drives.” Performance measures included the correctness of sign recognition, and the distance from the signs at which recognition took place. The experimental design looked at the effects of age and training on the learning and retention of symbol knowledge. The overall results showed strong age effects, but no influence due to the type of symbol training employed. All age groups learned and retained roughly the same number of symbols, but the older age groups started with less symbol knowledge initially. This result is hypothesized to be a generational effect rather than an age diminished-capability. Data interpretation also indicates that older subjects require longer recognition and response times.


2020 ◽  
Vol 11 (1) ◽  
pp. 102-111
Author(s):  
Em Poh Ping ◽  
J. Hossen ◽  
Wong Eng Kiong

AbstractLane departure collisions have contributed to the traffic accidents that cause millions of injuries and tens of thousands of casualties per year worldwide. Due to vision-based lane departure warning limitation from environmental conditions that affecting system performance, a model-based vehicle dynamics framework is proposed for estimating the lane departure event by using vehicle dynamics responses. The model-based vehicle dynamics framework mainly consists of a mathematical representation of 9-degree of freedom system, which permitted to pitch, roll, and yaw as well as to move in lateral and longitudinal directions with each tire allowed to rotate on its axle axis. The proposed model-based vehicle dynamics framework is created with a ride model, Calspan tire model, handling model, slip angle, and longitudinal slip subsystems. The vehicle speed and steering wheel angle datasets are used as the input in vehicle dynamics simulation for predicting lane departure event. Among the simulated vehicle dynamic responses, the yaw acceleration response is observed to provide earlier insight in predicting the future lane departure event compared to other vehicle dynamics responses. The proposed model-based vehicle dynamics framework had shown the effectiveness in estimating lane departure using steering wheel angle and vehicle speed inputs.


2001 ◽  
Author(s):  
Masao Nagai ◽  
Hidehisa Yoshida ◽  
Kiyotaka Shitamitsu ◽  
Hiroshi Mouri

Abstract Although the vast majority of lane-tracking control methods rely on the steering wheel angle as the control input, a few studies have treated methods using the steering torque as the input. When operating vehicles especially at high speed, drivers typically do not grip the steering wheel tightly to prevent the angle of the steering wheel from veering off course. This study proposes a new steering assist system for a driver not with the steering angle but the steering torque as the input and clarifies the characteristics and relative advantages of the two approaches. Then using a newly developed driving simulator, characteristics of human drivers and the lane-tracking system based on the steering torque control are investigated.


Author(s):  
Wyatt McManus ◽  
Jing Chen

Modern surface transportation vehicles often include different levels of automation. Higher automation levels have the potential to impact surface transportation in unforeseen ways. For example, connected vehicles with higher levels of automation are at a higher risk for hacking attempts, because automated driving assistance systems often rely on onboard sensors and internet connectivity (Amoozadeh et al., 2015). As the automation level of vehicle control rises, it is necessary to examine the effect different levels of automation have on the driver-vehicle interactions. While research into the effect of automation level on driver-vehicle interactions is growing, research into how automation level affects driver’s responses to vehicle hacking attempts is very limited. In addition, auditory warnings have been shown to effectively attract a driver’s attention while performing a driving task, which is often visually demanding (Baldwin, 2011; Petermeijer, Doubek, & de Winter, 2017). An auditory warning can be either speech-based containing sematic information (e.g., “car in blind spot”) or non-sematic (e.g., a tone, or an earcon), which can influence driver behaviors differently (Sabic, Mishler, Chen, & Hu, 2017). The purpose of the current study was to examine the effect of level of automation and warning type on driver responses to novel critical events, using vehicle hacking attempts as a concrete example, in a driving simulator. The current study compared how level of automation (manual vs. automated) and warning type (non-semantic vs. semantic) affected drivers’ responses to a vehicle hacking attempt using time to collision (TTC) values, maximum steering wheel angle, number of successful responses, and other measures of response. A full factorial between-subjects design with the two factors made four conditions (Manual Semantic, Manual Non-Semantic, Automated Semantic, and Automated Non-Semantic). Seventy-two participants recruited using SONA ( odupsychology.sona-systems.com ) completed two simulated drives to school in a driving simulator. The first drive ended with the participant safely arriving at school. A two-second warning was presented to the participants three quarters of the way through the second drive and was immediately followed by a simulated vehicle hacking attempt. The warning either stated “Danger, hacking attempt incoming” in the semantic conditions or was a 500 Hz sine tone in the non-semantic conditions. The hacking attempt lasted five seconds before simulating a crash into a vehicle and ending the simulation if no intervention by the driver occurred. Our results revealed no significant effect of level of automation or warning type on TTC or successful response rate. However, there was a significant effect of level of automation on maximum steering wheel angle. This is a measure of response quality (Shen & Neyens, 2017), such that manual drivers had safer responses to the hacking attempt with smaller maximum steering wheel angles. In addition, an effect of warning type that approached significance was also found for maximum steering wheel angle such that participants who received a semantic warning had more severe and dangerous responses to the hacking attempt. The TTC and successful response results from the current experiment do not match those in the previous literature. The null results were potentially due to the warning implementation time and the complexity of the vehicle hacking attempt. In contrast, the maximum steering wheel angle results indicated that level of automation and warning type affected the safety and severity of the participants’ responses to the vehicle hacking attempt. This suggests that both factors may influence responses to hacking attempts in some capacity. Further research will be required to determine if level of automation and warning type affect participants ability to safely respond to vehicle hacking attempts. Acknowledgments. We are grateful to Scott Mishler for his assistance with STISIM programming and Faye Wakefield, Hannah Smith, and Pettie Perkins for their assistance in data collection.


2017 ◽  
Vol 8 (1) ◽  
pp. 108-129
Author(s):  
Nur Khairiel Anuar ◽  
Romano Pagliari ◽  
Richard Moxon

The purpose of this study was to investigate the impact of different wayfinding provision on senior driving behaviour and road safety. A car driving simulator was used to model scenarios of differing wayfinding complexity and road design. Three scenario types were designed consisting of 3.8 miles of airport road. Wayfinding complexity varied due to differing levels of road-side furniture. Experienced car drivers were asked to drive simulated routes. Forty drivers in the age ranges: 50 to 54, 55 to 59 and those aged over 60 were selected to perform the study. Participants drove for approximately 20 minutes to complete the simulated driving. The driver performance was compared between age groups. Results were analysed by Mean, Standard Deviation and ANOVA Test, and discussed with reference to the use of the driving simulator. The ANOVA confirmed that age group has a correlation between road design complexity, driving behaviour and driving errors.


Sensors ◽  
2021 ◽  
Vol 22 (1) ◽  
pp. 42
Author(s):  
Lichao Yang ◽  
Mahdi Babayi Semiromi ◽  
Yang Xing ◽  
Chen Lv ◽  
James Brighton ◽  
...  

In conditionally automated driving, the engagement of non-driving activities (NDAs) can be regarded as the main factor that affects the driver’s take-over performance, the investigation of which is of great importance to the design of an intelligent human–machine interface for a safe and smooth control transition. This paper introduces a 3D convolutional neural network-based system to recognize six types of driver behaviour (four types of NDAs and two types of driving activities) through two video feeds based on head and hand movement. Based on the interaction of driver and object, the selected NDAs are divided into active mode and passive mode. The proposed recognition system achieves 85.87% accuracy for the classification of six activities. The impact of NDAs on the perspective of the driver’s situation awareness and take-over quality in terms of both activity type and interaction mode is further investigated. The results show that at a similar level of achieved maximum lateral error, the engagement of NDAs demands more time for drivers to accomplish the control transition, especially for the active mode NDAs engagement, which is more mentally demanding and reduces drivers’ sensitiveness to the driving situation change. Moreover, the haptic feedback torque from the steering wheel could help to reduce the time of the transition process, which can be regarded as a productive assistance system for the take-over process.


Sign in / Sign up

Export Citation Format

Share Document