Measuring Driver Perception: Combining Eye-Tracking and Automated Road Scene Perception

2020 ◽  
pp. 001872082095995 ◽  
Author(s):  
Jork Stapel ◽  
Mounir El Hassnaoui ◽  
Riender Happee
Keyword(s):  
Eye Tracking ◽  
Situation Awareness ◽  
Scene Perception ◽  
Recognition Task ◽  
Road User ◽  
Gaze Behavior ◽  
Left Turn ◽  
Road Users ◽  
Driver Support Systems ◽  
Fixation Locations

Objective To investigate how well gaze behavior can indicate driver awareness of individual road users when related to the vehicle’s road scene perception. Background An appropriate method is required to identify how driver gaze reveals awareness of other road users. Method We developed a recognition-based method for labeling of driver situation awareness (SA) in a vehicle with road-scene perception and eye tracking. Thirteen drivers performed 91 left turns on complex urban intersections and identified images of encountered road users among distractor images. Results Drivers fixated within 2° for 72.8% of relevant and 27.8% of irrelevant road users and were able to recognize 36.1% of the relevant and 19.4% of irrelevant road users one min after leaving the intersection. Gaze behavior could predict road user relevance but not the outcome of the recognition task. Unexpectedly, 18% of road users observed beyond 10° were recognized. Conclusions Despite suboptimal psychometric properties leading to low recognition rates, our recognition task could identify awareness of individual road users during left turn maneuvers. Perception occurred at gaze angles well beyond 2°, which means that fixation locations are insufficient for awareness monitoring. Application Findings can be used in driver attention and awareness modelling, and design of gaze-based driver support systems.

scholarly journals Contrasting Perspectives on the Comfort and Safety of Pedestrians Interacting with Other Road Users

2021 ◽  
Vol 2675 (3) ◽  
pp. 33-43
Author(s):  
Alexander Bigazzi ◽  
Gurdiljot Gill ◽  
Meghan Winters
Keyword(s):  
Traffic Safety ◽  
Injury Risk ◽  
Road User ◽  
Motor Vehicles ◽  
Advisory Group ◽  
User Interactions ◽  
The Public ◽  
Road Users ◽  
Expert Assessments ◽  
Sample Representation

Assessments of interactions between road users are crucial to understanding comfort and safety. However, observers may vary in their perceptions and ratings of road user interactions. The objective of this paper is to examine how perceptions of yielding, comfort, and safety for pedestrian interactions vary among observers, ranging from members of the public to road safety experts. Video clips of pedestrian interactions with motor vehicles and bicycles were collected from 11 crosswalks and shown to three groups of participants (traffic safety experts, an engaged citizen advisory group, and members of the general public) along with questions about yielding, comfort, and risk of injury. Experts had similar views of yielding and comfort to the other two groups, but a consistently lower assessment of injury risk for pedestrians in the study. Respondent socio-demographics did not relate to perceptions of yielding, comfort, or risk, but self-reported travel habits did. Respondents who reported walking more frequently rated pedestrian comfort as lower, and respondents who reported cycling more frequently rated risk as lower for pedestrian interactions with both motor vehicles and bicycles. Findings suggest small groups of engaged citizens can provide useful information about public perspectives on safety that likely diverge from expert assessments of risk, and that sample representation should be assessed in relation to travel habits rather than socio-demographics.

scholarly journals Autonomous Vehicles and Vulnerable Road-Users—Important Considerations and Requirements Based on Crash Data from Two Countries

2021 ◽  
Vol 11 (7) ◽  
pp. 101
Author(s):  
Andrew Paul Morris ◽  
Narelle Haworth ◽  
Ashleigh Filtness ◽  
Daryl-Palma Asongu Nguatem ◽  
Laurie Brown ◽  
...  
Keyword(s):  
Autonomous Vehicles ◽  
Red Light ◽  
Road User ◽  
Red Light Running ◽  
Crash Data ◽  
Passenger Vehicles ◽  
Road Users ◽  
Vulnerable Road User ◽  
Vulnerable Road Users ◽  
Road Intersections

(1) Background: Passenger vehicles equipped with advanced driver-assistance system (ADAS) functionalities are becoming more prevalent within vehicle fleets. However, the full effects of offering such systems, which may allow for drivers to become less than 100% engaged with the task of driving, may have detrimental impacts on other road-users, particularly vulnerable road-users, for a variety of reasons. (2) Crash data were analysed in two countries (Great Britain and Australia) to examine some challenging traffic scenarios that are prevalent in both countries and represent scenarios in which future connected and autonomous vehicles may be challenged in terms of safe manoeuvring. (3) Road intersections are currently very common locations for vulnerable road-user accidents; traffic flows and road-user behaviours at intersections can be unpredictable, with many vehicles behaving inconsistently (e.g., red-light running and failure to stop or give way), and many vulnerable road-users taking unforeseen risks. (4) Conclusions: The challenges of unpredictable vulnerable road-user behaviour at intersections (including road-users violating traffic or safe-crossing signals, or taking other risks) combined with the lack of knowledge of CAV responses to intersection rules, could be problematic. This could be further compounded by changes to nonverbal communication that currently exist between road-users, which could become more challenging once CAVs become more widespread.

Does crossing the road in a group influence pedestrians’ gaze behavior?

2020 ◽  
Vol 64 (1) ◽  
pp. 1938-1942
Author(s):  
Mirjam Lanzer ◽  
Martin Baumann
Keyword(s):  
Group Size ◽  
Situational Factors ◽  
Gaze Behavior ◽  
The Road ◽  
Road Users ◽  
Gender Influence ◽  
Vulnerable Road Users ◽  
Group Members ◽  
And Gender ◽  
Group Characteristics

So far, research on pedestrians’ gaze behavior while crossing roads has mainly focused on individual pedestrians rather than groups. However, pedestrians often travel in groups especially in downtown areas. This observational study investigated how group characteristics (group size and movement of the group), situational factors (presence of traffic), and demographic variables (age and gender) influence pedestrians’ gaze behavior towards traffic during road crossing. A total of N = 197 pedestrians were observed of whom n = 24 traveled alone, n = 128 traveled in groups of two or three, and n = 45 traveled in groups of four or more. Results indicated that with increasing group size, the odds to observe traffic decreased. Diffusion of responsibility among group members might explain this effect. Finally, pedestrians’ group characteristics should be considered when developing automated vehicles that interact with vulnerable road users.

scholarly journals Perception and Action under Different Stimulus Presentations: A Review of Eye-Tracking Studies with an Extended View on Possibilities of Virtual Reality

2021 ◽  
Vol 11 (12) ◽  
pp. 5546
Author(s):  
Florian Heilmann ◽  
Kerstin Witte
Keyword(s):  
Virtual Reality ◽  
Eye Tracking ◽  
Literature Search ◽  
Perception And Action ◽  
Stimulus Presentation ◽  
Gaze Behavior ◽  
Motor Responses ◽  
Scientific Approach ◽  
Extended View

Visual anticipation is essential for performance in sports. This review provides information on the differences between stimulus presentations and motor responses in eye-tracking studies and considers virtual reality (VR), a new possibility to present stimuli. A systematic literature search on PubMed, ScienceDirect, IEEE Xplore, and SURF was conducted. The number of studies examining the influence of stimulus presentation (in situ, video) is deficient but still sufficient to describe differences in gaze behavior. The seven reviewed studies indicate that stimulus presentations can cause differences in gaze behavior. Further research should focus on displaying game situations via VR. The advantages of a scientific approach using VR are experimental control and repeatability. In addition, game situations could be standardized and movement responses could be included in the analysis.

An Integrated Approach for Traffic Scene Understanding from Monocular Cameras

2021 ◽  
Author(s):  
Malte Oeljeklaus
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Scene Perception ◽  
Integrated Approach ◽  
Image Features ◽  
Road Users ◽  
Environment Model ◽  
Computational Performance ◽  
Spatial Reconstruction ◽  
The Individual

This thesis investigates methods for traffic scene perception with monocular cameras for a basic environment model in the context of automated vehicles. The developed approach is designed with special attention to the computational limitations present in practical systems. For this purpose, three different scene representations are investigated. These consist of the prevalent road topology as the global scene context, the drivable road area and the detection and spatial reconstruction of other road users. An approach is developed that allows for the simultaneous perception of all environment representations based on a multi-task convolutional neural network. The obtained results demonstrate the efficiency of the multi-task approach. In particular, the effects of shareable image features for the perception of the individual scene representations were found to improve the computational performance. Contents Nomenclature VII 1 Introduction 1 1.1 Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 Outline and contributions . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 2 Related Work and Fundamental Background 8 2.1 Advances in CNN...

scholarly journals MobRISK: a model for assessing the exposure of road users to flash flood events

2017 ◽  
Vol 17 (9) ◽  
pp. 1631-1651 ◽  
Author(s):  
Saif Shabou ◽  
Isabelle Ruin ◽  
Céline Lutoff ◽  
Samuel Debionne ◽  
Sandrine Anquetin ◽  
...  
Keyword(s):  
Exposure Assessment ◽  
Flash Flood ◽  
Activity Patterns ◽  
Traffic Load ◽  
Road User ◽  
Population Exposure ◽  
Flood Events ◽  
Population Mobility ◽  
Road Users ◽  
Adverse Weather

Abstract. Recent flash flood impact studies highlight that road networks are often disrupted due to adverse weather and flash flood events. Road users are thus particularly exposed to road flooding during their daily mobility. Previous exposure studies, however, do not take into consideration population mobility. Recent advances in transportation research provide an appropriate framework for simulating individual travel-activity patterns using an activity-based approach. These activity-based mobility models enable the prediction of the sequence of activities performed by individuals and locating them with a high spatial–temporal resolution. This paper describes the development of the MobRISK microsimulation system: a model for assessing the exposure of road users to extreme hydrometeorological events. MobRISK aims at providing an accurate spatiotemporal exposure assessment by integrating travel-activity behaviors and mobility adaptation with respect to weather disruptions. The model is applied in a flash-flood-prone area in southern France to assess motorists' exposure to the September 2002 flash flood event. The results show that risk of flooding mainly occurs in principal road links with considerable traffic load. However, a lag time between the timing of the road submersion and persons crossing these roads contributes to reducing the potential vehicle-related fatal accidents. It is also found that sociodemographic variables have a significant effect on individual exposure. Thus, the proposed model demonstrates the benefits of considering spatiotemporal dynamics of population exposure to flash floods and presents an important improvement in exposure assessment methods. Such improved characterization of road user exposures can present valuable information for flood risk management services.

scholarly journals ADOS-Eye-Tracking: The Archimedean Point of View and Its Absence in Autism Spectrum Conditions

2021 ◽  
Vol 12 ◽  
Author(s):  
Ulrich Max Schaller ◽  
Monica Biscaldi ◽  
Anna Burkhardt ◽  
Christian Fleischhaker ◽  
Michael Herbert ◽  
...  
Keyword(s):  
Social Interaction ◽  
Eye Tracking ◽  
Children And Adolescents ◽  
Face Perception ◽  
Autism Spectrum ◽  
Autism Spectrum Conditions ◽  
Gaze Behavior ◽  
Face Region ◽  
Mobile Eye Tracking ◽  
Standardized Diagnostic

Face perception and emotion categorization are widely investigated under laboratory conditions that are devoid of real social interaction. Using mobile eye-tracking glasses in a standardized diagnostic setting while applying the Autism Diagnostic Observation Schedule (ADOS-2), we had the opportunity to record gaze behavior of children and adolescents with and without Autism Spectrum Conditions (ASCs) during social interaction. The objective was to investigate differences in eye-gaze behavior between three groups of children and adolescents either (1) with ASC or (2) with unconfirmed diagnosis of ASC or (3) with neurotypical development (NTD) during social interaction with an adult interviewer in a diagnostic standard situation using the ADOS-2. In a case control study, we used mobile eye-tracking glasses in an ecologically valid and highly standardized diagnostic interview to investigate suspected cases of ASC. After completion of the ASC diagnostic gold standard including the ADOS-2, the participants were assigned to two groups based on their diagnosis (ASC vs. non-ASC) and compared with a matched group of neurotypically developed controls. The primary outcome measure is the percentage of total dwell times assessed for different areas of interest (AOI) with regard to the face and body of a diagnostic interviewer and the surrounding space. Overall, 65 children and adolescents within an age range of 8.3–17.9 years were included in the study. The data revealed significant group differences, especially in the central-face area. Previous investigations under laboratory conditions gave preferential attention to the eye region during face perception to describe differences between ASC and NTD. In this study – using an ecologically valid setting within a standard diagnostic procedure – the results indicate that neurotypically developed controls seem to process faces and facial expressions in a holistic manner originating from the central-face region. Conversely, participants on the Autism Spectrum (tAS) seem to avoid the central-face region and show unsystematic gaze behavior, not using the preferred landing position in the central-face region as the Archimedean point of face perception. This study uses a new approach, and it will be important to replicate these preliminary findings in future research.

scholarly journals Use of machine learning to identify autism with natural social gaze behavior (Preprint)

2021 ◽  
Author(s):  
Zhong Zhao ◽  
Haiming Tang ◽  
Xiaobin Zhang ◽  
Xingda Qu ◽  
Jianping Lu
Keyword(s):  
Machine Learning ◽  
Eye Tracking ◽  
Classification Accuracy ◽  
Autism Spectrum ◽  
Support Vector ◽  
Gaze Behavior ◽  
Linear Discriminant ◽  
Face To Face ◽  
Area Of Interest ◽  
Social Gaze

BACKGROUND Abnormal gaze behavior is a prominent feature of the autism spectrum disorder (ASD). Previous eye tracking studies had participants watch images (i.e., picture, video and webpage), and the application of machine learning (ML) on these data showed promising results in identify ASD individuals. Given the fact that gaze behavior differs in face-to-face interaction from image viewing tasks, no study has investigated whether natural social gaze behavior could accurately identify ASD. OBJECTIVE The objective of this study was to examine whether and what area of interest (AOI)-based features extracted from the natural social gaze behavior could identify ASD. METHODS Both children with ASD and typical development (TD) were eye-tracked when they were engaged in a face-to-face conversation with an interviewer. Four ML classifiers (support vector machine, SVM; linear discriminant analysis, LDA; decision tree, DT; and random forest, RF) were used to determine the maximum classification accuracy and the corresponding features. RESULTS A maximum classification accuracy of 84.62% were achieved with three classifiers (LDA, DT and RF). Results showed that the mouth, but not the eyes AOI, was a powerful feature in detecting ASD. CONCLUSIONS Natural gaze behavior could be leveraged to identify ASD, suggesting that ASD might be objectively screened with eye tracking technology in everyday social interaction. In addition, the comparison between our and previous findings suggests that eye tracking features that could identify ASD might be culture dependent and context sensitive.

scholarly journals ROAD SAFETY CAMPAIGNS TO REDUCE TRAFFIC ACCIDENTS FOR YOUNG ROAD USERS

ICCD ◽  
2019 ◽  
Vol 2 (1) ◽  
pp. 601-606
Author(s):  
Widodo Budi Dermawan ◽  
Dewi Nusraningrum
Keyword(s):  
School Environment ◽  
Road Safety ◽  
Traffic Accident ◽  
Traffic Accidents ◽  
Road Traffic ◽  
School Administrators ◽  
Road User ◽  
The Road ◽  
Road Users ◽  
Accident Data

Every year we lose many young road users in road traffic accidents. Based on traffic accident data issued by the Indonesian National Police in 2017, the number of casualties was highest in the age group 15-19, with 3,496 minor injuries, 400 seriously injured and 535 deaths. This condition is very alarming considering that student as the nation's next generation lose their future due to the accidents. This figure does not include other traffic violations, not having a driver license, not wearing a helmet, driving opposite the direction, those given ticket and verbal reprimand. To reduce traffic accident for young road user, road safety campaigns were organized in many schools in Jakarta. This activity aims to socialize the road safety program to increase road safety awareness among young road users/students including the dissemination of Law No. 22 of 2009 concerning Road Traffic and Transportation. Another purpose of this program is to accompany school administrators to set up a School Safe Zone (ZoSS), a location on particular roads in the school environment that are time-based speed zone to set the speed of the vehicle. The purpose of this paper is to promote the road safety campaigns strategies by considering various campaign tools.

scholarly journals The spatial distribution of eye movements predicts the (false) recognition of emotional facial expressions

PLoS ONE ◽  
2021 ◽  
Vol 16 (1) ◽  
pp. e0245777
Author(s):  
Fanny Poncet ◽  
Robert Soussignan ◽  
Margaux Jaffiol ◽  
Baptiste Gaudelus ◽  
Arnaud Leleu ◽  
...  
Keyword(s):  
Spatial Distribution ◽  
Eye Movements ◽  
Eye Tracking ◽  
Facial Expressions ◽  
False Recognition ◽  
Recognition Task ◽  
Visual Exploration ◽  
Emotional Expressions ◽  
Facial Emotions ◽  
The Face

Recognizing facial expressions of emotions is a fundamental ability for adaptation to the social environment. To date, it remains unclear whether the spatial distribution of eye movements predicts accurate recognition or, on the contrary, confusion in the recognition of facial emotions. In the present study, we asked participants to recognize facial emotions while monitoring their gaze behavior using eye-tracking technology. In Experiment 1a, 40 participants (20 women) performed a classic facial emotion recognition task with a 5-choice procedure (anger, disgust, fear, happiness, sadness). In Experiment 1b, a second group of 40 participants (20 women) was exposed to the same materials and procedure except that they were instructed to say whether (i.e., Yes/No response) the face expressed a specific emotion (e.g., anger), with the five emotion categories tested in distinct blocks. In Experiment 2, two groups of 32 participants performed the same task as in Experiment 1a while exposed to partial facial expressions composed of actions units (AUs) present or absent in some parts of the face (top, middle, or bottom). The coding of the AUs produced by the models showed complex facial configurations for most emotional expressions, with several AUs in common. Eye-tracking data indicated that relevant facial actions were actively gazed at by the decoders during both accurate recognition and errors. False recognition was mainly associated with the additional visual exploration of less relevant facial actions in regions containing ambiguous AUs or AUs relevant to other emotional expressions. Finally, the recognition of facial emotions from partial expressions showed that no single facial actions were necessary to effectively communicate an emotional state. In contrast, the recognition of facial emotions relied on the integration of a complex set of facial cues.

Sign in / Sign up

Export Citation Format

Share Document