Real Time Visual Cues Extraction for Monitoring Driver Vigilance

2001 ◽  
pp. 107-124 ◽  
Author(s):  
Qiang Ji ◽  
Xiaojie Yang
Keyword(s):  
Real Time ◽  
Visual Cues

Driver inattention monitoring system based on multimodal fusion with visual cues to improve driving safety

2016 ◽  
Vol 40 (3) ◽  
pp. 885-895 ◽  
Author(s):  
Xuanpeng Li ◽  
Emmanuel Seignez
Keyword(s):  
Real Time ◽  
Monitoring System ◽  
Visual Cues ◽  
Real Life ◽  
Multimodal Fusion ◽  
Driving Safety ◽  
Driver Drowsiness ◽  
Driver Monitoring ◽  
Driver Inattention ◽  
Multi Level

Driver inattention, either driver drowsiness or distraction, is a major contributor to serious traffic crashes. In general, most research on this topic studies driver drowsiness and distraction separately, and is often conducted in a well-controlled, simulated environment. By considering the reliability and flexibility of real-time driver monitoring systems, it is possible to evaluate driver inattention by the fusion of multiple selected cues in real life scenarios. This paper presents a real-time, visual-cue-based driver monitoring system, which can track both multi-level driver drowsiness and distraction simultaneously. A set of visual cues are adopted via analysis of drivers’ physical behaviour and driving performance. Driver drowsiness is evaluated using a multi-level scale, by applying evidence theory. Additionally, a general framework of extensive hierarchical combinations is used to generate a probabilistic evaluation of driving risk in real time. This driver inattention monitoring system with multimodal fusion has been proven to improve the accuracy of risk evaluation and reduce the rate of false alarms, and acceptance of the system is recommended.

scholarly journals Exploiting visual cues for safe and flexible cyber-physical production systems

2019 ◽  
Vol 11 (12) ◽  
pp. 168781401989722
Author(s):  
Syed Osama Bin Islam ◽  
Waqas Akbar Lughmani ◽  
Waqar Shahid Qureshi ◽  
Azfar Khalid ◽  
Miguel Angel Mariscal ◽  
...  
Keyword(s):  
Real Time ◽  
Visual Cues ◽  
Production Systems ◽  
Impedance Control ◽  
Simultaneous Detection ◽  
Dynamic Changes ◽  
Collaborative Robots ◽  
Time Dynamic ◽  
Knowledge Reasoning ◽  
Cyber Physical Production Systems

Human workers are envisioned to work alongside robots and other intelligent factory modules, and fulfill supervision tasks in future smart factories. Technological developments, during the last few years, in the field of smart factory automation have introduced the concept of cyber-physical systems, which further expanded to cyber-physical production systems. In this context, the role of collaborative robots is significant and depends largely on the advanced capabilities of collision detection, impedance control, and learning new tasks based on artificial intelligence. The system components, collaborative robots, and humans need to communicate for collective decision-making. This requires processing of shared information keeping in consideration the available knowledge, reasoning, and flexible systems that are resilient to the real-time dynamic changes on the industry floor as well as within the communication and computer network infrastructure. This article presents an ontology-based approach to solve industrial scenarios for safety applications in cyber-physical production systems. A case study of an industrial scenario is presented to validate the approach in which visual cues are used to detect and react to dynamic changes in real time. Multiple scenarios are tested for simultaneous detection and prioritization to enhance the learning surface of the intelligent production system with the goal to automate safety-based decisions.

Establishing a Quantitative Endpoint for Transarterial Embolization From Real-Time Pressure Measurements

2020 ◽  
Vol 15 (2) ◽  
Author(s):  
Prateek C. Gowda ◽  
Victoria X. Chen ◽  
Miguel C. Sobral ◽  
Taylor L. Bobrow ◽  
Tatiana Gelaf Romer ◽  
...  
Keyword(s):  
Blood Flow ◽  
Real Time ◽  
Visual Cues ◽  
Time Pressure ◽  
Transarterial Embolization ◽  
Injection Pressure ◽  
Standard Of Care ◽  
Pressure Curve ◽  
Target Tissue

Abstract Transarterial embolization (TAE) is a standard-of-care treatment for tumors in which embolic particles are locally injected via a catheter to occlude blood flow and induce ischemia in the target tissue. Physicians currently rely on subjective visual cues from fluoroscopy in order to determine the procedural endpoint relative to the injection site. This contributes to highly variable treatment outcomes, including the accumulation of embolic particles in healthy tissue, called off-target embolization. To address this concern, we describe a novel, multilumen catheter that 1) measures real-time pressure upstream of the tumor site during TAE injection; and 2) associates that measurement with the volume of embolic particles injected. Using an in vitro silicon vascular model, we characterize the relationship between blood flow, intravascular pressure, and injection pressure. Furthermore, we identify a predictive pressure curve based on the volume of embolic particles injected. This approach has the potential to standardize and optimize TAE, reducing the likelihood of incomplete or off-target embolization, and improving patient outcomes.

Real-time Object Tracking of a Robot Head Based on Multiple Visual Cues Integration

2006 ◽  
Author(s):  
Yunting Pang ◽  
Qiang Huang ◽  
Weimin Zhang ◽  
Zhangfeng Hu ◽  
Altaf Rajpar ◽  
...  
Keyword(s):  
Object Tracking ◽  
Real Time ◽  
Visual Cues ◽  
Robot Head

EXPLOITING VISUAL CUES FOR LEARNING GAIT PATTERNS ASSOCIATED WITH NEUROLOGICAL DISORDERS

2017 ◽  
Vol 79 (3) ◽  
Author(s):  
Kuhelee Roy ◽  
Geelapaturu Subrahmanya Venkata Radha Krish Rao ◽  
Savarimuthu, Margret Anouncia
Keyword(s):  
Early Diagnosis ◽  
Real Time ◽  
Neurological Disorders ◽  
Visual Cues ◽  
Gait Pattern ◽  
Shape Features ◽  
Gait Patterns ◽  
Normal Gait ◽  
Abnormal Gait ◽  
Gait Abnormalities

Records of cases involving neurological disorders often exhibit abnormalities in the gait pattern of an individual. As mentioned in various articles, the causes of various gait disorders can be attributed to neurological disorders. Hence analysis of gait abnormalities can be a key to predict the type of neurological disorders as a part of early diagnosis. A number of sensor-based measurements have aided towards quantifying the degree of abnormalities in a gait pattern. A shape oriented motion based approach has been proposed in this paper to envisage the task of classifying an abnormal gait pattern into one of the five types of gait viz. Parkinsonian, Scissor, Spastic, Steppage and Normal gait. The motion and shape features for two cases viz. right-leg-front and left-leg-front will be taken into account. Experimental results of application on real-time videos suggest the reliability of the proposed method.

scholarly journals Real-Time Auditory Feedback–Induced Adaptation to Walking Among Seniors Using the Heel2Toe Sensor: Proof-of-Concept Study

10.2196/13889 ◽  
2019 ◽  
Vol 6 (2) ◽  
pp. e13889
Author(s):  
Kedar KV Mate ◽  
Ahmed Abou-Sharkh ◽  
José A Morais ◽  
Nancy E Mayo
Keyword(s):  
Real Time ◽  
Auditory Feedback ◽  
Visual Cues ◽  
Gait Training ◽  
Gait Pattern ◽  
Arm Swing ◽  
Simple Strategy ◽  
Minute Period ◽  
Gait Parameters ◽  
Strategy Changes

Background Evidence shows that gait training in older adults is effective in improving the gait pattern, but the effects abate with cessation of training. During gait training, therapists use a number of verbal and visual cues to place the heel first when stepping. This simple strategy changes posture from stooped to upright, lengthens the stride, stimulates pelvic and trunk rotation, and facilitates arm swing. These principles guided the development of the Heel2Toe sensor that provides real-time auditory feedback for each good step, in which the heel strikes first. Objective This feasibility study aimed (1) to contribute evidence toward the feasibility and efficacy potential for home use of the Heel2Toe sensor that provides real-time feedback and (2) to estimate changes in gait parameters after five training sessions using the sensor. Methods A pre-post study included 5 training sessions over 2 weeks in the community on a purposive sample of six seniors. Proportion of good steps, angular velocity (AV) at each step, and cadence over a 2- minute period were assessed as was usability and experience. Results All gait parameters, proportion of good steps, AV, and duration of walking bouts improved. The coefficient of variation of AV decreased, indicating consistency of stepping. Conclusions Efficacy potential and feasibility of the Heel2Toe sensor were demonstrated.

scholarly journals Real-Time Auditory Feedback–Induced Adaptation to Walking Among Seniors Using the Heel2Toe Sensor: Proof-of-Concept Study (Preprint)

2019 ◽  
Author(s):  
Kedar K.V. Mate ◽  
Ahmed Abou-Sharkh ◽  
José A. Morais ◽  
Nancy E. Mayo
Keyword(s):  
Real Time ◽  
Auditory Feedback ◽  
Visual Cues ◽  
Gait Training ◽  
Gait Pattern ◽  
Arm Swing ◽  
Simple Strategy ◽  
Minute Period ◽  
Gait Parameters ◽  
Strategy Changes

BACKGROUND Evidence shows that gait training in older adults is effective in improving the gait pattern, but the effects abate with cessation of training. During gait training, therapists use a number of verbal and visual cues to place the heel first when stepping. This simple strategy changes posture from stooped to upright, lengthens the stride, stimulates pelvic and trunk rotation, and facilitates arm swing. These principles guided the development of the Heel2Toe sensor that provides real-time auditory feedback for each good step, in which the heel strikes first. OBJECTIVE This feasibility study aimed (1) to contribute evidence toward the feasibility and efficacy potential for home use of the Heel2Toe sensor that provides real-time feedback and (2) to estimate changes in gait parameters after five training sessions using the sensor. METHODS A pre-post study included 5 training sessions over 2 weeks in the community on a purposive sample of six seniors. Proportion of good steps, angular velocity (AV) at each step, and cadence over a 2- minute period were assessed as was usability and experience. RESULTS All gait parameters, proportion of good steps, AV, and duration of walking bouts improved. The coefficient of variation of AV decreased, indicating consistency of stepping. CONCLUSIONS Efficacy potential and feasibility of the Heel2Toe sensor were demonstrated.

Workstation-Based Man-in-the-Loop Simulation for Multibody Systems

1990 ◽  
Author(s):  
J. L. Chang ◽  
S. S. Kim
Keyword(s):  
Real Time ◽  
Dynamic Simulation ◽  
High Speed ◽  
Visual Cues ◽  
Parallel Computer ◽  
Hydraulic Systems ◽  
Recursive Formulation ◽  
Time Dynamic ◽  
Time Dynamics ◽  
Operator Interface

Abstract This paper presents a general approach to achieving real-time man-in-the-loop simulation for multibody dynamic systems. Emerging real-time dynamic simulation methods are used to demonstrate the potential for creating interactive design workstations with a human operator in the control loop. The recursive formulation of multibody system dynamics with relative coordinates is employed for efficient numerical analysis and implementation on parallel computer. A workstation-based simulator is developed by integrating the real-time dynamics program, a realistic graphics display, and the operator’s control interface. High speed computer graphics techniques are employed to create realistic visual cues for the simulator. Real-time man-in-the-loop simulation is analyzed, as regards the goal of real clock time, not only with respect to dynamic simulation but also with respect to graphics display and the operator interface. Synchronization of the simulation is found to be most important for realism of the simulator. A backhoe simulation is implemented to demonstrate the capability for man-in-the-loop simulation. The backhoe simulator is developed by modeling backhoe dynamics and hydraulic systems with the recursive formulation to achieve real-time simulation, developing an interactive graphics program for visual cues, and interfacing the operator’s control action with the dynamic simulation through a pair of joysticks.

Sign in / Sign up

Export Citation Format

Share Document