scholarly journals On Assessing Driver Awareness of Situational Criticalities: Multi-modal Bio-Sensing and Vision-Based Analysis, Evaluations, and Insights

2020 ◽  
Vol 10 (1) ◽  
pp. 46
Author(s):  
Siddharth Siddharth ◽  
Mohan M. Trivedi

Automobiles for our roadways are increasingly using advanced driver assistance systems. The adoption of such new technologies requires us to develop novel perception systems not only for accurately understanding the situational context of these vehicles, but also to infer the driver’s awareness in differentiating between safe and critical situations. This manuscript focuses on the specific problem of inferring driver awareness in the context of attention analysis and hazardous incident activity. Even after the development of wearable and compact multi-modal bio-sensing systems in recent years, their application in driver awareness context has been scarcely explored. The capability of simultaneously recording different kinds of bio-sensing data in addition to traditionally employed computer vision systems provides exciting opportunities to explore the limitations of these sensor modalities. In this work, we explore the applications of three different bio-sensing modalities namely electroencephalogram (EEG), photoplethysmogram (PPG) and galvanic skin response (GSR) along with a camera-based vision system in driver awareness context. We assess the information from these sensors independently and together using both signal processing- and deep learning-based tools. We show that our methods outperform previously reported studies to classify driver attention and detecting hazardous/non-hazardous situations for short time scales of two seconds. We use EEG and vision data for high resolution temporal classification (two seconds) while additionally also employing PPG and GSR over longer time periods. We evaluate our methods by collecting user data on twelve subjects for two real-world driving datasets among which one is publicly available (KITTI dataset) while the other was collected by us (LISA dataset) with the vehicle being driven in an autonomous mode. This work presents an exhaustive evaluation of multiple sensor modalities on two different datasets for attention monitoring and hazardous events classification.

Author(s):  
Gerardo Reyes Ruiz ◽  
Marisol Hernández Hernández ◽  
Samuel Olmos Peña

The technology has now ventured into multiple educational environments. The case of augmented reality has served to create new digital environments of search that help the location of any physical reference in a public library. In these educational spaces, it is important to have information resources that are innovative and, simultaneously, which motivate the users to enter them. For physical learning resources, these informative tools must provide a fast and efficient inquiry/location. Augmented reality helps this location by showing, through digital content, the three-dimensional space (3D) of that location, highlighting categories and classifications of physical references so that, in turn, the user able to visualize it, using a mobile device, and is therefore directed to the exact place of the location in a relatively short time. Thus, this study shows that the application of new technologies in a public library can make the user feel immersed in a new learning environment, which is transmitted through a digital environment through augmented reality.


2017 ◽  
Vol 8 (1) ◽  
pp. 36-54
Author(s):  
Buket Celik Ünal ◽  
Onur Ünal

This article describes how the renewable energy sector is increasing in size and wind turbine technology has improved. With the development of internet technology maintenance efficiency has improved. Maintenance is a core activity of the production life cycle since it accounts for 60 to 70% of its total costs. This has led to increased need for maintenance planning and the implementation of new technologies. Shared vision system (SVS) is another enabling technology used for dealing with the increasingly complex maintenance procedures. The main objective of this article is to develop a SVS technology for remote maintenance by enabling cooperation between the technician and the expert. The system represents a solution within the intersection of the areas of problem solving and remote support in the context of collaborative work. As a test case application to show the potential of a SVS considering the following targets: improve time taken to complete maintenance tasks and improve the communication between the technician and the expert.


2014 ◽  
Vol 2 (1) ◽  
pp. 61-72 ◽  
Author(s):  
Masashi Kawaguchi ◽  
Naohiro Ishii ◽  
Takashi Jimbo

In the neural network field, many application models have been proposed. A neuro chip and an artificial retina chip are developed to comprise the neural network model and simulate the biomedical vision system. Previous analog neural network models were composed of the operational amplifier and fixed resistance. It is difficult to change the connection coefficient. In this study, we used analog electronic multiple and sample hold circuits. The connecting weights describe the input voltage. It is easy to change the connection coefficient. This model works only on analog electronic circuits. It can finish the learning process in a very short time and this model will enable more flexible learning.


2018 ◽  
Vol 233 ◽  
pp. 00015 ◽  
Author(s):  
Erik Baalbergen ◽  
Wim Lammen ◽  
Nikita Noskov ◽  
Pier-Davide Ciampa ◽  
Erwin Moerland

Airlines need to continuously extend and modernise their fleets, to keep up with the challenges of air-travel growth, competition, green, safe and secure operations, and growing passenger demands. As a result, the aircraft industry and its supply chain have to manage the growing needs for cost-efficient and complex aircraft in increasingly shorter time. Meanwhile they face their own challenges, such as certification and global competition. Quick evaluation of promising new technologies and concepts facilitates a short time to market. However, the required innovations are costly and risky, and require involvement of many experts from different disciplines and partners. Increasing the level of collaboration within the aircraft industry and its supply chain will be an essential step forward to deal with the challenges. Developing modern aircraft in an increasingly cost and time efficient manner in a collaborative set-up however requires step changes. The EU-funded Horizon2020 project AGILE has developed methods and tools for efficient and cross-organisation collaborative aircraft design, facilitating the rapid evaluation of new technologies and concepts at the early stages of aircraft development. This paper describes the capabilities and illustrates the successful integrated application of the capabilities by means of a collaborative aircraft rudder design evaluation.


Sensors ◽  
2019 ◽  
Vol 19 (14) ◽  
pp. 3220 ◽  
Author(s):  
Carlos Veiga Almagro ◽  
Mario Di Castro ◽  
Giacomo Lunghi ◽  
Raúl Marín Prades ◽  
Pedro José Sanz Valero ◽  
...  

Robotic interventions in hazardous scenarios need to pay special attention to safety, as in most cases it is necessary to have an expert operator in the loop. Moreover, the use of a multi-modal Human-Robot Interface allows the user to interact with the robot using manual control in critical steps, as well as semi-autonomous behaviours in more secure scenarios, by using, for example, object tracking and recognition techniques. This paper describes a novel vision system to track and estimate the depth of metallic targets for robotic interventions. The system has been designed for on-hand monocular cameras, focusing on solving lack of visibility and partial occlusions. This solution has been validated during real interventions at the Centre for Nuclear Research (CERN) accelerator facilities, achieving 95% success in autonomous mode and 100% in a supervised manner. The system increases the safety and efficiency of the robotic operations, reducing the cognitive fatigue of the operator during non-critical mission phases. The integration of such an assistance system is especially important when facing complex (or repetitive) tasks, in order to reduce the work load and accumulated stress of the operator, enhancing the performance and safety of the mission.


2020 ◽  
Vol 17 (9) ◽  
pp. 4145-4149
Author(s):  
A. N. Myna ◽  
K. Deepthi ◽  
Samvrudhi V. Shankar

Music plays an integral role in our lives as the most popular type of recreation. With the advent of new technologies such as Internet and portable media players, large amount of music data is available online which can be distributed and easily made available to people. Enormous amount of music data is released every year by several artists with songs varying in features, genre and so on. Because of this, a need for reliable and easy access of songs based on user preferences is necessary. The recommender system focuses on generating playlists based on the physical, perceptual and acoustical properties of the song (content based filtering approach), or on commonalities between users on a particular basis like ratings or user data history (collaborative filtering). The system thus developed is a hybrid music recommender tool which creates a user centric suggestion system accompanied by feature extraction which in turn enhances the accuracy of music recommendations.


Author(s):  
Valentin Olenev

Introduction: New technologies are replacing the onboard space networks based on bus topologies. One of these technologies is SpaceWire. New communication protocols are being developed, expanding SpaceWire functionality. The protocol developers should provide all the required technical characteristics for data transmission and processing. Purpose: Analysis of the existing requirements for communication protocols, and development of consolidated set of requirements that will take into account the modern requests of the space industry. Results: The analysis of the existing demands on communication protocols resulted in a set of consolidated requirements for the physical-network layers’ protocols and the transport layer protocols. The requirements cover the speed, latencies, transmission distance, transmitted information amount, fault detection functionality, time synchronization between the devices, quality of service, main user data types, and data transfer modes at the transport level. The existing SpaceWire protocols are defined as a special class of protocols, possessing unique characteristics. Practical relevance: The performed analysis can simplify the implementation of new onboard communication protocols and provide a required level of technique for new generation spacecraft.


Micromachines ◽  
2020 ◽  
Vol 11 (12) ◽  
pp. 1055
Author(s):  
Muhammad Asad Bilal Fayyaz ◽  
Christopher Johnson

Multiple projects within the rail industry across different regions have been initiated to address the issue of over-population. These expansion plans and upgrade of technologies increases the number of intersections, junctions, and level crossings. A level crossing is where a railway line is crossed by a road or right of way on the level without the use of a tunnel or bridge. Level crossings still pose a significant risk to the public, which often leads to serious accidents between rail, road, and footpath users and the risk is dependent on their unpredictable behavior. For Great Britain, there were three fatalities and 385 near misses at level crossings in 2015–2016. Furthermore, in its annual safety report, the Rail Safety and Standards Board (RSSB) highlighted the risk of incidents at level crossings during 2016/17 with a further six fatalities at level crossings including four pedestrians and two road vehicles. The relevant authorities have suggested an upgrade of the existing sensing system and the integration of new novel technology at level crossings. The present work addresses this key issue and discusses the current sensing systems along with the relevant algorithms used for post-processing the information. The given information is adequate for a manual operator to make a decision or start an automated operational cycle. Traditional sensors have certain limitations and are often installed as a “single sensor”. The single sensor does not provide sufficient information; hence another sensor is required. The algorithms integrated with these sensing systems rely on the traditional approach, where background pixels are compared with new pixels. Such an approach is not effective in a dynamic and complex environment. The proposed model integrates deep learning technology with the current Vision system (e.g., CCTV to detect and localize an object at a level crossing). The proposed sensing system should be able to detect and localize particular objects (e.g., pedestrians, bicycles, and vehicles at level crossing areas.) The radar system is also discussed for a “two out of two” logic interlocking system in case of fail-mechanism. Different techniques to train a deep learning model are discussed along with their respective results. The model achieved an accuracy of about 88% from the MobileNet model for classification and a loss metric of 0.092 for object detection. Some related future work is also discussed.


Author(s):  
Fernando Figueroa ◽  
Carolyn R. Mercer

NASA’s Stennis Space Center (SSC) and Glenn Research Center (GRC) participate in the development of technologies for propulsion testing and propulsion applications in air and space transportation. Future transportation systems and the test facilities needed to develop and sustain them are becoming increasingly complex. Sensor technology is a fundamental pillar that makes possible development of complex systems that must operate in automatic mode (closed loop systems), or even in assisted-autonomous mode (highly self-sufficient systems such as planetary exploration spacecraft). Hence, a great deal of effort is dedicated to develop new sensors and related technologies to be used in research facilities, test facilities, and in vehicles and equipment. This paper describes sensor technologies being developed and in use at SSC and GRC, including new technologies in integrated health management involving sensors, components, processes, and vehicles.


2006 ◽  
Vol 2 (SPS5) ◽  
pp. 263-264
Author(s):  
Hayk Harutyunian ◽  
Areg Mickaelian

AbstractAstronomical education is entering a new stage of development which is closely connected with the development of new technologies for communication, computing and data visualization. We discuss this evolution in the context of astronomy education in Armenia. As students spend only a short time in Byurakan Observatory for training in observations, they are not able to carry out systematic astronomical observations. Hence their training places emphasis on the use of astronomical archives and analysis of observational data obtained previously with the Byurakan telescopes and other ground-based and space telescopes. Thus, one of the aims of the Armenian Virtual Observatory is to support the training of students in this modern context.


Sign in / Sign up

Export Citation Format

Share Document