Behind-The-Scenes (BTS): Wiper-Occlusion Canceling for Advanced Driver Assistance Systems in Adverse Rain Environments

Driving in an adverse rain environment is a crucial challenge for vision-based advanced driver assistance systems (ADAS) in the automotive industry. The vehicle windshield wiper removes adherent raindrops that cause distorted images from in-vehicle frontal view cameras, but, additionally, it causes an occlusion that can hinder visibility at the same time. The wiper-occlusion causes erroneous judgments by vision-based applications and endangers safety. This study proposes behind-the-scenes (BTS) that detects and removes wiper-occlusion in real-time image inputs under rainy weather conditions. The pixel-wise wiper masks are detected by high-pass filtering to predict the optical flow of a sequential image pair. We fine-tuned a deep learning-based optical flow model with a synthesized dataset, which was generated with pseudo-ground truth wiper masks and flows using auto-labeling with acquired real rainy images. A typical optical flow dataset with static synthetic objects is synthesized with real fast-moving objects to enhance data diversity. We annotated wiper masks and scenes as detection ground truths from the collected real images for evaluation. BTS outperforms by achieving a 0.962 SSIM and 91.6% F1 score in wiper mask detection and 88.3% F1 score in wiper image detection. Consequently, BTS enhanced the performance of vision-based image restoration and object detection applications by canceling occlusions and demonstrated it potential role in improving ADAS under rainy weather conditions.

A Review of Model Predictive Controls Applied to Advanced Driver-Assistance Systems

Advanced Driver-Assistance Systems (ADASs) are currently gaining particular attention in the automotive field, as enablers for vehicle energy consumption, safety, and comfort enhancement. Compelling evidence is in fact provided by the variety of related studies that are to be found in the literature. Moreover, considering the actual technology readiness, larger opportunities might stem from the combination of ADASs and vehicle connectivity. Nevertheless, the definition of a suitable control system is not often trivial, especially when dealing with multiple-objective problems and dynamics complexity. In this scenario, even though diverse strategies are possible (e.g., Equivalent Consumption Minimization Strategy, Rule-based strategy, etc.), the Model Predictive Control (MPC) turned out to be among the most effective ones in fulfilling the aforementioned tasks. Hence, the proposed study is meant to produce a comprehensive review of MPCs applied to scenarios where ADASs are exploited and aims at providing the guidelines to select the appropriate strategy. More precisely, particular attention is paid to the prediction phase, the objective function formulation and the constraints. Subsequently, the interest is shifted to the combination of ADASs and vehicle connectivity to assess for how such information is handled by the MPC. The main results from the literature are presented and discussed, along with the integration of MPC in the optimal management of higher level connection and automation. Current gaps and challenges are addressed to, so as to possibly provide hints on future developments.

Driver perceptions of advanced driver assistance systems: A case study

Background: Automobile manufacturers need to have an insight and understand how consumers, specifically drivers, respond to the advanced driver assistance systems (ADAS) technology in their manufactured vehicles. This study reveals drivers’ perceptions of Malaysia’s advanced driver assistance systems, which is currently lacking in the literature. So far, other studies have focused on countries that are unlike Malaysia’s multi-culture environment. Methods: A survey was designed and distributed using convenience sampling to obtain responses from licensed drivers. Questions included demographic and driving questions, the perceptions of benefits and obstacles relevant to ADAS use, vehicle decision-making, and technology use. Data were collected from 818 respondents who were licensed drivers in Malaysia. Results were then analysed using statistical approaches. Results: The findings indicated that 76.8% of drivers have a positive attitude towards ADAS technology, particularly safety applications when they are available. Regardless of the accuracy of these systems, acceptance of the technology may shift upon viewing or hearing messages of possible problems with ADAS. Conclusions: It can be concluded that the safety advantages of ADAS technology are less valued by drivers who do not have experience of road traffic accidents. Furthermore, acceptance of the technology could be undermined by assuming that the safety applications could be compromised.

Exploring User Understanding of Advanced Driver Assistance Systems Iconography Using Novel Survey Methods

As advanced driver assistance systems (ADAS) increase in functionality, so do the functional requirements of their visual displays to communicate status and settings. Drivers who misinterpret in-vehicle displays may be more likely to misuse or avoid using ADAS, negating the potential safety benefits. A novel evaluation method is proposed and applied to the (at the time of surveying) latest Volvo instrument cluster. An online survey was completed by 838 Volvo car owners with varying levels of familiarity with adaptive cruise control and pilot assist. Results suggest that the concepts of a system being “available but not on” or “on but not actively providing support” can be difficult for novice users to recognize, resulting in a mode or state confusion. However, more experienced users were less likely to make these types of errors. The assessment method of providing users with partially masked images shows promise as a useful tool for evaluating comprehension of ADAS in-vehicle visual displays.