scholarly journals Smart Black Box 2.0: Efficient High-Bandwidth Driving Data Collection Based on Video Anomalies

Algorithms ◽  
2021 ◽  
Vol 14 (2) ◽  
pp. 57
Author(s):  
Ryan Feng ◽  
Yu Yao ◽  
Ella Atkins

Autonomous vehicles require fleet-wide data collection for continuous algorithm development and validation. The smart black box (SBB) intelligent event data recorder has been proposed as a system for prioritized high-bandwidth data capture. This paper extends the SBB by applying anomaly detection and action detection methods for generalized event-of-interest (EOI) detection. An updated SBB pipeline is proposed for the real-time capture of driving video data. A video dataset is constructed to evaluate the SBB on real-world data for the first time. SBB performance is assessed by comparing the compression of normal and anomalous data and by comparing our prioritized data recording with an FIFO strategy. The results show that SBB data compression can increase the anomalous-to-normal memory ratio by ∼25%, while the prioritized recording strategy increases the anomalous-to-normal count ratio when compared to an FIFO strategy. We compare the real-world dataset SBB results to a baseline SBB given ground-truth anomaly labels and conclude that improved general EOI detection methods will greatly improve SBB performance.

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2133
Author(s):  
Cuong Nguyen Khac ◽  
Yeongyu Choi ◽  
Ju H. Park ◽  
Ho-Youl Jung

Vanishing point (VP) provides extremely useful information related to roads in driving scenes for advanced driver assistance systems (ADAS) and autonomous vehicles. Existing VP detection methods for driving scenes still have not achieved sufficiently high accuracy and robustness to apply for real-world driving scenes. This paper proposes a robust motion-based road VP detection method to compensate for the deficiencies. For such purposes, three main processing steps often used in the existing road VP detection methods are carefully examined. Based on the analysis, stable motion detection, stationary point-based motion vector selection, and angle-based RANSAC (RANdom SAmple Consensus) voting are proposed. A ground-truth driving dataset including various objects and illuminations is used to verify the robustness and real-time capability of the proposed method. The experimental results show that the proposed method outperforms the existing motion-based and edge-based road VP detection methods for various illumination conditioned driving scenes.


2019 ◽  
Vol 147 (5) ◽  
pp. 1429-1445 ◽  
Author(s):  
Yuchu Zhao ◽  
Zhengyu Liu ◽  
Fei Zheng ◽  
Yishuai Jin

Abstract We performed parameter estimation in the Zebiak–Cane model for the real-world scenario using the approach of ensemble Kalman filter (EnKF) data assimilation and the observational data of sea surface temperature and wind stress analyses. With real-world data assimilation in the coupled model, our study shows that model parameters converge toward stable values. Furthermore, the new parameters improve the real-world ENSO prediction skill, with the skill improved most by the parameter of the highest climate sensitivity (gam2), which controls the strength of anomalous upwelling advection term in the SST equation. The improved prediction skill is found to be contributed mainly by the improvement in the model dynamics, and second by the improvement in the initial field. Finally, geographic-dependent parameter optimization further improves the prediction skill across all the regions. Our study suggests that parameter optimization using ensemble data assimilation may provide an effective strategy to improve climate models and their real-world climate predictions in the future.


BMC Cancer ◽  
2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Tae-Hwan Kim ◽  
Hun Do Cho ◽  
Yong Won Choi ◽  
Hyun Woo Lee ◽  
Seok Yun Kang ◽  
...  

Abstract Background Since the results of the ToGA trial were published, trastuzumab-based chemotherapy has been used as the standard first-line treatment for HER2-positive recurrent or primary metastatic gastric cancer (RPMGC). However, the real-world data has been rarely reported. Therefore, we investigated the outcomes of trastuzumab-based chemotherapy in a single center. Methods This study analyzed the real-world data of 47 patients with HER2-positive RPMGC treated with trastuzumab-based chemotherapy in a single institution. Results With the median follow-up duration of 18.8 months in survivors, the median overall survival (OS) and progression-free survival were 12.8 and 6.9 months, respectively, and the overall response rate was 64%. Eastern Cooperative Oncology Group performance status 2 and massive amount of ascites were independent poor prognostic factors for OS, while surgical resection before or after chemotherapy was associated with favorable OS, in multivariate analysis. In addition, 5 patients who underwent conversion surgery after chemotherapy demonstrated an encouraging median OS of 30.8 months, all with R0 resection. Conclusions Trastuzumab-based chemotherapy in patients with HER2-positive RPMGC in the real world demonstrated outcomes almost comparable to those of the ToGA trial. Moreover, conversion surgery can be actively considered in fit patients with a favorable response after trastuzumab-based chemotherapy.


10.2196/13961 ◽  
2020 ◽  
Vol 22 (4) ◽  
pp. e13961
Author(s):  
Kim Sarah Sczuka ◽  
Lars Schwickert ◽  
Clemens Becker ◽  
Jochen Klenk

Background Falls are a common health problem, which in the worst cases can lead to death. To develop reliable fall detection algorithms as well as suitable prevention interventions, it is important to understand circumstances and characteristics of real-world fall events. Although falls are common, they are seldom observed, and reports are often biased. Wearable inertial sensors provide an objective approach to capture real-world fall signals. However, it is difficult to directly derive visualization and interpretation of body movements from the fall signals, and corresponding video data is rarely available. Objective The re-enactment method uses available information from inertial sensors to simulate fall events, replicate the data, validate the simulation, and thereby enable a more precise description of the fall event. The aim of this paper is to describe this method and demonstrate the validity of the re-enactment approach. Methods Real-world fall data, measured by inertial sensors attached to the lower back, were selected from the Fall Repository for the Design of Smart and Self-Adaptive Environments Prolonging Independent Living (FARSEEING) database. We focused on well-described fall events such as stumbling to be re-enacted under safe conditions in a laboratory setting. For the purposes of exemplification, we selected the acceleration signal of one fall event to establish a detailed simulation protocol based on identified postures and trunk movement sequences. The subsequent re-enactment experiments were recorded with comparable inertial sensor configurations as well as synchronized video cameras to analyze the movement behavior in detail. The re-enacted sensor signals were then compared with the real-world signals to adapt the protocol and repeat the re-enactment method if necessary. The similarity between the simulated and the real-world fall signals was analyzed with a dynamic time warping algorithm, which enables the comparison of two temporal sequences varying in speed and timing. Results A fall example from the FARSEEING database was used to show the feasibility of producing a similar sensor signal with the re-enactment method. Although fall events were heterogeneous concerning chronological sequence and curve progression, it was possible to reproduce a good approximation of the motion of a person’s center of mass during fall events based on the available sensor information. Conclusions Re-enactment is a promising method to understand and visualize the biomechanics of inertial sensor-recorded real-world falls when performed in a suitable setup, especially if video data is not available.


2018 ◽  
Vol 44 (8) ◽  
pp. 1191-1198 ◽  
Author(s):  
Alberto Carmona-Bayonas ◽  
Paula Jiménez-Fonseca ◽  
Isabel Echavarria ◽  
Manuel Sánchez Cánovas ◽  
Gema Aguado ◽  
...  

Author(s):  
Martyna Bogacz ◽  
Stephane Hess ◽  
Chiara Calastri ◽  
Charisma F. Choudhury ◽  
Alexander Erath ◽  
...  

The use of virtual reality (VR) in transport research offers the opportunity to collect behavioral data in a controlled dynamic setting. VR settings are useful in the context of hypothetical situations in which real-world data does not exist or in situations which involve risk and safety issues making real-world data collection infeasible. Nevertheless, VR studies can contribute to transport-related research only if the behavior elicited in a virtual environment closely resembles real-world behavior. Importantly, as VR is a relatively new research tool, the best-practice with regards to the experimental design is still to be established. In this paper, we contribute to a better understanding of the implications of the choice of the experimental setup by comparing cycling behavior in VR between two groups of participants in similar immersive scenarios, the first group controlling the maneuvers using a keyboard and the other group riding an instrumented bicycle. We critically compare the speed, acceleration, braking and head movements of the participants in the two experiments. We also collect electroencephalography (EEG) data to compare the alpha wave amplitudes and assess the engagement levels of participants in the two settings. The results demonstrate the ability of VR to elicit behavioral patterns in line with those observed in the real-world and indicate the importance of the experimental design in a VR environment beyond the choice of audio-visual stimuli. The findings will be useful for researchers in designing the experimental setup of VR for behavioral data collection.


JAMIA Open ◽  
2019 ◽  
Vol 2 (4) ◽  
pp. 416-422
Author(s):  
Laura McDonald ◽  
Varun Behl ◽  
Vijayarakhavan Sundar ◽  
Faisal Mehmud ◽  
Bill Malcolm ◽  
...  

Abstract There is a need to understand how patients are managed in the real world to better understand disease burden and unmet need. Traditional approaches to gather these data include the use of electronic medical record (EMR) or claims databases; however, in many cases data access policies prevent rapid insight gathering. Social media may provide a potential source of real-world data to assess treatment patterns, but the limitations and biases of doing so have not yet been evaluated. Here, we assessed whether patient treatment patterns extracted from publicly available patient forums compare to results from more traditional EMR and claims databases. We observed that the 95% confidence intervals of proportions of treatments received at first, second, and third line for advanced/metastatic melanoma generated from unstructured social media data overlapped with 95% confidence intervals from proportions obtained from 1 or more traditional EMR/Claims databases. Social media may offer a valid data option to understand treatment patterns in the real world.


Sign in / Sign up

Export Citation Format

Share Document