Automated detection of grade-crossing-trespassing near misses based on computer vision analysis of surveillance video data

2018 ◽  
Vol 110 ◽  
pp. 276-285 ◽  
Author(s):  
Zhipeng Zhang ◽  
Chintan Trivedi ◽  
Xiang Liu
Keyword(s):  
Computer Vision ◽  
Automated Detection ◽  
Video Data ◽  
Surveillance Video ◽  
Near Misses ◽  
Grade Crossing

scholarly journals The Use of Closed-Circuit Television and Video in Suicide Prevention: Narrative Review and Future Directions

10.2196/27663 ◽  
2021 ◽  
Vol 8 (5) ◽  
pp. e27663
Author(s):  
Sandersan Onie ◽  
Xun Li ◽  
Morgan Liang ◽  
Arcot Sowmya ◽  
Mark Erik Larsen
Keyword(s):  
Computer Vision ◽  
Early Intervention ◽  
Suicide Attempt ◽  
Detection System ◽  
Automated Detection ◽  
Video Data ◽  
Narrative Review ◽  
Closed Circuit ◽  
Closed Circuit Television ◽  
Area Of Interest

Background Suicide is a recognized public health issue, with approximately 800,000 people dying by suicide each year. Among the different technologies used in suicide research, closed-circuit television (CCTV) and video have been used for a wide array of applications, including assessing crisis behaviors at metro stations, and using computer vision to identify a suicide attempt in progress. However, there has been no review of suicide research and interventions using CCTV and video. Objective The objective of this study was to review the literature to understand how CCTV and video data have been used in understanding and preventing suicide. Furthermore, to more fully capture progress in the field, we report on an ongoing study to respond to an identified gap in the narrative review, by using a computer vision–based system to identify behaviors prior to a suicide attempt. Methods We conducted a search using the keywords “suicide,” “cctv,” and “video” on PubMed, Inspec, and Web of Science. We included any studies which used CCTV or video footage to understand or prevent suicide. If a study fell into our area of interest, we included it regardless of the quality as our goal was to understand the scope of how CCTV and video had been used rather than quantify any specific effect size, but we noted the shortcomings in their design and analyses when discussing the studies. Results The review found that CCTV and video have primarily been used in 3 ways: (1) to identify risk factors for suicide (eg, inferring depression from facial expressions), (2) understanding suicide after an attempt (eg, forensic applications), and (3) as part of an intervention (eg, using computer vision and automated systems to identify if a suicide attempt is in progress). Furthermore, work in progress demonstrates how we can identify behaviors prior to an attempt at a hotspot, an important gap identified by papers in the literature. Conclusions Thus far, CCTV and video have been used in a wide array of applications, most notably in designing automated detection systems, with the field heading toward an automated detection system for early intervention. Despite many challenges, we show promising progress in developing an automated detection system for preattempt behaviors, which may allow for early intervention.

Topic-based Video Analysis

2021 ◽  
Vol 54 (6) ◽  
pp. 1-34
Author(s):  
Ratnabali Pal ◽  
Arif Ahmed Sekh ◽  
Debi Prosad Dogra ◽  
Samarjit Kar ◽  
Partha Pratim Roy ◽  
...  
Keyword(s):  
Computer Vision ◽  
Video Analysis ◽  
Visual Surveillance ◽  
Video Data ◽  
Camera Motion ◽  
Topic Modelling ◽  
Surveillance Video ◽  
Analysis Computer ◽  
Manual Processing ◽  
Spatio Temporal

Manual processing of a large volume of video data captured through closed-circuit television is challenging due to various reasons. First, manual analysis is highly time-consuming. Moreover, as surveillance videos are recorded in dynamic conditions such as in the presence of camera motion, varying illumination, or occlusion, conventional supervised learning may not work always. Thus, computer vision-based automatic surveillance scene analysis is carried out in unsupervised ways. Topic modelling is one of the emerging fields used in unsupervised information processing. Topic modelling is used in text analysis, computer vision applications, and other areas involving spatio-temporal data. In this article, we discuss the scope, variations, and applications of topic modelling, particularly focusing on surveillance video analysis. We have provided a methodological survey on existing topic models, their features, underlying representations, characterization, and applications in visual surveillance’s perspective. Important research papers related to topic modelling in visual surveillance have been summarized and critically analyzed in this article.

scholarly journals The Use of Closed-Circuit Television and Video in Suicide Prevention: Narrative Review and Future Directions (Preprint)

2021 ◽  
Author(s):  
Sandersan Onie ◽  
Xun Li ◽  
Morgan Liang ◽  
Arcot Sowmya ◽  
Mark Erik Larsen
Keyword(s):  
Computer Vision ◽  
Early Intervention ◽  
Suicide Attempt ◽  
Detection System ◽  
Automated Detection ◽  
Video Data ◽  
Narrative Review ◽  
Closed Circuit ◽  
Closed Circuit Television ◽  
Area Of Interest

BACKGROUND Suicide is a recognized public health issue, with approximately 800,000 people dying by suicide each year. Among the different technologies used in suicide research, closed-circuit television (CCTV) and video have been used for a wide array of applications, including assessing crisis behaviors at metro stations, and using computer vision to identify a suicide attempt in progress. However, there has been no review of suicide research and interventions using CCTV and video. OBJECTIVE The objective of this study was to review the literature to understand how CCTV and video data have been used in understanding and preventing suicide. Furthermore, to more fully capture progress in the field, we report on an ongoing study to respond to an identified gap in the narrative review, by using a computer vision–based system to identify behaviors prior to a suicide attempt. METHODS We conducted a search using the keywords “suicide,” “cctv,” and “video” on PubMed, Inspec, and Web of Science. We included any studies which used CCTV or video footage to understand or prevent suicide. If a study fell into our area of interest, we included it regardless of the quality as our goal was to understand the scope of how CCTV and video had been used rather than quantify any specific effect size, but we noted the shortcomings in their design and analyses when discussing the studies. RESULTS The review found that CCTV and video have primarily been used in 3 ways: (1) to identify risk factors for suicide (eg, inferring depression from facial expressions), (2) understanding suicide after an attempt (eg, forensic applications), and (3) as part of an intervention (eg, using computer vision and automated systems to identify if a suicide attempt is in progress). Furthermore, work in progress demonstrates how we can identify behaviors prior to an attempt at a hotspot, an important gap identified by papers in the literature. CONCLUSIONS Thus far, CCTV and video have been used in a wide array of applications, most notably in designing automated detection systems, with the field heading toward an automated detection system for early intervention. Despite many challenges, we show promising progress in developing an automated detection system for preattempt behaviors, which may allow for early intervention.

scholarly journals Natural Language Description of Videos for Smart Surveillance

2021 ◽  
Vol 11 (9) ◽  
pp. 3730
Author(s):  
Aniqa Dilawari ◽  
Muhammad Usman Ghani Khan ◽  
Yasser D. Al-Otaibi ◽  
Zahoor-ur Rehman ◽  
Atta-ur Rahman ◽  
...  
Keyword(s):  
Natural Language ◽  
Feature Recognition ◽  
Scene Recognition ◽  
Video Data ◽  
Surveillance Video ◽  
Video Footage ◽  
Parallel Pipeline ◽  
September 11 Attacks ◽  
Description Framework ◽  
High Level

After the September 11 attacks, security and surveillance measures have changed across the globe. Now, surveillance cameras are installed almost everywhere to monitor video footage. Though quite handy, these cameras produce videos in a massive size and volume. The major challenge faced by security agencies is the effort of analyzing the surveillance video data collected and generated daily. Problems related to these videos are twofold: (1) understanding the contents of video streams, and (2) conversion of the video contents to condensed formats, such as textual interpretations and summaries, to save storage space. In this paper, we have proposed a video description framework on a surveillance dataset. This framework is based on the multitask learning of high-level features (HLFs) using a convolutional neural network (CNN) and natural language generation (NLG) through bidirectional recurrent networks. For each specific task, a parallel pipeline is derived from the base visual geometry group (VGG)-16 model. Tasks include scene recognition, action recognition, object recognition and human face specific feature recognition. Experimental results on the TRECViD, UET Video Surveillance (UETVS) and AGRIINTRUSION datasets depict that the model outperforms state-of-the-art methods by a METEOR (Metric for Evaluation of Translation with Explicit ORdering) score of 33.9%, 34.3%, and 31.2%, respectively. Our results show that our framework has distinct advantages over traditional rule-based models for the recognition and generation of natural language descriptions.

Differentiating Laparoscopic Skills of Trainees with Computer Vision Based Metrics

2021 ◽  
Vol 65 (1) ◽  
pp. 304-308
Author(s):  
Shiyu Deng ◽  
Chaitanya Kulkarni ◽  
Tianzi Wang ◽  
Jacob Hartman-Kenzler ◽  
Laura E. Barnes ◽  
...  
Keyword(s):  
Computer Vision ◽  
Transfer Task ◽  
High Sensitivity ◽  
Video Data ◽  
Machine Learning Algorithms ◽  
Fixation Rate ◽  
Skill Levels ◽  
Stationary Target ◽  
Practice Trials ◽  
Context Dependent

Context dependent gaze metrics, derived from eye movements explicitly associated with how a task is being performed, are particularly useful for formative assessment that includes feedback on specific behavioral adjustments for skill acquisitions. In laparoscopic surgery, context dependent gaze metrics are under investigated and commonly derived by either qualitatively inspecting the videos frame by frame or mapping the fixations onto a static surgical task field. This study collected eye-tracking and video data from 13 trainees practicing the peg transfer task. Machine learning algorithms in computer vision were employed to derive metrics of tool speed, fixation rate on (moving or stationary) target objects, and fixation rate on tool-object combination. Preliminary results from a clustering analysis on the measurements from 499 practice trials indicated that the metrics were able to differentiate three skill levels amongst the trainees, suggesting high sensitivity and potential of context dependent gaze metrics for surgical assessment.

FEASIBILITY ANALYSIS OF AN AUTOMATED DETECTION OF PHYSICAL DEFECT VIA COMPUTER VISION

2015 ◽  
Vol 76 (12) ◽  
Author(s):  
Por Jing Zhao ◽  
Shafriza Nisha Basah ◽  
Shazmin Aniza Abdul Shukor
Keyword(s):  
Computer Vision ◽  
Low Cost ◽  
Image Data ◽  
Automated Detection ◽  
Building Construction ◽  
High Demand ◽  
Major City ◽  
Cost System ◽  
Kinect Camera ◽  
Wall Condition

High demand of building construction has been taking places in the major city of Malaysia. However, despite this magnificent development, the lack of proper maintenance has caused a large portion of these properties deteriorated over time. The implementation of the project - Automated Detection of Physical Defect via Computer Vision - is a low cost system that helps to inspect the wall condition using Kinect camera. The system is able to classify the types of physical defects -crack and hole - and state its level of severity.The system uses artificial neural network as the image classifier due to its reliability and consistency. The validity of the system is shown using experiments on synthetic and real image data. This automated physical defect detection could detect building defect early, quickly, and easily, which results in cost saving and extending building life span. 

Performance Evaluation of Different Cost Functions in Motion Vector Estimation

2014 ◽  
Vol 5 (1) ◽  
pp. 45-65 ◽  
Author(s):  
Suvojit Acharjee ◽  
Sayan Chakraborty ◽  
Wahiba Ben Abdessalem Karaa ◽  
Ahmad Taher Azar ◽  
Nilanjan Dey
Keyword(s):  
Video Compression ◽  
Motion Vector ◽  
Video Data ◽  
Cost Functions ◽  
Absolute Difference ◽  
Surveillance Video ◽  
Mean Absolute Difference ◽  
Vector Estimation ◽  
The Difference ◽  
Temporal Redundancy

Video is an important medium in terms of information sharing in this present era. The tremendous growth of video use can be seen in the traditional multimedia application as well as in many other applications like medical videos, surveillance video etc. Raw video data is usually large in size, which demands for video compression. In different video compressing schemes, motion vector is a very important step to remove the temporal redundancy. A frame is first divided into small blocks and then motion vector for each block is computed. The difference between two blocks is evaluated by different cost functions (i.e. mean absolute difference (MAD), mean square error (MSE) etc).In this paper the performance of different cost functions was evaluated and also the most suitable cost function for motion vector estimation was found.

Sign in / Sign up

Export Citation Format

Share Document