Real time area-based stereo matching algorithm for multimedia video devices

2013 ◽  
Vol 21 (4) ◽  
Author(s):  
T. Hachaj ◽  
M. Ogiela
Keyword(s):  
Real Time ◽  
Stereo Matching ◽  
Global Memory ◽  
Stereo Pair ◽  
Processing Unit ◽  
Process Data ◽  
Matching Algorithm ◽  
Knowing That ◽  
Algorithm Configuration ◽  
Graphical Processing

AbstractIn this paper we investigate stereovision algorithms that are suitable for multimedia video devices. The main novel contribution of this article is detailed analysis of modern graphical processing unit (GPU)-based dense local stereovision matching algorithm for real time multimedia applications. We considered two GPU-based implementations and one CPU implementation (as the baseline). The results (in terms of frame per second, fps) were measured twenty times per algorithm configuration and, then averaged (the standard deviation was below 5%). The disparity range was [0,20], [0,40], [0,60], [0,80], [0,100] and [0,120]. We also have used three different matching window sizes (3×3, 5×5 and 7×7) and three stereo pair image resolutions 320×240, 640×480 and 1024×768. We developed our algorithm under assumption that it should process data with the same speed as it arrives from captures’ devices. Because most popular of the shelf video cameras (multimedia video devices) capture data with the frequency of 30Hz, this frequency was threshold to consider implementation of our algorithm to be “real time”. We have proved that our GPU algorithm that uses only global memory can be used successfully in that kind of tasks. It is very important because that kind of implementation is more hardware-independent than algorithms that operate on shared memory. Knowing that we might avoid the algorithms failure while moving the multimedia application between machines operating different hardware. From our knowledge this type of research has not been yet reported.

A Real-Time Photogrammetric System for Acquisition and Monitoring of Three-Dimensional Human Body Kinematics

2021 ◽  
Vol 87 (5) ◽  
pp. 363-373
Author(s):  
Long Chen ◽  
Bo Wu ◽  
Yao Zhao ◽  
Yuan Li
Keyword(s):  
Real Time ◽  
Human Body ◽  
Graphics Processing Unit ◽  
Three Dimensional ◽  
Stereo Pair ◽  
Processing Unit ◽  
Detection Distance ◽  
Human Kinematics ◽  
Graphics Processing ◽  
Time Acquisition

Real-time acquisition and analysis of three-dimensional (3D) human body kinematics are essential in many applications. In this paper, we present a real-time photogrammetric system consisting of a stereo pair of red-green-blue (RGB) cameras. The system incorporates a multi-threaded and graphics processing unit (GPU)-accelerated solution for real-time extraction of 3D human kinematics. A deep learning approach is adopted to automatically extract two-dimensional (2D) human body features, which are then converted to 3D features based on photogrammetric processing, including dense image matching and triangulation. The multi-threading scheme and GPU-acceleration enable real-time acquisition and monitoring of 3D human body kinematics. Experimental analysis verified that the system processing rate reached ∼18 frames per second. The effective detection distance reached 15 m, with a geometric accuracy of better than 1% of the distance within a range of 12 m. The real-time measurement accuracy for human body kinematics ranged from 0.8% to 7.5%. The results suggest that the proposed system is capable of real-time acquisition and monitoring of 3D human kinematics with favorable performance, showing great potential for various applications.

scholarly journals A Real-Time Range Finding System with Binocular Stereo Vision

10.5772/50921 ◽  
2012 ◽  
Vol 9 (1) ◽  
pp. 26 ◽  
Author(s):  
Xiao-Bo Lai ◽  
Hai-Shun Wang ◽  
Yue-Hong Xu
Keyword(s):  
Real Time ◽  
Stereo Vision ◽  
Stereo Matching ◽  
Single Point ◽  
Time Range ◽  
Real Time Control ◽  
Matching Algorithm ◽  
Range Finding ◽  
Binocular Stereo Vision ◽  
Binocular Stereo

To acquire range information for mobile robots, a TMS320DM642 DSP-based range finding system with binocular stereo vision is proposed. Firstly, paired images of the target are captured and a Gaussian filter, as well as improved Sobel kernels, are achieved. Secondly, a feature-based local stereo matching algorithm is performed so that the space location of the target can be determined. Finally, in order to improve the reliability and robustness of the stereo matching algorithm under complex conditions, the confidence filter and the left-right consistency filter are investigated to eliminate the mismatching points. In addition, the range finding algorithm is implemented in the DSP/BIOS operating system to gain real-time control. Experimental results show that the average accuracy of range finding is more than 99% for measuring single-point distances equal to 120cm in the simple scenario and the algorithm takes about 39ms for ranging a time in a complex scenario. The effectivity, as well as the feasibility, of the proposed range finding system are verified.

scholarly journals Literature Survey on Stereo Vision Disparity Map Algorithms

2016 ◽  
Vol 2016 ◽  
pp. 1-23 ◽  
Author(s):  
Rostam Affendi Hamzah ◽  
Haidi Ibrahim
Keyword(s):  
Stereo Vision ◽  
Stereo Matching ◽  
Literature Survey ◽  
Processing Unit ◽  
Stereo Correspondence ◽  
Disparity Map ◽  
Central Processing ◽  
Field Programmable ◽  
Processing Module ◽  
Graphical Processing

This paper presents a literature survey on existing disparity map algorithms. It focuses on four main stages of processing as proposed by Scharstein and Szeliski in a taxonomy and evaluation of dense two-frame stereo correspondence algorithms performed in 2002. To assist future researchers in developing their own stereo matching algorithms, a summary of the existing algorithms developed for every stage of processing is also provided. The survey also notes the implementation of previous software-based and hardware-based algorithms. Generally, the main processing module for a software-based implementation uses only a central processing unit. By contrast, a hardware-based implementation requires one or more additional processors for its processing module, such as graphical processing unit or a field programmable gate array. This literature survey also presents a method of qualitative measurement that is widely used by researchers in the area of stereo vision disparity mappings.

Fast and Parallel Summed Area Table for Fabric Defect Detection

2016 ◽  
Vol 30 (09) ◽  
pp. 1660004 ◽  
Author(s):  
Khaled Ragab
Keyword(s):  
Real Time ◽  
Defect Detection ◽  
Gpu Computing ◽  
Processing Unit ◽  
Detection Algorithms ◽  
Fabric Defect Detection ◽  
Fabric Defect ◽  
Time Requirements ◽  
Robustness To Noise ◽  
Graphical Processing

Automating fabric defect detection has a significant role in fabric industries. However, the existing fabric defect detection algorithms lack the real-time performance that is required in real applications due to their high demanding computation. To ensure real time, high accuracy and reliable fabric defect detection this paper developed a fast and parallel normalized cross-correlation algorithm based on summed-area table technique called PFDD-SAT. To meet real-time requirements, extensive use of the NVIDIA CUDA framework for Graphical Processing Unit (GPU) computing is made. The detailed implementation steps of the PFDD-SAT are illustrated in this paper. Several experiments have been carried out to evaluate the detection time and accuracy and then the robustness to illumination and Gaussian noises. The results show that the PFDD-SAT has robustness to noise and speeds the defect detection process more than 200 times than normal required time and that greatly met the needs for real-time automatic fabric defect detection.

scholarly journals GPU Accelerated real-time Melanoma Detection

2018 ◽  
Vol 7 (3) ◽  
pp. 1208
Author(s):  
Ajai Sunny Joseph ◽  
Elizabeth Isaac
Keyword(s):  
Real Time ◽  
Video Processing ◽  
Processing Technique ◽  
Video Data ◽  
Image Processing Technique ◽  
Processing Unit ◽  
Central Processing ◽  
Melanoma Detection ◽  
Real Time Analysis ◽  
Graphical Processing

Melanoma is recognized as one of the most dangerous type of skin cancer. A novel method to detect melanoma in real time with the help of Graphical Processing Unit (GPU) is proposed. Existing systems can process medical images and perform a diagnosis based on Image Processing technique and Artificial Intelligence. They are also able to perform video processing with the help of large hardware resources at the backend. This incurs significantly higher costs and space and are complex by both software and hardware. Graphical Processing Units have high processing capabilities compared to a Central Processing Unit of a system. Various approaches were used for implementing real time detection of Melanoma. The results and analysis based on various approaches and the best approach based on our study is discussed in this work. A performance analysis for the approaches on the basis of CPU and GPU environment is also discussed. The proposed system will perform real-time analysis of live medical video data and performs diagnosis. The system when implemented yielded an accuracy of 90.133% which is comparable to existing systems.  

scholarly journals Using a Balloon-Launched Unmanned Glider to Validate Real-Time WRF Modeling

Sensors ◽  
2019 ◽  
Vol 19 (8) ◽  
pp. 1914 ◽  
Author(s):  
Travis J. Schuyler ◽  
S. M. Iman Gohari ◽  
Gary Pundsack ◽  
Donald Berchoff ◽  
Marcelo I. Guzman
Keyword(s):  
High Resolution ◽  
Real Time ◽  
Gpu Computing ◽  
Atmospheric Temperature ◽  
Unmanned Aerial Systems ◽  
Processing Unit ◽  
Graphical Processing ◽  
Atmospheric Sampling ◽  
Wrf Modeling ◽  
Weather Models

The use of small unmanned aerial systems (sUAS) for meteorological measurements has expanded significantly in recent years. SUAS are efficient platforms for collecting data with high resolution in both space and time, providing opportunities for enhanced atmospheric sampling. Furthermore, advances in mesoscale weather research and forecasting (WRF) modeling and graphical processing unit (GPU) computing have enabled high resolution weather modeling. In this manuscript, a balloon-launched unmanned glider, complete with a suite of sensors to measure atmospheric temperature, pressure, and relative humidity, is deployed for validation of real-time weather models. This work demonstrates the usefulness of sUAS for validating and improving mesoscale, real-time weather models for advancements toward reliable weather forecasts to enable safe and predictable sUAS missions beyond visual line of sight (BVLOS).

Towards real-time wavefront sensorless adaptive optics using a graphical processing unit (GPU) in a line scanning system

2011 ◽  
Author(s):  
David P. Biss ◽  
Ankit H. Patel ◽  
R. Daniel Ferguson ◽  
Mircea Mujat ◽  
Nicusor Iftimia ◽  
...  
Keyword(s):  
Real Time ◽  
Adaptive Optics ◽  
Graphical Processing Unit ◽  
Scanning System ◽  
Processing Unit ◽  
Line Scanning ◽  
Graphical Processing

A Parallel Stereo Matching Algorithm Core for FPGA Modeled by DSP Builder

2014 ◽  
Vol 536-537 ◽  
pp. 67-76
Author(s):  
Xiang Zhang ◽  
Zhang Wei Chen
Keyword(s):  
Stereo Matching ◽  
Cost Calculation ◽  
Stereo Pair ◽  
Disparity Map ◽  
High Definition ◽  
Matching Algorithm ◽  
Census Transform ◽  
Cost Aggregation ◽  
Dsp Builder ◽  
Fpga Chip

This paper proposes a FPGA implementation to apply a stereo matching algorithm based on a kind of sparse census transform in a FPGA chip which can provide a high-definition dense disparity map in real-time. The parallel stereo matching algorithm core involves census transform, cost calculation and cost aggregation modules. The circuits of the algorithm core are modeled by the Matlab/Simulink-based tool box: DSP Builder. The system can process many different sizes of stereo pair images through a configuration interface. The maximum horizon resolution of stereo images is 2048.

scholarly journals Observations of transients and pulsars with LOFAR international stations and the ARTEMIS backend

2012 ◽  
Vol 8 (S291) ◽  
pp. 492-494 ◽  
Author(s):  
Maciej Serylak ◽  
Aris Karastergiou ◽  
Chris Williams ◽  
Wesley Armour ◽  
Michael Giles ◽  
...  
Keyword(s):  
Real Time ◽  
Low Frequency ◽  
Identification System ◽  
Processing Unit ◽  
Transient Event ◽  
New Radio ◽  
Digital Hardware ◽  
Graphical Processing ◽  
Radio Transients ◽  
Millisecond Radio

AbstractThe LOw Frequency ARray – LOFAR – is a new radio interferometer designed with emphasis on flexible digital hardware instead of mechanical solutions. The array elements, so-called stations, are located in the Netherlands and in neighbouring countries. The design of LOFAR allows independent use of its international stations, which, coupled with a dedicated backend, makes them very powerful telescopes in their own right. This backend is called the Advanced Radio Transient Event Monitor and Identification System (ARTEMIS). It is a combined software/hardware solution for both targeted observations and real-time searches for millisecond radio transients which uses Graphical Processing Unit (GPU) technology to remove interstellar dispersion and detect millisecond radio bursts from astronomical sources in real-time.

Sign in / Sign up

Export Citation Format

Share Document