Three dimensional dynamic measurements using a stereo vision system and optical flow algorithms for high speed video applications

Author(s):  
Geliztle Alejandra Parra Escamilla ◽  
Victor Eduardo Lopez Padilla
Author(s):  
Sukjune Yoon ◽  
Chun-Kyu Woo ◽  
Hyun Do Choi ◽  
Sung-Kee Park ◽  
Sung-Chul Kang ◽  
...  

The purpose of this project is to develop a mobile robot for hazardous terrain exploration. The exploration of hazardous terrain requires the development of a passive mechanism adaptable to such terrain and a sensing system for obstacle avoidance, as well as a remote control. We designed a new mobile robot, the Ronahz 6-wheel robot, which uses a passive mechanism that can adapt to hazardous terrains and building stairways without any active control. The suggested passive linkage mechanism consists of a simple four-bar linkage mechanism. In addition, we install a stereo vision system for obstacle avoidance, as well as a remote control. Wide dynamic range CCD cameras are used for outdoor navigation. A stereo vision system commonly requires high computational power. Therefore, we use a new high-speed stereo correspondence algorithm, triangulation, and iterative closest point (ICP) registration to reduce computation time. Disparity maps computed by a newly proposed, high-speed method are sent to the operator by a wireless LAN equipment. At the remote control site, a three-dimensional digital map around a mobile robot is built by ICP registration and reconstruction process, and this three-dimensional map is displayed for the operator. This process allows the operator to sense the environment around the robot and to give commands to the mobile robot when the robot is in a remote site.


2021 ◽  
Author(s):  
Jamin Islam

For the purpose of autonomous satellite grasping, a high-speed, low-cost stereo vision system is required with high accuracy. This type of system must be able to detect an object and estimate its range. Hardware solutions are often chosen over software solutions, which tend to be too slow for high frame-rate applications. Designs utilizing field programmable gate arrays (FPGAs) provide flexibility and are cost effective versus solutions that provide similar performance (i.e., Application Specific Integrated Circuits). This thesis presents the architecture and implementation of a high frame-rate stereo vision system based on an FPGA platform. The system acquires stereo images, performs stereo rectification and generates disparity estimates at frame-rates close to 100 fpSi and on a large-enough FPGA, it can process 200 fps. The implementation presents novelties in performance and in the choice of the algorithm implemented. It achieves superior performance to existing systems that estimate scene depth. Furthermore, it demonstrates equivalent accuracy to software implementations of the dynamic programming maximum likelihood stereo correspondence algorithm.


2020 ◽  
Vol 17 (2) ◽  
pp. 172988142091000
Author(s):  
Jiaofei Huo ◽  
Xiaomo Yu

With the development of computer technology and three-dimensional reconstruction technology, three-dimensional reconstruction based on visual images has become one of the research hotspots in computer graphics. Three-dimensional reconstruction based on visual image can be divided into three-dimensional reconstruction based on single photo and video. As an indirect three-dimensional modeling technology, this method is widely used in the fields of film and television production, cultural relics restoration, mechanical manufacturing, and medical health. This article studies and designs a stereo vision system based on two-dimensional image modeling technology. The system can be divided into image processing, camera calibration, stereo matching, three-dimensional point reconstruction, and model reconstruction. In the part of image processing, common image processing methods, feature point extraction algorithm, and edge extraction algorithm are studied. On this basis, interactive local corner extraction algorithm and interactive local edge detection algorithm are proposed. It is found that the Harris algorithm can effectively remove the features of less information and easy to generate clustering phenomenon. At the same time, the method of limit constraints is used to match the feature points extracted from the image. This method has high matching accuracy and short time. The experimental research has achieved good matching results. Using the platform of binocular stereo vision system, each step in the process of three-dimensional reconstruction has achieved high accuracy, thus achieving the three-dimensional reconstruction of the target object. Finally, based on the research of three-dimensional reconstruction of mechanical parts and the designed binocular stereo vision system platform, the experimental results of edge detection, camera calibration, stereo matching, and three-dimensional model reconstruction in the process of three-dimensional reconstruction are obtained, and the full text is summarized, analyzed, and prospected.


2011 ◽  
Vol 5 (3) ◽  
pp. 445-451
Author(s):  
Makoto Yamashita ◽  
◽  
Noriaki Maru ◽  

This article presents the development of a low-cost, high-speed stereo vision system for embedded use employing a mass-produced CMOS imager and a commercially available DSP. We use the system to acquire an image of 96×96 pixels in a period of 1 ms. We embed a read region movement control and a target track function into the system and successfully track a target point within a period of 3 ms. The difference between this high-speed stereo vision system and traditional ones lies in that this system is intended to be used even in a small-scale control system using a microcomputer. We limit the capacity of the image memory in which acquired pixel data is temporarily stored and performed real time processing. As a result, we eliminate frame memory and thus simplify its corresponding circuit. This allows the system to be reduced in size, power consumption, and cost, thereby making the system appropriate for embedded devices, batterypowered robots, and the like.


Sign in / Sign up

Export Citation Format

Share Document