A New Mobile Robot With a Passive Mechanism and a Stereo Vision System for Hazardous Terrain Exploration

2004 ◽  
Author(s):  
Sukjune Yoon ◽  
Chun-Kyu Woo ◽  
Hyun Do Choi ◽  
Sung-Kee Park ◽  
Sung-Chul Kang ◽  
...  
Keyword(s):  
Remote Control ◽  
Mobile Robot ◽  
Obstacle Avoidance ◽  
Stereo Vision ◽  
High Speed ◽  
Vision System ◽  
Three Dimensional ◽  
Linkage Mechanism ◽  
Passive Mechanism ◽  
Stereo Vision System

The purpose of this project is to develop a mobile robot for hazardous terrain exploration. The exploration of hazardous terrain requires the development of a passive mechanism adaptable to such terrain and a sensing system for obstacle avoidance, as well as a remote control. We designed a new mobile robot, the Ronahz 6-wheel robot, which uses a passive mechanism that can adapt to hazardous terrains and building stairways without any active control. The suggested passive linkage mechanism consists of a simple four-bar linkage mechanism. In addition, we install a stereo vision system for obstacle avoidance, as well as a remote control. Wide dynamic range CCD cameras are used for outdoor navigation. A stereo vision system commonly requires high computational power. Therefore, we use a new high-speed stereo correspondence algorithm, triangulation, and iterative closest point (ICP) registration to reduce computation time. Disparity maps computed by a newly proposed, high-speed method are sent to the operator by a wireless LAN equipment. At the remote control site, a three-dimensional digital map around a mobile robot is built by ICP registration and reconstruction process, and this three-dimensional map is displayed for the operator. This process allows the operator to sense the environment around the robot and to give commands to the mobile robot when the robot is in a remote site.

scholarly journals Experiments on mobile robot stereo vision system calibration under hardware imperfection

2018 ◽  
Vol 161 ◽  
pp. 03020 ◽  
Author(s):  
Ramil Safin ◽  
Roman Lavrenov ◽  
Subir Kumar Saha ◽  
Evgeni Magid
Keyword(s):  
Mobile Robot ◽  
Stereo Vision ◽  
Experimental Approach ◽  
Vision System ◽  
Robot Vision ◽  
System Calibration ◽  
Stereo Vision System ◽  
Calibration Methods ◽  
Vertical Level ◽  
Grid Based

Calibration is essential for any robot vision system for achieving high accuracy in deriving objects metric information. One of typical requirements for a stereo vison system in order to obtain better calibration results is to guarantee that both cameras keep the same vertical level. However, cameras may be displaced due to severe conditions of a robot operating or some other circumstances. This paper presents our experimental approach to the problem of a mobile robot stereo vision system calibration under a hardware imperfection. In our experiments, we used crawler-type mobile robot «Servosila Engineer». Stereo system cameras of the robot were displaced relative to each other, causing loss of surrounding environment information. We implemented and verified checkerboard and circle grid based calibration methods. The two methods comparison demonstrated that a circle grid based calibration should be preferred over a classical checkerboard calibration approach.

scholarly journals Architecture and implementation of a high frame-rate stereo vision system

2021 ◽  
Author(s):  
Jamin Islam
Keyword(s):  
Integrated Circuits ◽  
Stereo Vision ◽  
High Speed ◽  
Vision System ◽  
Low Cost ◽  
Cost Effective ◽  
Frame Rate ◽  
Superior Performance ◽  
High Frame Rate ◽  
Stereo Vision System

For the purpose of autonomous satellite grasping, a high-speed, low-cost stereo vision system is required with high accuracy. This type of system must be able to detect an object and estimate its range. Hardware solutions are often chosen over software solutions, which tend to be too slow for high frame-rate applications. Designs utilizing field programmable gate arrays (FPGAs) provide flexibility and are cost effective versus solutions that provide similar performance (i.e., Application Specific Integrated Circuits). This thesis presents the architecture and implementation of a high frame-rate stereo vision system based on an FPGA platform. The system acquires stereo images, performs stereo rectification and generates disparity estimates at frame-rates close to 100 fpSi and on a large-enough FPGA, it can process 200 fps. The implementation presents novelties in performance and in the choice of the algorithm implemented. It achieves superior performance to existing systems that estimate scene depth. Furthermore, it demonstrates equivalent accuracy to software implementations of the dynamic programming maximum likelihood stereo correspondence algorithm.

scholarly journals Three-dimensional mechanical parts reconstruction technology based on two-dimensional image

2020 ◽  
Vol 17 (2) ◽  
pp. 172988142091000
Author(s):  
Jiaofei Huo ◽  
Xiaomo Yu
Keyword(s):  
Image Processing ◽  
Stereo Vision ◽  
Stereo Matching ◽  
Vision System ◽  
Three Dimensional ◽  
Three Dimensional Reconstruction ◽  
Stereo Vision System ◽  
Binocular Stereo Vision ◽  
Extraction Algorithm ◽  
Dimensional Reconstruction

With the development of computer technology and three-dimensional reconstruction technology, three-dimensional reconstruction based on visual images has become one of the research hotspots in computer graphics. Three-dimensional reconstruction based on visual image can be divided into three-dimensional reconstruction based on single photo and video. As an indirect three-dimensional modeling technology, this method is widely used in the fields of film and television production, cultural relics restoration, mechanical manufacturing, and medical health. This article studies and designs a stereo vision system based on two-dimensional image modeling technology. The system can be divided into image processing, camera calibration, stereo matching, three-dimensional point reconstruction, and model reconstruction. In the part of image processing, common image processing methods, feature point extraction algorithm, and edge extraction algorithm are studied. On this basis, interactive local corner extraction algorithm and interactive local edge detection algorithm are proposed. It is found that the Harris algorithm can effectively remove the features of less information and easy to generate clustering phenomenon. At the same time, the method of limit constraints is used to match the feature points extracted from the image. This method has high matching accuracy and short time. The experimental research has achieved good matching results. Using the platform of binocular stereo vision system, each step in the process of three-dimensional reconstruction has achieved high accuracy, thus achieving the three-dimensional reconstruction of the target object. Finally, based on the research of three-dimensional reconstruction of mechanical parts and the designed binocular stereo vision system platform, the experimental results of edge detection, camera calibration, stereo matching, and three-dimensional model reconstruction in the process of three-dimensional reconstruction are obtained, and the full text is summarized, analyzed, and prospected.

FPGA-Based Stereo Vision System Using Gradient Feature Correspondence

2015 ◽  
Vol 27 (6) ◽  
pp. 681-690 ◽  
Author(s):  
Hayato Hagiwara ◽  
◽  
Yasufumi Touma ◽  
Kenichi Asami ◽  
Mochimitsu Komori
Keyword(s):  
Mobile Robot ◽  
Stereo Vision ◽  
Vision System ◽  
Image Feature ◽  
Interest Point ◽  
Feature Correspondence ◽  
Speeded Up Robust Features ◽  
Stereo Vision System ◽  
Simpler Algorithm ◽  
Gradient Feature

<div class=""abs_img""><img src=""[disp_template_path]/JRM/abst-image/00270006/10.jpg"" width=""300"" /> Mobile robot with a stereo vision</div>This paper describes an autonomous mobile robot stereo vision system that uses gradient feature correspondence and local image feature computation on a field programmable gate array (FPGA). Among several studies on interest point detectors and descriptors for having a mobile robot navigate are the Harris operator and scale-invariant feature transform (SIFT). Most of these require heavy computation, however, and using them may burden some computers. Our purpose here is to present an interest point detector and a descriptor suitable for FPGA implementation. Results show that a detector using gradient variance inspection performs faster than SIFT or speeded-up robust features (SURF), and is more robust against illumination changes than any other method compared in this study. A descriptor with a hierarchical gradient structure has a simpler algorithm than SIFT and SURF descriptors, and the result of stereo matching achieves better performance than SIFT or SURF.

A Stereo Vision Based Target Tracking and Obstacle Avoidance

2009 ◽  
Vol 419-420 ◽  
pp. 565-568 ◽  
Author(s):  
Chao Ching Ho
Keyword(s):  
Mobile Robot ◽  
Target Tracking ◽  
Obstacle Avoidance ◽  
Visual Tracking ◽  
Stereo Vision ◽  
Vision System ◽  
Tracking System ◽  
Video Data ◽  
Corner Detection ◽  
Harris Corner

Designing a visual tracking system to track an object is a complex task because a large amount of video data must be transmitted and processed in real time. In this study, a stereo vision system is used to acquire the 3D positions of the target, tracking can be achieved by applying the CAMSHIFT algorithm, then apply the fuzzy reasoning control to steer the mobile robot to follow the selected target and avoid the in-path obstacles. The adopted obstacle avoidance component is based on the Harris corner detection and the binocular stereo imaging, which performs the correspondence calculation. Therefore a depth map is created and showing the relative 3D distances of the detected substantial features to the robot, which provides the information of the in-path obstacles in front of the wheeled mobile robot. The designed visual tracking and servo system is less sensitive to lighting influences and thus performs more efficiently. Experimental results showed that the mobile robot vision system successfully finished the target-following task by avoiding obstacles.

Sign in / Sign up

Export Citation Format

Share Document