A Stereo Vision Based Target Tracking and Obstacle Avoidance

2009 ◽  
Vol 419-420 ◽  
pp. 565-568 ◽  
Author(s):  
Chao Ching Ho
Keyword(s):  
Mobile Robot ◽  
Target Tracking ◽  
Obstacle Avoidance ◽  
Visual Tracking ◽  
Stereo Vision ◽  
Vision System ◽  
Tracking System ◽  
Video Data ◽  
Corner Detection ◽  
Harris Corner

Designing a visual tracking system to track an object is a complex task because a large amount of video data must be transmitted and processed in real time. In this study, a stereo vision system is used to acquire the 3D positions of the target, tracking can be achieved by applying the CAMSHIFT algorithm, then apply the fuzzy reasoning control to steer the mobile robot to follow the selected target and avoid the in-path obstacles. The adopted obstacle avoidance component is based on the Harris corner detection and the binocular stereo imaging, which performs the correspondence calculation. Therefore a depth map is created and showing the relative 3D distances of the detected substantial features to the robot, which provides the information of the in-path obstacles in front of the wheeled mobile robot. The designed visual tracking and servo system is less sensitive to lighting influences and thus performs more efficiently. Experimental results showed that the mobile robot vision system successfully finished the target-following task by avoiding obstacles.

Image Processing Algorithm for Tracking and Picking an Object for an Open Platform Mobile Robot

2009 ◽  
Vol 419-420 ◽  
pp. 569-572 ◽  
Author(s):  
Chao Ching Ho
Keyword(s):  
Mobile Robot ◽  
Visual Tracking ◽  
Vision System ◽  
Tracking System ◽  
Video Data ◽  
Target Color ◽  
Image Processing Algorithm ◽  
End Effector ◽  
Open Platform ◽  
Pick And Place

Designing a visual tracking system to pick-and-place an object is a complex task because a large amount of video data must be transmitted and processed in real time. In this work, a mobile robot visual control system is proposed which uses a stereo vision to acquire the 3D positions of a target color ball and to control an end-effector to pick the ball up and place it in the specified location. This mobile robotic system is based on the Open Source Computer Vision Library for programming framework with portable components, off-the-shelf commercial hardware, and minimal programming. Two calibrated web cameras are used to track the color ball and a 2-axis end-effector is controlled to pick up the tracked color ball. The visual tracking and servo system as designed in this work is less sensitive to lighting influences and thus performs more efficiently. Experimental results show that the open platform based robot vision system successfully finishes the pick-and-place task and could be scalable to many diverse areas of robotics research

scholarly journals 3 Bio-Mimetic Vision System For Autonomous Mobile Robot Navigation

2013 ◽  
Vol 3 (1) ◽  
pp. 4
Author(s):  
Muhammad Safwan ◽  
Muhammad Yasir Zaheen ◽  
M. Anwar Ahmed ◽  
Muhammad Shujaat Kamal ◽  
Raj Kumar
Keyword(s):  
Mobile Robot ◽  
Obstacle Avoidance ◽  
Stereo Vision ◽  
Robot Navigation ◽  
Vision System ◽  
Experimental Results ◽  
Mobile Robot Navigation ◽  
Absolute Difference ◽  
Autonomous Mobile Robot ◽  
Dc Motors

Bio-Mimetic Vision System (BMVS) for AutonomousMobile Robot Navigation encompasses three major fields, namelyrobotics, navigation and obstacle avoidance. Bio-mimetic vision isbased on stereo vision. Summation of Absolute Difference (SAD)is applied on the images from the two cameras and disparity mapis generated which is then used to navigate and avoid obstacles.Camera calibration and SAD is applied on Matlab software.AT89C52 microcontroller, along with Matlab, is used to efficientlycontrol the DC motors mounted on the robot frame. It is observedfrom experimental results that the developed system effectivelydistinguishes objects at different distances and avoids them whenthe path is blocked.

A New Mobile Robot With a Passive Mechanism and a Stereo Vision System for Hazardous Terrain Exploration

2004 ◽  
Author(s):  
Sukjune Yoon ◽  
Chun-Kyu Woo ◽  
Hyun Do Choi ◽  
Sung-Kee Park ◽  
Sung-Chul Kang ◽  
...  
Keyword(s):  
Remote Control ◽  
Mobile Robot ◽  
Obstacle Avoidance ◽  
Stereo Vision ◽  
High Speed ◽  
Vision System ◽  
Three Dimensional ◽  
Linkage Mechanism ◽  
Passive Mechanism ◽  
Stereo Vision System

The purpose of this project is to develop a mobile robot for hazardous terrain exploration. The exploration of hazardous terrain requires the development of a passive mechanism adaptable to such terrain and a sensing system for obstacle avoidance, as well as a remote control. We designed a new mobile robot, the Ronahz 6-wheel robot, which uses a passive mechanism that can adapt to hazardous terrains and building stairways without any active control. The suggested passive linkage mechanism consists of a simple four-bar linkage mechanism. In addition, we install a stereo vision system for obstacle avoidance, as well as a remote control. Wide dynamic range CCD cameras are used for outdoor navigation. A stereo vision system commonly requires high computational power. Therefore, we use a new high-speed stereo correspondence algorithm, triangulation, and iterative closest point (ICP) registration to reduce computation time. Disparity maps computed by a newly proposed, high-speed method are sent to the operator by a wireless LAN equipment. At the remote control site, a three-dimensional digital map around a mobile robot is built by ICP registration and reconstruction process, and this three-dimensional map is displayed for the operator. This process allows the operator to sense the environment around the robot and to give commands to the mobile robot when the robot is in a remote site.

scholarly journals 3 Bio-Mimetic Vision System For Autonomous Mobile Robot Navigation

2013 ◽  
Vol 1 (1) ◽  
pp. 4
Author(s):  
Muhammad Safwan ◽  
Muhammad Yasir Zaheen ◽  
M. Anwar Ahmed ◽  
Muhammad Shujaat Kamal ◽  
Raj Kumar
Keyword(s):  
Mobile Robot ◽  
Obstacle Avoidance ◽  
Stereo Vision ◽  
Robot Navigation ◽  
Vision System ◽  
Experimental Results ◽  
Mobile Robot Navigation ◽  
Absolute Difference ◽  
Autonomous Mobile Robot ◽  
Dc Motors

Bio-Mimetic Vision System (BMVS) for AutonomousMobile Robot Navigation encompasses three major fields, namelyrobotics, navigation and obstacle avoidance. Bio-mimetic vision isbased on stereo vision. Summation of Absolute Difference (SAD)is applied on the images from the two cameras and disparity mapis generated which is then used to navigate and avoid obstacles.Camera calibration and SAD is applied on Matlab software.AT89C52 microcontroller, along with Matlab, is used to efficientlycontrol the DC motors mounted on the robot frame. It is observedfrom experimental results that the developed system effectivelydistinguishes objects at different distances and avoids them whenthe path is blocked.

scholarly journals Experiments on mobile robot stereo vision system calibration under hardware imperfection

2018 ◽  
Vol 161 ◽  
pp. 03020 ◽  
Author(s):  
Ramil Safin ◽  
Roman Lavrenov ◽  
Subir Kumar Saha ◽  
Evgeni Magid
Keyword(s):  
Mobile Robot ◽  
Stereo Vision ◽  
Experimental Approach ◽  
Vision System ◽  
Robot Vision ◽  
System Calibration ◽  
Stereo Vision System ◽  
Calibration Methods ◽  
Vertical Level ◽  
Grid Based

Calibration is essential for any robot vision system for achieving high accuracy in deriving objects metric information. One of typical requirements for a stereo vison system in order to obtain better calibration results is to guarantee that both cameras keep the same vertical level. However, cameras may be displaced due to severe conditions of a robot operating or some other circumstances. This paper presents our experimental approach to the problem of a mobile robot stereo vision system calibration under a hardware imperfection. In our experiments, we used crawler-type mobile robot «Servosila Engineer». Stereo system cameras of the robot were displaced relative to each other, causing loss of surrounding environment information. We implemented and verified checkerboard and circle grid based calibration methods. The two methods comparison demonstrated that a circle grid based calibration should be preferred over a classical checkerboard calibration approach.

scholarly journals Virtual Reality Based Multi-Modal Teleoperation Using Mixed Autonomy

2008 ◽  
Author(s):  
Muthukkumar S. Kadavasal ◽  
Abhishek Seth ◽  
James H. Oliver
Keyword(s):  
Virtual Reality ◽  
Stereo Vision ◽  
Vision System ◽  
Tracking System ◽  
A Priori ◽  
Obstacle Detection ◽  
Remotely Operated Vehicle ◽  
Autonomous Operation ◽  
Control Interface ◽  
Video Feed

A multi modal teleoperation interface is introduced featuring an integrated virtual reality based simulation augmented by sensors and image processing capabilities on-board the remotely operated vehicle. The proposed virtual reality interface fuses an existing VR model with live video feed and prediction states, thereby creating a multi modal control interface. Virtual reality addresses the typical limitations of video-based teleoperation caused by signal lag and limited field of view thereby allowing the operator to navigate in a continuous fashion. The vehicle incorporates an on-board computer and a stereo vision system to facilitate obstacle detection. A vehicle adaptation system with a priori risk maps and real state tracking system enables temporary autonomous operation of the vehicle for local navigation around obstacles and automatic re-establishment of the vehicle’s teleoperated state. As both the vehicle and the operator share absolute autonomy in stages, the operation is referred to as mixed autonomous. Finally, the system provides real time update of the virtual environment based on anomalies encountered by the vehicle. The system effectively balances the autonomy between human and on board vehicle intelligence. The stereo vision based obstacle avoidance system is initially implemented on video based teleoperation architecture and experimental results are presented. The VR based multi modal teleoperation interface is expected to be more adaptable and intuitive when compared to other interfaces.

Sign in / Sign up

Export Citation Format

Share Document