scholarly journals Visual Servoing of a 5-DOF Mobile Manipulator Using a Panoramic Vision System

Author(s):  
Y. Zhang ◽  
M. Mehrandezh
2008 ◽  
Vol 20 (1) ◽  
pp. 135-150
Author(s):  
Chaiyapol Kulpate ◽  
◽  
Mehran Mehrandezh ◽  
Raman Paranjape ◽  

A novel visual servoing structure is presented for robot positioning under an eye-to-hand camera configuration using panoramic vision. The proposed algorithm is based upon Image-Based Visual Servoing (IBVS) and uses only one fixed camera in conjunction with a stationary flat mirror. A single landmark mounted on the robot's end-effector along with its mirror reflection provide enough information for 3D reasoning based on a 2D image when viewed by a camera. The equations describing the relationship between the velocity of the coordinate frame attached to the robot's end-effector and rate of change in image features called the image Jacobian are presented. A novel set of image features that yield a full-rank image Jacobian is introduced. The Visual servoing based on an online estimation of the image Jacobian using a Kalman Filter (KF) is also presented. Simulated and experimental results illustrate the robustness of the proposed visual servoing structure. In addition, the accuracy of the proposed visual servoing structure is evaluated with an error analysis and sensitivity tests.


Author(s):  
M. Alizadeh ◽  
C. Ratanasawanya ◽  
M. Mehrandezh ◽  
R. Paranjape

A vision-based servoing technique is proposed for a 2 degrees-of-freedom (dof) model helicopter equipped with a monocular vision system. In general, these techniques can be categorized as image- and position-based, where the task error is defined in the image plane in the former and in the physical space in the latter. The 2-dof model helicopter requires a configuration-dependent feed-forward control to compensate for gravitational forces when servoing on a ground target. Therefore, a position-based visual servoing deems more appropriate for precision control. Image information collected from a ground object, with known geometry a priori, is used to calculate the desired pose of the camera and correspondingly the desired joint angles of the model helicopter. To assure a smooth servoing, the task error is parameterized, using the information obtained from the linearaized image Jacobian, and time scaled to form a moving reference trajectory. At the higher level, a Linear Quadratic Regulator (LQR), augmented with a feed-forward term and an integrator, is used to track this trajectory. The discretization of the reference trajectory is achieved by an error-clamping strategy for optimal performance. The proposed technique was tested on a 2-dof model helicopter capable of pitch and yaw maneuvers carrying a light-weight off-the-shelf video camera. The test results show that the optimized controller can servo the model helicopter to a hovering pose for an image acquisition rate of as low as 2 frames per second.


Electronics ◽  
2019 ◽  
Vol 8 (10) ◽  
pp. 1154 ◽  
Author(s):  
Cristian del Toro ◽  
Carlos Robles-Algarín ◽  
Omar Rodríguez-Álvarez

This paper presents the design and construction of a robotic arm that plays chess against a human opponent, based on an artificial vision system. The mechanical design was an adaptation of the robotic arm proposed by the rapid prototyping laboratory FabLab RUC (Fabrication Laboratory of the University of Roskilde). Using the software Solidworks, a gripper with 4 joints was designed. An artificial vision system was developed for detecting the corners of the squares on a chessboard and performing image segmentation. Then, an image recognition model was trained using convolutional neural networks to detect the movements of pieces on the board. An image-based visual servoing system was designed using the Kanade–Lucas–Tomasi method, in order to locate the manipulator. Additionally, an Arduino development board was programmed to control and receive information from the robotic arm using Gcode commands. Results show that with the Stockfish chess game engine, the system is able to make game decisions and manipulate the pieces on the board. In this way, it was possible to implement a didactic robotic arm as a relevant application in data processing and decision-making for programmable automatons.


Robotica ◽  
2007 ◽  
Vol 25 (5) ◽  
pp. 615-626 ◽  
Author(s):  
Wen-Chung Chang

SUMMARYRobotic manipulators that have interacted with uncalibrated environments typically have limited positioning and tracking capabilities, if control tasks cannot be appropriately encoded using available features in the environments. Specifically, to perform 3-D trajectory following operations employing binocular vision, it seems necessary to have a priori knowledge on pointwise correspondence information between two image planes. However, such an assumption cannot be made for any smooth 3-D trajectories. This paper describes how one might enhance autonomous robotic manipulation for 3-D trajectory following tasks using eye-to-hand binocular visual servoing. Based on a novel encoded error, an image-based feedback control law is proposed without assuming pointwise binocular correspondence information. The proposed control approach can guarantee task precision by employing only an approximately calibrated binocular vision system. The goal of the autonomous task is to drive a tool mounted on the end-effector of the robotic manipulator to follow a visually determined smooth 3-D target trajectory in desired speed with precision. The proposed control architecture is suitable for applications that require precise 3-D positioning and tracking in unknown environments. Our approach is successfully validated in a real task environment by performing experiments with an industrial robotic manipulator.


Robotica ◽  
2012 ◽  
Vol 31 (4) ◽  
pp. 643-656 ◽  
Author(s):  
M. H. Korayem ◽  
M. Irani ◽  
A. Charesaz ◽  
A. H. Korayem ◽  
A. Hashemi

SUMMARYThis paper presents a solution for optimal trajectory planning problem of robotic manipulators with complicated dynamic equations. The main goal is to find the optimal path with maximum dynamic load carrying capacity (DLCC). Proposed method can be implemented to problems of both motion along a specified path and point-to-point motion. Dynamic Programming (DP) approach is applied to solve optimization problem and find the positions and velocities that minimize a pre-defined performance index. Unlike previous attempts, proposed method increases the speed of convergence by using the sequential quadratic programming (SQP) formulation. This formulation is used for solving problems with nonlinear constraints. Also, this paper proposes a new algorithm to design optimal trajectory with maximum DLCC for both fixed and mobile base mechanical manipulators. Algorithms for DLCC calculations in previous works were based on indirect optimization method or linear programming approach. The proposed trajectory planning method is applied to a linear tracked Puma and the mobile manipulator named Scout. Application of this algorithm is confirmed and simulation results are compared with experimental results for Scout robot. In experimental test, results are obtained using a new stereo vision system to determine the position of the robot end-effector.


Sign in / Sign up

Export Citation Format

Share Document