scholarly journals Gesture based wireless control for a robotic manipulator

2018 ◽  
Vol 7 (2.31) ◽  
pp. 231
Author(s):  
Arockia Vijay Joseph ◽  
Akshat Mathur ◽  
Jatin Verma ◽  
Ankita Singh

This project plays a very important role to complement the industrial and automation field. Nowadays, robots are used in several fields of engineering and manufacturing and the systems for controlling or actuating them have also enhanced from the past. The use of gestures for controlling them has been the new trend to control the movement of robotic manipulators. The various methodologies for controlling them are motion tracking, image processing and by using Kinect sensors. All these methods can be used as a teach pendant where one can provide the movement of the manipulator as a preset and the manipulator can carry out the same motion repetitively, or in the case of motion tracking and while using Kinect sensors, the user is bound to a confined area where the cameras can monitor the user’s body. Here, we propose a wireless controlled robotic arm system for tool handling (pick and place) and many other applications where human reach is elusive. The result is that the gestures of the human hand are in sync with the manipulator’s movement. Further, this robotic arm has been implanted beneath a drone which would then have the ability to reach certain heights where human reach is impervious or might put a human’s life in jeopardy. In this case, the user can maneuver along with manipulator wherever it is used.  

Author(s):  
Shriya A. Hande ◽  
Nitin R. Chopde

<p>In today’s world, in almost all sectors, most of the work is done by robots or robotic arm having different number of degree of freedoms (DOF’s) as per the requirement. This project deals with the Design and Implementation of a “Wireless Gesture Controlled Robotic Arm with Vision”. The system design is divided into 3 parts namely: Accelerometer Part, Robotic Arm and Platform. It is fundamentally an Accelerometer based framework which controls a Robotic Arm remotely utilizing a, little and minimal effort, 3-pivot (DOF's) accelerometer by means of RF signals. The Robotic Arm is mounted over a versatile stage which is likewise controlled remotely by another accelerometer. One accelerometer is mounted/joined on the human hand, catching its conduct (motions and stances) and hence the mechanical arm moves in like manner and the other accelerometer is mounted on any of the leg of the client/administrator, catching its motions and stances and in this way the stage moves as needs be. In a nutshell, the robotic arm and platform is synchronised with the gestures and postures of the hand and leg of the user / operator, respectively. The different motions performed by robotic arm are: PICK and PLACE / DROP, RAISING and LOWERING the objects. Also, the motions performed by the platform are: FORWARD, BACKWARD, RIGHT and LEFT.</p>


Author(s):  
Yeo Jung Yoon ◽  
Oswin G. Almeida ◽  
Aniruddha V. Shembekar ◽  
Satyandra K. Gupta

Abstract By attaching a material extrusion system to a robotic arm, we can deposit materials onto complex surfaces. Robotic manipulators can also maximize the task utility by performing other tasks such as assembly or surface polishing when they are not in use for the AM process. We present a robotic cell for embedding prefabricated components in extrusion-based AM. The robotic cell consists of two 6 degrees of freedom (DOF) robots, an extrusion system, and a gripper. One robot is used for printing a part, and the other robot takes a support role to pick and place the prefabricated component and embed it into the part being printed. After the component is embedded, AM process resumes, and the material is deposited onto the prefabricated components and previously printed layers. We illustrate the capabilities of the system by fabricating three objects.


Modeling and Fabrication of robotic systems and their control for pick &place and maintenance tasks is highly complex activity involving coordination of various sub-systems. The entire design has four important modules: (i) CAD Modeling (ii) Control System Design (iii) Machine Vision and Image Processing, (iv) Hardware Development and Testing. The fiveaxis articulated manipulator equipped with a vision camera in eye-to-hand configuration is designed for performing the pick and place operations of the defected tiles in a systematic manner. Dynamics of manipulator is required for design of model-based controllers. Interactive programs are developed in Matlab for kinematics and dynamics. Three-dimensional manipulator assembly configuration is modeled in Pro-E software. Motion analysis is conducted in Arduino software in order to compare the results obtained from the classical kinematics. The test set-up is developed using vision camera and microcontroller platform to guide the robot joint servos so as to perform defected object replacement activity. Presences of the coordinate of the region are indicated with the use of image-processing operations.


2020 ◽  
Vol 38 (5A) ◽  
pp. 707-718 ◽  
Author(s):  
Firas S. Hameed ◽  
Hasan M. Alwan ◽  
Qasim A. Ateia

Robot Vision is one of the most important applications in Image processing. Visual interaction with the environment is a much better way for the robot to gather information and react more intelligently to the variations of the parameters in that environment. A common example of an application that depends on robot vision is that of Pick-And-Place objects by a robotic arm. This work presents a method for identifying an object in a scene and determines its orientation. The method presented enables the robot to choose the best-suited pair of points on the object at which the two-finger gripper can successfully pick the object. The scene is taken by a camera attached to the arm’s end effector which gives 2D images for analysis. The edge detection operation was used to extract a 2D edge image for all the objects in the scene to reduce the time needed for processing. The methods proposed showed accurate object identification which enabled the robotic to successfully identify and pick an object of interest in the scene.


2019 ◽  
Vol 29 ◽  
pp. 03004
Author(s):  
Magdalena Banda ◽  
Valentin Ciupe ◽  
Cristian Moldovan ◽  
Inocențu Maniu ◽  
Robert Kristof

The present work deals with design aspects and testing results of a novel solution regarding the remote control of two virtual robotic manipulators by using hands motion tracking and palms gesture recognition. The spatial position and orientation of the user's left and right hands' wrists are interpreted by a custom built software application and then forwarded as positioning data and gripper status to a V-Rep server running the simulation scene. The goal of the presented setup is for the user to be able to manipulate objects in the scene in a collaborative way, i.e. pick one object with the first robot and give it to the second one for elsewhere depositing. The real-life applications for this approach are to provide a framework for simplified operator training and programming of robots used in pick-and-place or assembly operations, and also in healthcare for assisting patients in hand -coordination and mobility recovery.


Author(s):  
Yogita Sawant

<p class="Abstract"><em>Abstract</em>— <em><span>Robots are very smart and interactive machines that can be programmed and used in many areas such as industry, manufacturing, production lines, household or health, etc. These robots can perform hard, dangerous, and accurate work to facilitate our life and to increase the production. Humans</span></em><em><span> are trying to minimize the time required to do the similar kind of jobs. The task in which picking &amp; placing of an object is to be done, can be carried out with the help of robots. These robots can minimize the human efforts. The robotic arms can be also used in the industries to assemble the small parts, in chemical industries to pick and place small types of object such as tablets. Artificial robotic arms thus can be used to control gestures. In this paper an  idea of controlling robotic arm is implemented using an accelerometer which is placed </span></em><em>on the human hand, capturing its behavior (gestures and postures) which are then transmitted at some distance and the robotic arm assembly connected wirelessly moves accordingly.</em></p>


Author(s):  
John Mansfield

Advances in camera technology and digital instrument control have meant that in modern microscopy, the image that was, in the past, typically recorded on a piece of film is now recorded directly into a computer. The transfer of the analog image seen in the microscope to the digitized picture in the computer does not mean, however, that the problems associated with recording images, analyzing them, and preparing them for publication, have all miraculously been solved. The steps involved in the recording an image to film remain largely intact in the digital world. The image is recorded, prepared for measurement in some way, analyzed, and then prepared for presentation.Digital image acquisition schemes are largely the realm of the microscope manufacturers, however, there are also a multitude of “homemade” acquisition systems in microscope laboratories around the world. It is not the mission of this tutorial to deal with the various acquisition systems, but rather to introduce the novice user to rudimentary image processing and measurement.


2021 ◽  
Vol 30 (10) ◽  
pp. 580-587
Author(s):  
Ajay Asokan ◽  
Joanna Baawa-Ameyaw ◽  
Babar Kayani ◽  
Ganan T Radhakrishnan ◽  
Ahmed A Magan ◽  
...  

Robotic-arm assisted arthroplasty (RAA) has gained popularity over the past decade because of its ability to provide more accurate implant positioning with less surgical trauma than conventional manual arthroplasty. It has shown better early functional outcomes, less postoperative pain and shorter inpatient stays. A multidisciplinary approach is crucial in improving overall outcomes and ensuring this technology is implemented efficiently and safely, but there is limited published literature on the nursing considerations for managing patients undergoing RAA. This article aims to provide a pragmatic approach for nursing care in the pre-, intra-, and postoperative phases of RAA.


2021 ◽  
Vol 14 (4) ◽  
pp. 1-20
Author(s):  
Dzemila Sero ◽  
Isabelle Garachon ◽  
Erma Hermens ◽  
Robert Van Liere ◽  
Kees Joost Batenburg

Fingerprints play a central role in any field where person identification is required. In forensics and biometrics, three-dimensional fingerprint-based imaging technologies, and corresponding recognition methods, have been vastly investigated. In cultural heritage, preliminary studies provide evidence that the three-dimensional impressions left on objects from the past (ancient fingerprints) are of paramount relevance to understand the socio-cultural systems of former societies, to possibly identify a single producer of multiple potteries, and to authenticate the artist of a sculpture. These findings suggest that the study of ancient fingerprints can be further investigated and open new avenues of research. However, the potential for capturing and analyzing ancient fingerprints is still largely unexplored in the context of cultural heritage research. In fact, most of the existing studies have focused on plane fingerprint representations and commercial software for image processing. Our aim is to outline the opportunities and challenges of digital fingerprint recognition in answering a range of questions in cultural heritage research. Therefore, we summarize the fingerprint-based imaging technologies, reconstruction methods, and analyses used in biometrics that could be beneficial to the study of ancient fingerprints in cultural heritage. In addition, we analyze the works conducted on ancient fingerprints from potteries and ceramic/fired clay sculptures. We conclude with a discussion on the open challenges and future works that could initiate novel strategies for ancient fingerprint acquisition, digitization, and processing within the cultural heritage community.


Sign in / Sign up

Export Citation Format

Share Document