scholarly journals Analysis of Precision and Stability of Hand Tracking with Leap Motion Sensor

Sensors ◽  
2020 ◽  
Vol 20 (15) ◽  
pp. 4088
Author(s):  
Aleš Vysocký ◽  
Stefan Grushko ◽  
Petr Oščádal ◽  
Tomáš Kot ◽  
Ján Babjak ◽  
...  

In this analysis, we present results from measurements performed to determine the stability of a hand tracking system and the accuracy of the detected palm and finger’s position. Measurements were performed for the evaluation of the sensor for an application in an industrial robot-assisted assembly scenario. Human–robot interaction is a relevant topic in collaborative robotics. Intuitive and straightforward control tools for robot navigation and program flow control are essential for effective utilisation in production scenarios without unnecessary slowdowns caused by the operator. For the hand tracking and gesture-based control, it is necessary to know the sensor’s accuracy. For gesture recognition with a moving target, the sensor must provide stable tracking results. This paper evaluates the sensor’s real-world performance by measuring the localisation deviations of the hand being tracked as it moves in the workspace.

Robotics ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 54
Author(s):  
Lorenzo Scalera ◽  
Stefano Seriani ◽  
Paolo Gallina ◽  
Mattia Lentini ◽  
Alessandro Gasparetto

In this paper, authors present a novel architecture for controlling an industrial robot via an eye tracking interface for artistic purposes. Humans and robots interact thanks to an acquisition system based on an eye tracker device that allows the user to control the motion of a robotic manipulator with his gaze. The feasibility of the robotic system is evaluated with experimental tests in which the robot is teleoperated to draw artistic images. The tool can be used by artists to investigate novel forms of art and by amputees or people with movement disorders or muscular paralysis, as an assistive technology for artistic drawing and painting, since, in these cases, eye motion is usually preserved.


Technologies ◽  
2018 ◽  
Vol 6 (4) ◽  
pp. 119 ◽  
Author(s):  
Konstantinos Tsiakas ◽  
Maria Kyrarini ◽  
Vangelis Karkaletsis ◽  
Fillia Makedon ◽  
Oliver Korn

In this article, we present a taxonomy in Robot-Assisted Training; a growing body of research in Human–Robot Interaction which focuses on how robotic agents and devices can be used to enhance user’s performance during a cognitive or physical training task. Robot-Assisted Training systems have been successfully deployed to enhance the effects of a training session in various contexts, i.e., rehabilitation systems, educational environments, vocational settings, etc. The proposed taxonomy suggests a set of categories and parameters that can be used to characterize such systems, considering the current research trends and needs for the design, development and evaluation of Robot-Assisted Training systems. To this end, we review recent works and applications in Robot-Assisted Training systems, as well as related taxonomies in Human–Robot Interaction. The goal is to identify and discuss open challenges, highlighting the different aspects of a Robot-Assisted Training system, considering both robot perception and behavior control.


Author(s):  
Joanne Pransky

Purpose The purpose of this paper is a “Q&A interview” conducted by Joanne Pransky of Industrial Robot Journal as a method to impart the combined technological, business and personal experience of a prominent, robotic industry PhD-turned-entrepreneur regarding the evolution, commercialization and challenges of bringing a technological invention to market. Design/methodology/approach The interviewee is Dr Cory Kidd, an inventor, entrepreneur and leading practitioner in the field of human–robot interaction. Dr Kidd shares his 20-year journey of working at the intersection of healthcare and technology and how he applied innovative technologies toward solving large-scale consumer healthcare challenges. Findings Dr Kidd received his BS degree in Computer Science from the Georgia Institute of Technology and earned a National Science Foundation Graduate Research Fellow in Computer and Information Science & Engineering. Dr Kidd received his MS and PhD degrees at the MIT Media Lab in human–robot interaction. While there, he conducted studies that showed the psychological and clinical advantages of using a physical robot over screen-based interactions. While finishing his PhD in 2007, he founded his first company, Intuitive Automata, which created interactive coaches for weight loss. Though Intuitive Automata ceased operations in 2013, Dr Kidd harnessed his extensive knowledge of the healthcare business and the experiences from patient engagement and launched Catalia Health in 2014 with a new platform centered specifically around patient behavior change programs for chronic disease management. Originality/value Dr Kidd is a pioneer of social robotics and has developed groundbreaking technology for healthcare applications that combines artificial intelligence, psychology and medical best practices to deliver everyday care to patients who are managing chronic conditions. He holds patents, including one entitled Apparatus and Method for Assisting in Achieving Desired Behavior Patterns and in an Interactive Personal Health Promoting Robot. Dr Kidd was awarded the inaugural Wall Street Journal and Credit Suisse Technopreneur of the Year in 2010, which is meant to “honor the entry that best applies technology with the greatest potential for commercial success”. He is also the Director of Business Development for the nonprofit Silicon Valley Robotics and is an impact partner for Fresco Capital. He consults, mentors and serves as a Board Member and Advisor to several high-tech startups.


2019 ◽  
Vol 38 (6) ◽  
pp. 747-765 ◽  
Author(s):  
Federica Ferraguti ◽  
Chiara Talignani Landi ◽  
Lorenzo Sabattini ◽  
Marcello Bonfè ◽  
Cesare Fantuzzi ◽  
...  

Admittance control allows a desired dynamic behavior to be reproduced on a non-backdrivable manipulator and it has been widely used for interaction control and, in particular, for human–robot collaboration. Nevertheless, stability problems arise when the environment (e.g. the human) the robot is interacting with becomes too stiff. In this paper, we investigate the stability issues related to a change of stiffness of the human arm during the interaction with an admittance-controlled robot. We propose a novel method for detecting the rise of instability and a passivity-preserving strategy for restoring a stable behavior. The results of the paper are validated on two robotic setups and with 50 users performing two tasks that emulate industrial operations.


Sign in / Sign up

Export Citation Format

Share Document