Spatial programming for industrial robots based on gestures and Augmented Reality

Author(s):  
Jens Lambrecht ◽  
Jorg Kruger
2014 ◽  
Vol 1018 ◽  
pp. 39-46 ◽  
Author(s):  
Jens Lambrecht ◽  
Jörg Krüger

In this paper, we present a robot programming system taking into account natural communication and process integrated simulation as well as a unified robot control layer and an interface towards the Digital Factory for program transmission. We choose an integrative approach including markerless gesture recognition and a mobile Augmented Reality simulation on common handheld devices, e.g. smartphones or tablet-PCs. The user is enabled to draw poses and trajectories into the workspace of the robot supported with simultaneous visual feedback in Augmented Reality. In addition the user can adapt the robot program by gestural manipulation of poses and trajectories. Within a task-oriented implementation of the robot program a pick and place task was implemented through the programming by demonstration principle. With the help of a user study we evaluate programming duration, programming errors and subjective assessment compared with Teach-In and Offline Programming. The analysis of the results shows a significant reduction of programming duration as well as a reduction of programming errors compared with Teach-In. Furthermore, most participants favour the spatial programming system.


Author(s):  
Vladimir Kuts ◽  
Tauno Otto ◽  
Yevhen Bondarenko ◽  
Fei Yu

Abstract Industrial Digital Twins (DT) is the precise virtual representation of the manufacturing environment and mainly consists of the system-level simulation, which combines both manufacturing processes and parametric models of the product. As being one of the pillars of the Industry 4.0 paradigm, DT-s are widely integrated into the existing factories, enhancing the concept of the virtual factories. View from the research perspective is that experiments on the Internet of Things, data acquisition, cybersecurity, telemetry synchronization with physical factories, etc. are being executed in those virtual simulations. Moreover, new ways of interactions and interface to oversee, interact and learn are being developed via the assistance of Virtual Reality (VR) and Augmented Reality (AR) technologies, which are already widely spread on the consumer market. However, already, VR is being used widely in existing commercial software packages and toolboxes to provide students, teachers, operators, engineers, production managers, and researchers with an immersive way of interacting with the factory while the manufacturing simulation is running. This gives a better understanding and more in-depth knowledge of the actual manufacturing processes, not being directly accessing those. However, the virtual presence mentioned above experience is limited to a single person. It does not enable additional functionalities for the simulations, which can be re-planning or even re-programming of the physical factory in an online connection by using VR or AR interfaces. The main aim of the related research paper is to enhance already existing fully synchronized with physical world DT-s with multi-user experience, enabling factory operators to work with and re-program the real machinery from remote locations in a more intuitive way instead thinking about final aim than about the process itself. Moreover, being developed using real-time platform Unity3D, this multiplayer solution gives opportunities for training and educational purposes and is connecting people from remote locations of the world. Use-cases exploits industrial robots placed in the Industrial Virtual and Augmented Reality Laboratory environment of Tallinn University of Technology and a mobile robot solution developed based on a collaboration between the University of Southern Denmark and a Danish company. Experiments are being performed on the connection between Estonia and Denmark while performing reprogramming tasks of the physical heavy industrial robots. Furthermore, the mobile robot solution is demonstrated in a virtual warehouse environment. Developed methods and environments together with the collected data will enable us to widen the use-cases with non-manufacturing scenarios, i.e., smart city and smart healthcare domains, for the creation of a set of new interfaces and multiplayer experiences.


10.5772/55640 ◽  
2013 ◽  
Vol 10 (5) ◽  
pp. 254 ◽  
Author(s):  
Jens Lambrecht ◽  
Martin Kleinsorge ◽  
Martin Rosenstrauch ◽  
Jörg Krüger

Author(s):  
Jingsong Chu ◽  
Ariyan Kabir ◽  
William Rose ◽  
Dennis Wang ◽  
Mingjun Yao ◽  
...  

2012 ◽  
Vol 463-464 ◽  
pp. 1654-1657 ◽  
Author(s):  
Florin Gîrbacia ◽  
Mihai Duguleana ◽  
Adrian Stavar

This paper presents a methodology and a prototype system for off-line programming of an industrial robot using augmented reality technology. The system allows to control a virtual model of the industrial robot co-located in the real environment, planning for collision-free paths, generate robot program and simulate the robot actions before the real robot perform the task. The advantage of this system is use of inexpensive equipment for intuitive off-line programming of an industrial robot.


2020 ◽  
Vol 149 ◽  
pp. 106806
Author(s):  
Francesco De Pace ◽  
Federico Manuri ◽  
Andrea Sanna ◽  
Claudio Fornaro

2021 ◽  
Vol 111 (03) ◽  
pp. 130-135
Author(s):  
Daria Leiber ◽  
Lukas Tanz ◽  
Gunther Reinhart

Modell- und simulationsbasierte Ansätze werden in verschiedenen Lebenszyklusphasen von Montageanlagen eingesetzt. Potenziale bestehen vor allem bei der Vereinfachung von Planung und Programmierung. Moderne Visualisierungsmethoden wie Augmented Reality (AR) können dabei genutzt werden, um Planungsergebnisse anschaulich darzustellen und existierende Anlagen in die Planung miteinzubeziehen. Auch zur Vereinfachung der Programmierung und Inbetriebnahme von Industrierobotern lässt sich AR einsetzen.   Model- and simulation-based methods are used in different life cycle phases of assembly systems. In particular, they offer potential for simplifying the planning and programming of assembly lines. Modern visualization methods such as Augmented Reality (AR) can be used to clearly visualize planning results and to include existing equipment in the planning process. AR can also be used to simplify the programming and initial start-up of industrial robots.


Sign in / Sign up

Export Citation Format

Share Document