Augmented Reality Aided Control of Industrial Robots

2014 ◽  
Vol 1025-1026 ◽  
pp. 1145-1149 ◽  
Author(s):  
Jozef Novak-Marcincin ◽  
Miroslav Janak ◽  
Ludmila Novakova-Marcincinova

This contribution presents the method of simultaneous control and creation of programming sequences for industrial robot with the use of interactivity achieved in the environment of augmented reality. Paper describes the experimental testing of proposed conception realized at the Faculty of Manufacturing Technologies in Presov of Technical University of Kosice (Slovakia) in the environment of experimental robotic workcell with the use of augmented reality tools. From the viewpoint of displaying units it consider the projection on half-silvered glass as well as using the head mounted display for virtual reality. Final part of the paper summarizes possible trends of further development in described area and also the possibilities of industrial applications.

Author(s):  
Vladimir Kuts ◽  
Tauno Otto ◽  
Yevhen Bondarenko ◽  
Fei Yu

Abstract Industrial Digital Twins (DT) is the precise virtual representation of the manufacturing environment and mainly consists of the system-level simulation, which combines both manufacturing processes and parametric models of the product. As being one of the pillars of the Industry 4.0 paradigm, DT-s are widely integrated into the existing factories, enhancing the concept of the virtual factories. View from the research perspective is that experiments on the Internet of Things, data acquisition, cybersecurity, telemetry synchronization with physical factories, etc. are being executed in those virtual simulations. Moreover, new ways of interactions and interface to oversee, interact and learn are being developed via the assistance of Virtual Reality (VR) and Augmented Reality (AR) technologies, which are already widely spread on the consumer market. However, already, VR is being used widely in existing commercial software packages and toolboxes to provide students, teachers, operators, engineers, production managers, and researchers with an immersive way of interacting with the factory while the manufacturing simulation is running. This gives a better understanding and more in-depth knowledge of the actual manufacturing processes, not being directly accessing those. However, the virtual presence mentioned above experience is limited to a single person. It does not enable additional functionalities for the simulations, which can be re-planning or even re-programming of the physical factory in an online connection by using VR or AR interfaces. The main aim of the related research paper is to enhance already existing fully synchronized with physical world DT-s with multi-user experience, enabling factory operators to work with and re-program the real machinery from remote locations in a more intuitive way instead thinking about final aim than about the process itself. Moreover, being developed using real-time platform Unity3D, this multiplayer solution gives opportunities for training and educational purposes and is connecting people from remote locations of the world. Use-cases exploits industrial robots placed in the Industrial Virtual and Augmented Reality Laboratory environment of Tallinn University of Technology and a mobile robot solution developed based on a collaboration between the University of Southern Denmark and a Danish company. Experiments are being performed on the connection between Estonia and Denmark while performing reprogramming tasks of the physical heavy industrial robots. Furthermore, the mobile robot solution is demonstrated in a virtual warehouse environment. Developed methods and environments together with the collected data will enable us to widen the use-cases with non-manufacturing scenarios, i.e., smart city and smart healthcare domains, for the creation of a set of new interfaces and multiplayer experiences.


Author(s):  
Thiago D'Angelo ◽  
Saul Emanuel Delabrida Silva ◽  
Ricardo A. R. Oliveira ◽  
Antonio A. F. Loureiro

Virtual Reality and Augmented Reality Head-Mounted Displays (HMDs) have been emerging in the last years. These technologies sound like the new hot topic for the next years. Head-Mounted Displays have been developed for many different purposes. Users have the opportunity to enjoy these technologies for entertainment, work tasks, and many other daily activities. Despite the recent release of many AR and VR HMDs, two major problems are hindering the AR HMDs from reaching the mainstream market: the extremely high costs and the user experience issues. In order to minimize these problems, we have developed an AR HMD prototype based on a smartphone and on other low-cost materials. The prototype is capable of running Eye Tracking algorithms, which can be used to improve user interaction and user experience. To assess our AR HMD prototype, we choose a state-of-the-art method for eye center location found in the literature and evaluate its real-time performance in different development boards.


2020 ◽  
Vol 4 (1) ◽  
Author(s):  
Sritrusta Sukaridhoto ◽  
Hestiasari Rante ◽  
Muhammad Agus Zainuddin ◽  
Rizqi Putri Nourma Budiarti

Dunia telah memasuki zaman Industry 4.0, dimana teknologi pendukungnya adalah Virtual Reality (VR) dan Augmented Reality (AR). Saat ini teknologi VR/AR sudah semakin berkembang pesat, sudah banyak peneliti dan industri yang mengembangkan aplikasi VR/AR. VR adalah teknologi komputer yang mampu memreplikasi lingkungan real maupun hayal dan mampu menstimulasi kondisi fisik pengguna sehingga mampu berinteraksi. Perangkat yang digunakan untuk dapat menggunakan teknologi VR ada berbagai macam, dari perangkat Head-Mounted-Display, perangkat masukan, perangkat lunak, konten, hingga perangkat gabungan. Pengetahuan tentang teknologi VR ini bias didapat dari Internet. Namun apakah teknologi ini sudah dikenal oleh masyarakat Indonesia, khususnya sekolah sebagai pendukung kegiatan edukasi? terutamanya oleh siswa menengah dalam membantu siswa untuk belajar dan mencari pengetahuan. Untuk menjawab permasalahan tersebut, Kami mengadakan kegiatan pengabdian masyarakat dengan judul “Pengenalan Teknologi Virtual Reality dan Augmented Reality sebagai Pendukung Edukasi untuk Siswa Menengah di Gresik”. Dimana dalam kegiatan tersebut Kami menjelaskan cara kerja teknologi VR/AR, implementasi penggunaan teknologi VR/AR berserta contoh-contoh aplikasi yang dapat digunakan untuk edukasi, dan penjelasan tentang aplikasi VR/AR yang tidak baik untuk siswa. Dari hasil pengamatan didapatkan bahwa 80% penggunaan teknologi VR/AR mudah dan berguna untuk edukasi, namun untuk implementasinya masih membutuhkan biaya.


Author(s):  
Inês Soares ◽  
Ricardo Sousa ◽  
Marcelo Petry ◽  
António Moreira

Augmented and Virtual Reality have been experiencing a rapidly growth in recent years, but there is not still a deep knowledge on their capabilities and where they could be explored. In that sense, this paper presents a study on the accuracy and repeatability of the Microsoft's HoloLens 2 (Augmented Reality device) and HTC Vive (Virtual Reality device) using an OptiTrack system as ground truth. For the HoloLens 2, the method used was hand tracking, while in HTC Vive, the object tracked was the system's hand controller. A series of tests in different scenarios and situations were performed to explore what could influence the measures. The HTC Vive obtained results in the millimetre scale, while the HoloLens 2 revealed not so accurate measures (around 2 centimetres). Although the difference can seem to be considerable, the fact that HoloLens 2 was tracking the user's hand and not an inherit controller made a huge impact. The results were considered a significant step for the on going project of developing a human-robot interface to program by demonstration an industrial robot using Extended Reality, which shows great potential to succeed based on this data.


2012 ◽  
Vol 463-464 ◽  
pp. 1654-1657 ◽  
Author(s):  
Florin Gîrbacia ◽  
Mihai Duguleana ◽  
Adrian Stavar

This paper presents a methodology and a prototype system for off-line programming of an industrial robot using augmented reality technology. The system allows to control a virtual model of the industrial robot co-located in the real environment, planning for collision-free paths, generate robot program and simulate the robot actions before the real robot perform the task. The advantage of this system is use of inexpensive equipment for intuitive off-line programming of an industrial robot.


2021 ◽  
Author(s):  
Stanley Mugisha ◽  
Matteo Zoppi ◽  
Rezia Molfino ◽  
Vamsi Guda ◽  
Christine Chevallereau ◽  
...  

Abstract In the list of interfaces used to make virtual reality, haptic interfaces allow users to touch a virtual world with their hands. Traditionally, the user’s hand touches the end effector of a robotic arm. When there is no contact, the robotic arm is passive; when there is contact, the arm suppresses mobility to the user’s hand in certain directions. Unfortunately, the passive mode is never completely seamless to the user. Haptic interfaces with intermittent contacts are interfaces using industrial robots that move towards the user when contact needs to be made. As the user is immersed via a virtual reality Head Mounted Display (HMD), he cannot perceive the danger of a collision when he changes his area of interest in the virtual environment. The objective of this article is to describe movement strategies for the robot to be as fast as possible on the contact zone while guaranteeing safety. This work uses the concept of predicting the position of the user through his gaze direction and the position of his dominant hand (the one touching the object). A motion generation algorithm is proposed and then applied to a UR5 robot with an HTC vive tracker system for an industrial application involving the analysis of materials in the interior of a car.


2021 ◽  
Vol 13 (18) ◽  
pp. 10336
Author(s):  
Gaurav Garg ◽  
Vladimir Kuts ◽  
Gholamreza Anbarjafari

A Digital Twin is the concept of creating a digital replica of physical models (such as a robot). This is similar to establishing a simulation using a robot operating system (ROS) or other industrial-owned platforms to simulate robot operations and sending the details to the robot controller. In this paper, we propose a Digital Twin model that assists in the online/remote programming of a robotic cell by creating a 3D digital environment of a real-world configuration. Our Digital Twin model consists of two components, (1) a physical model: FANUC robot (M-10iA/12), and (2) a digital model: Unity (a gaming platform) that comes with specialized plugins for virtual and augmented reality devices. One of the main challenges in the existing approach of robot programming is writing and modifying code for a robot trajectory that is eased in our framework using a Digital Twin. Using a Digital Twin setup along with Virtual Reality, we observe the trajectory replication between digital and physical robots. The simulation analysis provided a latency of approximately 40 ms with an error range of −0.28 to 0.28∘ across the robot joint movements in a simulation environment and −0.3 to 0.3∘ across the actual robot joint movements. Therefore, we can conclude that our developed model is suitable for industrial applications.


2021 ◽  
Author(s):  
Juan Sebastian Toquica ◽  
José Maurı́cio Motta

Abstract This paper proposes a methodology for calibration of industrial robots that uses a concept of measurement sub-regions, allowing low-cost solutions and easy implementation to meet the robot accuracy requirements in industrial applications. The solutions to increasing the accuracy of robots today have high-cost implementation, making calibration throughout the workplace in industry a difficult and unlikely task. Thus, reducing the time spent and the measured workspace volume of the robot end-effector are the main benefits of the implementation of the sub-region concept, ensuring sufficient flexibility in the measurement step of robot calibration procedures. The main contribution of this article is the proposal and discussion of a methodology to calibrate robots using several small measurement sub-regions and gathering the measurement data in a way equivalent to the measurements made in large volume regions, making feasible the use of high-precision measurement systems but limited to small volumes, such as vision-based measurement systems. The robot calibration procedures were simulated according to the literature, such that results from simulation are free from errors due to experimental setups as to isolate the benefits of the measurement proposal methodology. In addition, a method to validate the analytical off-line kinematic model of industrial robots is proposed using the nominal model of the robot supplier incorporated into its controller.


2019 ◽  
Vol 20 (1) ◽  
pp. 34-43
Author(s):  
V. L. Afonin ◽  
L. V. Gavrilina ◽  
A. N. Smolentsev

When performing certain technological operations, multi-coordinate industrial robots require simultaneous control of the movement of the executive body and the developed effort. When performing assembly operations (for example, a shaft with a bush), it is necessary to perform a free movement of the shaft along the bore of the bushing and to ensure minimum pressure on the bore walls. When performing operations to handle complex surfaces of parts, it is simultaneously required to move the tool over the surface at a specified speed and to perform a metered pressure on the surface. Since it is impossible to control the force and motion simultaneously at the same coordinate, it is necessary either to switch from one control method to another, or to control various actuators and different controllable coordinates of the actuator. In multi-coordinate robots, this task is complicated by the fact that to control the movement of one of the Cartesian coordinates of the executive body, and by another force, it is simultaneously necessary to control the interrelated generalized coordinates of the robot’s mechanism. In the work presented, the solution of the problem of control of a six-coordinate industrial robot is described, in which the separation of the degrees of mobility into power control and positional control of trajectory motion is carried out. In order to accomplish the task, additional variable parameters are introduced for the treatment of complex surfaces, which determine the position of the cutting edge on the cutting surface, which makes it possible to expand the service area of the robot during selection, for example, one of the coordinates for controlling the pressure force. This task is considered using the example of a six-coordinate industrial robot when performing a complex surface treatment operation, when it is required to program the tool at a specified speed along a path on the surface and at the same time carry out the controlled pressure of the tool on the surface.


2020 ◽  
Vol 10 (13) ◽  
pp. 4619 ◽  
Author(s):  
Matteo Bottin ◽  
Silvio Cocuzza ◽  
Nicola Comand ◽  
Alberto Doria

The stiffness properties of industrial robots are very important for many industrial applications, such as automatic robotic assembly and material removal processes (e.g., machining and deburring). On the one hand, in robotic assembly, joint compliance can be useful for compensating dimensional errors in the parts to be assembled; on the other hand, in material removal processes, a high Cartesian stiffness of the end-effector is required. Moreover, low frequency chatter vibrations can be induced when low-stiffness robots are used, with an impairment in the quality of the machined surface. In this paper, a compliant joint dynamic model of an industrial robot has been developed, in which joint stiffness has been experimentally identified using a modal approach. First, a novel method to select the test configurations has been developed, so that in each configuration the mode of vibration that chiefly involves only one joint is excited. Then, experimental tests are carried out in the selected configurations in order to identify joint stiffness. Finally, the developed dynamic model of the robot is used to predict the variation of the natural frequencies in the workspace.


Sign in / Sign up

Export Citation Format

Share Document