scholarly journals Augmented Reality for Robotics: A Review

Robotics ◽  
2020 ◽  
Vol 9 (2) ◽  
pp. 21 ◽  
Author(s):  
Zhanat Makhataeva ◽  
Huseyin Varol

Augmented reality (AR) is used to enhance the perception of the real world by integrating virtual objects to an image sequence acquired from various camera technologies. Numerous AR applications in robotics have been developed in recent years. The aim of this paper is to provide an overview of AR research in robotics during the five year period from 2015 to 2019. We classified these works in terms of application areas into four categories: (1) Medical robotics: Robot-Assisted surgery (RAS), prosthetics, rehabilitation, and training systems; (2) Motion planning and control: trajectory generation, robot programming, simulation, and manipulation; (3) Human-robot interaction (HRI): teleoperation, collaborative interfaces, wearable robots, haptic interfaces, brain-computer interfaces (BCIs), and gaming; (4) Multi-agent systems: use of visual feedback to remotely control drones, robot swarms, and robots with shared workspace. Recent developments in AR technology are discussed followed by the challenges met in AR due to issues of camera localization, environment mapping, and registration. We explore AR applications in terms of how AR was integrated and which improvements it introduced to corresponding fields of robotics. In addition, we summarize the major limitations of the presented applications in each category. Finally, we conclude our review with future directions of AR research in robotics. The survey covers over 100 research works published over the last five years.

2014 ◽  
Vol 39 (9) ◽  
pp. 1431-1438 ◽  
Author(s):  
Xiao-Yuan LUO ◽  
Shi-Kai SHAO ◽  
Xin-Ping GUAN ◽  
Yuan-Jie ZHAO

2003 ◽  
Vol 36 (3) ◽  
pp. 249-254
Author(s):  
Daniel Frey ◽  
Jens Nimis ◽  
Heinz Wörn ◽  
Peter Lockemann

Author(s):  
Fahad Iqbal Khawaja ◽  
Akira Kanazawa ◽  
Jun Kinugawa ◽  
Kazuhiro Kosuge

Human-Robot Interaction (HRI) for collaborative robots has become an active research topic recently. Collaborative robots assist the human workers in their tasks and improve their efficiency. But the worker should also feel safe and comfortable while interacting with the robot. In this paper, we propose a human-following motion planning and control scheme for a collaborative robot which supplies the necessary parts and tools to a worker in an assembly process in a factory. In our proposed scheme, a 3-D sensing system is employed to measure the skeletal data of the worker. At each sampling time of the sensing system, an optimal delivery position is estimated using the real-time worker data. At the same time, the future positions of the worker are predicted as probabilistic distributions. A Model Predictive Control (MPC) based trajectory planner is used to calculate a robot trajectory that supplies the required parts and tools to the worker and follows the predicted future positions of the worker. We have installed our proposed scheme in a collaborative robot system with a 2-DOF planar manipulator. Experimental results show that the proposed scheme enables the robot to provide anytime assistance to a worker who is moving around in the workspace while ensuring the safety and comfort of the worker.


Author(s):  
František Capkovic

The Petri nets (PN)-based analytical approach to describing both the single agent behaviour as well as the cooperation of several agents in MAS (multi agent systems) is presented. PN yield the possibility to express the agent behaviour and cooperation by means of the vector state equation in the form of linear discrete system. Hence, the modular approach to the creation of the MAS model can be successfully used too. Three different interconnections of modules (agents, interfaces, environment) expressed by PN subnets are introduced. The approach makes possible to use methods of linear algebra. Moreover, it can be successfully used at the system analysis (e.g. the reachability of states), at testing the system properties, and even at the system control synthesis.


2019 ◽  
Vol 23 (01) ◽  
pp. 1950015 ◽  
Author(s):  
YANDONG XIAO ◽  
CHULIANG SONG ◽  
LIANG TIAN ◽  
YANG-YU LIU

Our ability to understand and control the emergence of order in swarming systems is a fundamental challenge in contemporary science. The standard Vicsek model (SVM) — a minimal model for swarming systems of self-propelled particles — describes a large population of agents reaching global alignment without the need of central control. Yet, the emergence of order in this model takes time and is not robust to noise. In many real-world scenarios, we need a decentralized protocol to guide a swarming system (e.g., unmanned vehicles or nanorobots) to reach an ordered state in a prompt and noise-robust manner. Here, we find that introducing a simple adaptive rule based on the heading differences of neighboring particles in the Vicsek model can effectively speed up their global alignment, mitigate the disturbance of noise to alignment, and maintain a robust alignment under predation. This simple adaptive model of swarming systems could offer new insights in understanding the prompt and flexible formation of animals and help us design better protocols to achieve fast and robust alignment for multi-agent systems.


Sign in / Sign up

Export Citation Format

Share Document