A VISION-BASED LOCATION POSITIONING SYSTEM VIA AUGMENTED REALITY: AN APPLICATION IN HUMANOID ROBOT NAVIGATION

2013 ◽  
Vol 10 (03) ◽  
pp. 1350019 ◽  
Author(s):  
OMID MOHARERI ◽  
AHMAD B. RAD

In this paper, we present a vision-based localization system using mobile augmented reality (MAR) and mobile audio augmented reality (MAAR) techniques, applicable to both humans and humanoid robots navigation in indoor environments. In the first stage, we propose a system that recognizes the location of a user from the image sequence of an indoor environment using its onboard camera. The location information is added to the user's view in the form of 3D objects and audio sounds with location information and navigation instruction content via augmented reality (AR). The location is recognized by using the prior knowledge about the layout of the environment and the location of the AR markers. The image sequence can be obtained using a smart phone's camera and the marker detection, 3D object placement and audio augmentation will be performed by the phone's operating processor and graphical/audio modules. Using this system will majorly reduce the hardware complexity of such navigation systems, as it replaces a system consisting of a mobile PC, wireless camera, head-mounted displays (HMD) and a remote PC with a smart phone with camera. In the second stage, the same algorithm is employed as a novel vision-based autonomous humanoid robot localization and navigation approach. The proposed technique is implemented on a humanoid robot NAO and improves the robot's navigation and localization performance previously done using an extended Kalman filter (EKF) by presenting location-based information to the robot through different AR markers placed in the robot environment.

Author(s):  
Chee Oh Chung ◽  
Yilun He ◽  
Hoe Kyung Jung

With the advent of the Android system, smart phones are rapidly developing and through the conveniency of accessing internet on the smart phones, a user’s location information can be accessed anywhere and anytime easily. Augmented Reality Based Technology enables the provision of variety information such as pictures and location of buildings in the navigation field. Most of the augmented reality program used to Visual Trace Method (Marker method and Markerless Method). For the Visual Trace Method, the marker installation and digital information should be assigned while the Non-visual Trace Method requires the use of hardware (G.P.S, sensors etc). Most navigation systems can only show the path from a user’s current location to their destination. In this paper, the design and implementation of an augmented reality program is discussed. It will use the smart phone’s inbuilt camera and GPS to display a user’s surround information in real time on the smart phone. The proposed system will combine the G.P.S location-based technology and virtual trace technology to provide the user with basic information about a building they are looking for or one in their immediate surrounding.


Author(s):  
Chee Oh Chung ◽  
Yilun He ◽  
Hoe Kyung Jung

With the advent of the Android system, smart phones are rapidly developing and through the conveniency of accessing internet on the smart phones, a user’s location information can be accessed anywhere and anytime easily. Augmented Reality Based Technology enables the provision of variety information such as pictures and location of buildings in the navigation field. Most of the augmented reality program used to Visual Trace Method (Marker method and Markerless Method). For the Visual Trace Method, the marker installation and digital information should be assigned while the Non-visual Trace Method requires the use of hardware (G.P.S, sensors etc). Most navigation systems can only show the path from a user’s current location to their destination. In this paper, the design and implementation of an augmented reality program is discussed. It will use the smart phone’s inbuilt camera and GPS to display a user’s surround information in real time on the smart phone. The proposed system will combine the G.P.S location-based technology and virtual trace technology to provide the user with basic information about a building they are looking for or one in their immediate surrounding.


Author(s):  
Jeakweon Han ◽  
Dennis Hong

Besides the difficulties in control and gait generation, designing a full-sized (taller than 1.3m) bipedal humanoid robot that can walk with two legs is a very challenging task, mainly due to the large torque requirements at the joints combined with the need for the actuators’ size and weight to be small. Most of the handful of successful humanoid robots in this size class that exist today utilize harmonic drives for gear reduction to gain high torque in a compact package. However, this makes the cost of such a robot too high and thus puts it out of reach of most of those who want to use it for general research, education and outreach activities. Besides the cost, the heavy weight of the robot also causes difficulties in handling and raises concerns for safety. In this paper we present the design of a new class of full-sized bipedal humanoid robots that is lightweight and low cost. This is achieved by utilizing spring assisted parallel four-bar linkages with synchronized actuation in the lower body to reduce the torque requirements of the individual actuators which also enables the use of off the shelf components to further reduce the cost significantly. The resulting savings in weight not only makes the operation of the robot safer, but also allows it to forgo the expensive force/torque sensors at the ankles and achieve stable bipedal walking only using the feedback from the IMU (Inertial Measurement Unit.) CHARLI-L (Cognitive Humanoid Autonomous Robot with Learning Intelligence - Lightweight) is developed using this approach and successfully demonstrated untethered bipedal locomotion using ZMP (Zero Moment Point) based control, stable omnidirectional gaits, and carrying out tasks autonomously using vision based localization.


2015 ◽  
Vol 761 ◽  
pp. 158-162
Author(s):  
Noraidah Blar ◽  
Fairul Azni Jafar ◽  
Syahril Anuar Idris ◽  
Mahasan Mat Ali

Robots are not rare applications anymore due to the advanced technology today. Everyone knows robots have been used in many fields. Humanoid robots are especially desirable in human society as they can work well in indoor environments that have been designed for humans. The technical characteristics for humanoid robot teacher listed in this paper are facial expression, walking, speaking and hearing, body gestures, and vision. These characteristics are believed to be essential in every humanoid robot involved in education. Technical explanations for each characteristic are provided throughout this paper. The list of robots that can be used as a robotic teacher is also given in this paper.


2018 ◽  
Author(s):  
Serena Marchesi ◽  
Davide Ghiglino ◽  
Francesca Ciardo ◽  
Jairo Pérez-Osorio ◽  
Ebru Baykara ◽  
...  

In daily social interactions, we need to be able to navigate efficiently through our social environment. According to Dennett (1971), explaining and predicting others’ behaviour with reference to mental states (adopting the intentional stance) allows efficient social interaction. Today we also routinely interact with artificial agents: from Apple’s Siri to GPS navigation systems. In the near future, we might start casually interacting with robots. This paper addresses the question of whether adopting the intentional stance can also occur with respect to artificial agents. We propose a new tool to explore if people adopt the intentional stance towards an artificial agent (humanoid robot). The tool consists in a questionnaire that probes participants’ stance by requiring them to choose the likelihood of an explanation (mentalistic vs. mechanistic) of a behaviour of a robot iCub depicted in a naturalistic scenario (a sequence of photographs). The results of the first study conducted with this questionnaire showed that although the explanations were somewhat biased towards the mechanistic stance, a substantial number of mentalistic explanations were also given. This suggests that it is possible to induce adoption of the intentional stance towards artificial agents, at least in some contexts.


2018 ◽  
Author(s):  
Kyle Plunkett

This manuscript provides two demonstrations of how Augmented Reality (AR), which is the projection of virtual information onto a real-world object, can be applied in the classroom and in the laboratory. Using only a smart phone and the free HP Reveal app, content rich AR notecards were prepared. The physical notecards are based on Organic Chemistry I reactions and show only a reagent and substrate. Upon interacting with the HP Reveal app, an AR video projection shows the product of the reaction as well as a real-time, hand-drawn curved-arrow mechanism of how the product is formed. Thirty AR notecards based on common Organic Chemistry I reactions and mechanisms are provided in the Supporting Information and are available for widespread use. In addition, the HP Reveal app was used to create AR video projections onto laboratory instrumentation so that a virtual expert can guide the user during the equipment setup and operation.


Author(s):  
Giorgio Metta

This chapter outlines a number of research lines that, starting from the observation of nature, attempt to mimic human behavior in humanoid robots. Humanoid robotics is one of the most exciting proving grounds for the development of biologically inspired hardware and software—machines that try to recreate billions of years of evolution with some of the abilities and characteristics of living beings. Humanoids could be especially useful for their ability to “live” in human-populated environments, occupying the same physical space as people and using tools that have been designed for people. Natural human–robot interaction is also an important facet of humanoid research. Finally, learning and adapting from experience, the hallmark of human intelligence, may require some approximation to the human body in order to attain similar capacities to humans. This chapter focuses particularly on compliant actuation, soft robotics, biomimetic robot vision, robot touch, and brain-inspired motor control in the context of the iCub humanoid robot.


2010 ◽  
Vol 07 (01) ◽  
pp. 157-182 ◽  
Author(s):  
HAO GU ◽  
MARCO CECCARELLI ◽  
GIUSEPPE CARBONE

In this paper, problems for an anthropomorphic robot arm are approached for an application in a humanoid robot with the specific features of cost oriented design and user-friendly operation. One DOF solution is proposed by using a suitable combination of gearing systems, clutches, and linkages. Models and dynamic simulations are used both for designing the system and checking the operation feasibility.


Author(s):  
Valentina Pennacchietti ◽  
Katharina Stoelzel ◽  
Anna Tietze ◽  
Erwin Lankes ◽  
Andreas Schaumann ◽  
...  

Abstract Introduction Endoscopic skull base approaches are broadly used in modern neurosurgery. The support of neuronavigation can help to effectively target the lesion avoiding complications. In children, endoscopic-assisted skull base surgery in combination with navigation systems becomes even more important because of the morphological variability and rare diseases affecting the sellar and parasellar regions. This paper aims to analyze our first experience on augmented reality navigation in endoscopic skull base surgery in a pediatric case series. Patients and methods A retrospective review identified seventeen endoscopic-assisted endonasal or transoral procedures performed in an interdisciplinary setting in a period between October 2011 and May 2020. In all the cases, the surgical target was a lesion in the sellar or parasellar region. Clinical conditions, MRI appearance, intraoperative conditions, postoperative MRI, possible complications, and outcomes were analyzed. Results The mean age of our patients was 14.5 ± 2.4 years. The diagnosis varied, but craniopharyngiomas (31.2%) were mostly represented. AR navigation was experienced to be very helpful for effectively targeting the lesion and defining the intraoperative extension of the pathology. In 65% of the oncologic cases, a radical removal was proven in postoperative MRI. The mean follow-up was 89 ± 79 months. There were no deaths in our series. No long-term complications were registered; two cerebrospinal fluid (CSF) fistulas and a secondary abscess required further surgery. Conclusion The implementation of augmented reality to endoscopic-assisted neuronavigated procedures within the skull base was feasible and did provide relevant information directly in the endoscopic field of view and was experienced to be useful in the pediatric cases, where anatomical variability and rarity of the pathologies make surgery more challenging.


2021 ◽  
Vol 18 (2) ◽  
pp. 1-16
Author(s):  
Holly C. Gagnon ◽  
Carlos Salas Rosales ◽  
Ryan Mileris ◽  
Jeanine K. Stefanucci ◽  
Sarah H. Creem-Regehr ◽  
...  

Augmented reality ( AR ) is important for training complex tasks, such as navigation, assembly, and medical procedures. The effectiveness of such training may depend on accurate spatial localization of AR objects in the environment. This article presents two experiments that test egocentric distance perception in augmented reality within and at the boundaries of action space (up to 35 m) in comparison with distance perception in a matched real-world ( RW ) environment. Using the Microsoft HoloLens, in Experiment 1, participants in two different RW settings judged egocentric distances (ranging from 10 to 35 m) to an AR avatar or a real person using a visual matching measure. Distances to augmented targets were underestimated compared to real targets in the two indoor, RW contexts. Experiment 2 aimed to generalize the results to an absolute distance measure using verbal reports in one of the indoor environments. Similar to Experiment 1, distances to augmented targets were underestimated compared to real targets. We discuss these findings with respect to the importance of methodologies that directly compare performance in real and mediated environments, as well as the inherent differences present in mediated environments that are “matched” to the real world.


Sign in / Sign up

Export Citation Format

Share Document