Three-dimensional CityGML building models in mobile augmented reality: a smartphone-based pose tracking system

In cooperation with its strategic partners, Mada Center works to identify the needs of persons with disabilities for assistive technology and digital access solutions in Arabic. The center has supported start-ups and entrepreneurs to localize technological devices and solutions through the Mada Innovation Program, with the aim of improving digital accessibility for PWDs at the local, regional and international levels. This year, Mada and HBKU worked together to develop a mobile app using augmented reality technology and for the first time three dimensional AAC Symbols for learning purpose. The app is named A-Learn developed by Dr. Kamran Khowaja, Dr. Dena Al-Thani, and Dr. Siti Salwah Salim from Hamad Bin Khalifa University.

Download Full-text

An invisible head marker tracking system for indoor mobile augmented reality

Automation in Construction ◽

10.1016/j.autcon.2012.09.011 ◽

2013 ◽

Vol 33 ◽

pp. 104-115 ◽

Cited By ~ 20

Author(s):

Chyigang Kuo ◽

Taysheng Jeng ◽

Itung Yang

Keyword(s):

Augmented Reality ◽

Tracking System ◽

Mobile Augmented Reality ◽

Marker Tracking

Download Full-text

Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications

Sensors ◽

10.3390/s20041021 ◽

2020 ◽

Vol 20 (4) ◽

pp. 1021 ◽

Cited By ~ 8

Author(s):

Patrick Hübner ◽

Kate Clintworth ◽

Qingyi Liu ◽

Martin Weinmann ◽

Sven Wursthorn

Keyword(s):

Complete System ◽

Tracking System ◽

Three Dimensional ◽

Indoor Environments ◽

Mobile Augmented Reality ◽

Depth Sensor ◽

Depth Sensing ◽

Triangle Meshes ◽

Microsoft Hololens

The Microsoft HoloLens is a head-worn mobile augmented reality device that is capable of mapping its direct environment in real-time as triangle meshes and localize itself within these three-dimensional meshes simultaneously. The device is equipped with a variety of sensors including four tracking cameras and a time-of-flight (ToF) range camera. Sensor images and their poses estimated by the built-in tracking system can be accessed by the user. This makes the HoloLens potentially interesting as an indoor mapping device. In this paper, we introduce the different sensors of the device and evaluate the complete system in respect of the task of mapping indoor environments. The overall quality of such a system depends mainly on the quality of the depth sensor together with its associated pose derived from the tracking system. For this purpose, we first evaluate the performance of the HoloLens depth sensor and its tracking system separately. Finally, we evaluate the overall system regarding its capability for mapping multi-room environments.

Download Full-text

Pose tracking using motion state estimation for mobile augmented reality

2015 IEEE International Conference on Consumer Electronics (ICCE) ◽

10.1109/icce.2015.7066298 ◽

2015 ◽

Cited By ~ 3

Author(s):

Tatsuya Kobayashi ◽

Haruhisa Kato ◽

Hiromasa Yanagihara

Keyword(s):

Augmented Reality ◽

State Estimation ◽

Mobile Augmented Reality ◽

Pose Tracking ◽

Motion State

Download Full-text

Endoscopic Augmented Reality Navigation System for Endonasal Transsphenoidal Surgery to Treat Pituitary Tumors: Technical Note

Neurosurgery ◽

10.1097/00006123-200206000-00038 ◽

2002 ◽

Vol 50 (6) ◽

pp. 1393-1397 ◽

Cited By ~ 23

Author(s):

Takakazu Kawamata ◽

Hiroshi Iseki ◽

Takao Shibasaki ◽

Tomokatsu Hori

Keyword(s):

Augmented Reality ◽

Navigation System ◽

Transsphenoidal Surgery ◽

Tracking System ◽

Three Dimensional ◽

Pituitary Tumors ◽

Optical Tracking ◽

Navigation Systems ◽

Optical Tracking System ◽

Light Emitting

Abstract OBJECTIVE Endoscopes have been commonly used in transsphenoidal surgery to treat pituitary tumors, to compensate for the narrow surgical field. Although many navigation systems have been introduced for neurosurgical procedures, there have been few reports of navigation systems for endoscopic operations. This report presents our recently developed, endoscopic, augmented reality (AR) navigation system. METHODS The technology is based on the principles of AR environment technology. The system consisted of a rigid endoscope with light-emitting diodes, an optical tracking system, and a controller. The operation of the optical tracking system was based on two sets of infrared light-emitting diodes, which measured the position and orientation of the endoscope relative to the patient's head. We used the system during endonasal transsphenoidal operations to treat pituitary tumors in 12 recent cases. RESULTS Anatomic, “real,” three-dimensional, virtual images of the tumor and nearby anatomic structures (including the internal carotid arteries, sphenoid sinuses, and optic nerves) were superimposed on real- time endoscopic live images. The system also indicated the positions and directions of the endoscope and the endoscopic beam in three-dimensional magnetic resonance imaging or computed tomographic planes. Furthermore, the colors of the wire-frame images of the tumor changed according to the distance between the tip of the endoscope and the tumor. These features were superior to those of conventional navigation systems, which are available only for operating microscopes. CONCLUSION The endoscopic AR navigation system allows surgeons to perform accurate, safe, endoscope-assisted operations to treat pituitary tumors; it is particularly useful for reoperations, in which midline landmarks may be absent. We consider the AR navigation system to be a promising tool for safe, minimally invasive, endonasal, transsphenoidal surgery to treat pituitary tumors.

Download Full-text

Enhancing users involvement in architectural design using mobile augmented reality

Engineering Construction & Architectural Management ◽

10.1108/ecam-02-2021-0124 ◽

2021 ◽

Vol ahead-of-print (ahead-of-print) ◽

Author(s):

Bassam Shouman ◽

Ayman Ahmed Ezzat Othman ◽

Mohamed Marzouk

Keyword(s):

Augmented Reality ◽

Construction Projects ◽

Architectural Design ◽

Positive Impact ◽

Three Dimensional ◽

User Involvement ◽

Wall Material ◽

Mobile Augmented Reality ◽

Content Type ◽

Design Alternatives

PurposeMobile augmented reality (MAR) is one of the advanced three-dimensional (3D) representation tools that has been recently utilized in the construction industry. This paper aims to assess a user’s involvement levels through MAR application that has been experimented against traditional involvement techniques through an existing facility, plan re-designing scenario.Design/methodology/approachThrough reviewing related literature studies in the MAR field, an application has been developed that can superimpose real design alternatives on paper-based markers, allowing for flexible wall positioning, interior and exterior wall material application. As such, an enhanced user involvement experience is created. To measure user involvement levels, the application is experimented with 33 participants having the British University in Egypt’s library building as a case study, followed by survey questionnaires to gather and evaluate user responses.FindingsThe results of the analyzed data using SPSS indicated that MAR showed a positive impact on enhancing user involvement and better understanding of design projects. It also allowed users to produce different design alternatives in comparison to the traditional involvement approaches where users showed low design interaction and understanding.Originality/valueThe interactive features of the proposed application facilitate implementing ideas in design of construction projects that require user involvement.

Download Full-text