Intelligent Digital Twins and Augmented Reality in Inspection and Maintenance

2021 ◽  
Author(s):  
Farid Akbari
Keyword(s):  
Artificial Intelligence ◽  
Augmented Reality ◽  
Mobile Application ◽  
3D Model ◽  
3D Models ◽  
Smart Glasses ◽  
Digital Twins ◽  
Visual Support ◽  
Inspection And Maintenance ◽  
The Creation

Abstract Objective/Scope Simplify and semi-automate the creation of Intelligent Digital Twins available on an augmented hybrid solution (on/offline) based on the latest mobile solutions and wearable technologies (Smart Glasses) communicating over Bluetooth. The main objective was to implement an interactive environment of digital twins through Augmented Reality (AR) to improve decision-making, enhance performance and optimize efficiencies in Inspection and Maintenance. Methods, Procedures, Process A breakthrough algorithm enabled to semi-automate the creation of 3D models by providing a platform of Intelligent Digital Twins to connect to various disparate systems and use Artificial Intelligence-driven augmentation techniques to contextualize and enrich the model with Tag numbers from the asset register. An application has been developed for Smart Glasses by transforming the Digital Twins into sectioned files to enable a performant AR experience and an on/offline syncing functionality with the mobile solution over Bluetooth. Furthermore, the 3D model was embedded within the mobile application for visual support during Inspection and Maintenance. Results, Observations, Conclusions As a result, the following products have been developed to improve efficiency and productivity by leveraging innovative technologies: Application for Intelligent Digital Twins: Single Source of Truth for managing and maintaining Intelligent Digital Twins using breakthrough technology to semi-automate the creation of 3D models from Point Cloud data. A Mark-Up Tool and a Contextualization Editor were developed on the promise of Digital Twins to introduce a communication, collaboration, and planning tool. Furthermore, the 3D model has been embedded within the mobile application environment for visual support on the field tablets. Application for Smart Glasses (AR Headset): An application has been developed for the latest AR Headset to enable an Augmented Reality experience and a Mark-Up tool with Bluetooth communication to the mobile application as well as to support a hybrid on/offline syncing functionality as well as data capturing on the fly. With its basic functionality of hands-free video streaming and communication functionality, the AR Headset enabled a Remote Pre-Commissioning, Certification, and Audit with vendors and independent certifiers during the pandemic. Application Programming Interfaces (API): API interfaces were established to various source systems like the Computerized Maintenance Management System, Inspection Data Management System, Drawing System, and the Process Information System to integrate and visualize the big data within the platform of Intelligent Digital Twins. Novel/Additive Information The use of automation and artificial intelligence (AI) driven technologies for creating Intelligent Digital Twins is a key enabler for global scalability and accelerates creating the company's digital backbone during the digital transformation. Enhancing this technology with an Augmented Reality experience, including mark-up annotations, provides a solid basis for data insights, data-driven decision making, and performance optimization.

scholarly journals Development of augmented reality mobile application on android OS

2021 ◽  
Author(s):  
А.М. Galeeva ◽  
◽  
О.А. Medvedeva
Keyword(s):  
Augmented Reality ◽  
Mobile Application ◽  
3D Model ◽  
3D Models ◽  
Educational Process ◽  
Use Case ◽  
Modeling Methods ◽  
Lecture Material ◽  
Android Os ◽  
Educational Motivation

The article describes the use of augmented reality technologies in the modern educational process to increase educational motivation, multimedia, and interactivity of the lecture material. The main purpose of the application: educational and cognitive. In the process of performing work, computer graphics, algorithms, and modeling methods were used. Use case: there are special images on the stand that the mobile application recognizes and shows the created 3D models of the “Sun” and “Milky Way”. In addition, while the 3D model is being displayed, a short training audio lecture will be held. To create a 3D model of objects, the Unity program was used in conjunction with the augmented reality platform Vuforia.

An Augmented-Reality-Based Intelligent Mobile Application for Open Computer Education

2017 ◽  
pp. 154-174 ◽  
Author(s):  
Utku Köse
Keyword(s):  
Artificial Intelligence ◽  
Augmented Reality ◽  
Mobile Application ◽  
Learning Experiences ◽  
Computer Education ◽  
Dynamic Learning ◽  
Common Environment ◽  
Application System ◽  
Course Materials

Objective of this chapter is to introduce an Augmented Reality based intelligent mobile application (M-Learning application) to support courses of Computer Education. In the study, it was aimed to provide an alternative way of improving M-Learning experiences by employing both Augmented Reality and Artificial Intelligence based approaches in a common environment. Briefly, the application is able to use an intelligent mechanism evaluating students' several dynamic learning parameters to match them with the most appropriate course materials provided over the system. So, each student can encounter with appropriate course materials matching with their states over the application system. The related course materials include both AR based ones and standard ones as uploaded by teachers. An evaluation based flow has been run in the study by using the developed application through courses of Computer Education and the obtained results have shown that the application is effective and successful enough at improving students' learning experiences and achieving a good Open Computer Education.

Augmented Reality Aided 3D Modelling

2014 ◽  
Vol 1036 ◽  
pp. 1037-1040
Author(s):  
Radu Emanuil Petruse ◽  
Ioan Bondrea ◽  
Marco Sacco ◽  
Stefano Mottura
Keyword(s):  
Augmented Reality ◽  
3D Model ◽  
3D Models ◽  
Spatial Visualization ◽  
3D Modelling ◽  
Technical Drawing

The purpose of the article is to introduce possibilities of using Augmented Reality instructions in order to better understand technical drawings. The aim of these instructions based on 3D models is to create AR training applications and analyze their impact on the users. These instructions consist in a 3D model, superimposed over the technical drawing. The AR application also offers step by step instructions for 3D modelling in CAD software, which are very useful in creating the 3D model starting from a technical drawing. The AR application was tested by students from the Faculty of Engineering in Sibiu, obtaining great improvements in their 3D modelling times. The results of a survey that the students completed reveal that the AR modelling instructions also aids their spatial visualization capability.

Efficient Creation of Augmented Reality Content by Using an Intuitive Authoring System

2004 ◽  
Author(s):  
Carsten Matysczok ◽  
Peter Ebbesmeyer ◽  
Holger Krumm ◽  
Jo¨rg Maciej
Keyword(s):  
Augmented Reality ◽  
3D Models ◽  
Technological Knowledge ◽  
Software Tools ◽  
Authoring System ◽  
Recent Advances ◽  
Augmented Reality Application ◽  
Augmented Reality Technology ◽  
The Creation ◽  
User Friendly

Recent advances have shown, that the base technology of augmented reality have matured the point of being usable only by specialists. But existing augmented reality applications are still prototypes. They are developed without any authoring system, only by software experts. To support the wide use of augmented reality technology, the designers of augmented reality application need methods and software tools to create the contents in a fast and cheap way. In this paper we describe an authoring system for creating augmented reality content in an easy and user friendly way. The system allows the creation of augmented reality applications in a straight forward way. By using meta-constructs like menus, selection lists or hotspots as well as illustration objects like 3D-models, videos, texts and sounds a variety of applications can be created without previous technological knowledge. A preview window is also part of the authoring system displaying the actual created AR-application.

scholarly journals 3D SURVEY AND AUGMENTED REALITY FOR CULTURAL HERITAGE. THE CASE STUDY OF AURELIAN WALL AT CASTRA PRAETORIA IN ROME

2016 ◽  
Vol XLI-B5 ◽  
pp. 931-937 ◽  
Author(s):  
M. Canciani ◽  
E. Conigliaro ◽  
M. Del Grasso ◽  
P. Papalini ◽  
M. Saccone
Keyword(s):  
Augmented Reality ◽  
Cultural Heritage ◽  
Coming Out ◽  
3D Model ◽  
Low Cost ◽  
Conservation Status ◽  
3D Models ◽  
Curtain Wall ◽  
Virtual Reconstruction

The development of close-range photogrammetry has produced a lot of new possibility to study cultural heritage. 3D data acquired with conventional and low cost cameras can be used to document, investigate the full appearance, materials and conservation status, to help the restoration process and identify intervention priorities. At the same time, with 3D survey a lot of three-dimensional data are collected and analyzed by researchers, but there are a very few possibility of 3D output. The augmented reality is one of this possible output with a very low cost technology but a very interesting result. Using simple mobile technology (for iPad and Android Tablets) and shareware software (in the case presented “Augment”) it is possible to share and visualize a large number of 3D models with your own device. The case study presented is a part of an architecture graduate thesis, made in Rome at Department of Architecture of Roma Tre University. We have developed a photogrammetric survey to study the Aurelian Wall at Castra Praetoria in Rome. The surveys of 8000 square meters of surface have allowed to identify stratigraphy and construction phases of a complex portion of Aurelian Wall, specially about the Northern door of Castra. During this study, the data coming out of 3D survey (photogrammetric and topographic), are stored and used to create a reverse 3D model, or virtual reconstruction, of the Northern door of Castra. This virtual reconstruction shows the door in the Tiberian period, nowadays it's totally hidden by a curtain wall but, little and significative architectural details allow to know its original feature. The 3D model of the ancient walls has been mapped with the exact type of bricks and mortar, oriented and scaled according to the existing one to use augmented reality. Finally, two kind of application have been developed, one on site, were you can see superimposed the virtual reconstruction on the existing walls using the image recognition. On the other hand, to show the results also during the graduation day, the same application has been created in off-site condition using a poster.

scholarly journals An Architecture for Mobile Outdoors Augmented Reality for Cultural Heritage

2018 ◽  
Vol 7 (12) ◽  
pp. 463 ◽  
Author(s):  
Chris Panou ◽  
Lemonia Ragia ◽  
Despoina Dimelli ◽  
Katerina Mania
Keyword(s):  
Augmented Reality ◽  
Cultural Heritage ◽  
Real World ◽  
3D Model ◽  
3D Models ◽  
Interest Points ◽  
Historical Information ◽  
The Real ◽  
Heritage Sites ◽  
Past State

In this paper, we present the software architecture of a complete mobile tourist guide for cultural heritage sites located in the old town of Chania, Crete, Greece. This includes gamified components that motivate the user to traverse the suggested interest points, as well as technically challenging outdoors augmented reality (AR) visualization features. The main focus of the AR feature is to superimpose 3D models of historical buildings in their past state onto the real world, while users walk around the Venetian part of Chania’s city, exploring historical information in the form of text and images. We examined and tested registration and tracking mechanisms based on commercial AR frameworks in the challenging outdoor, sunny environment of a Mediterranean town, addressing relevant technical challenges. Upon visiting one of three significant monuments, a 3D model displaying the monument in its past state is visualized onto the mobile phone’s screen at the exact location of the real-world monument, while the user is exploring the area. A location-based experience was designed and integrated into the application, enveloping the 3D model with real-world information at the same time. The users are urged to explore interest areas and unlock historical information, while earning points following a gamified experience. By combining AR technologies with location-aware and gamified elements, we aim to promote the technologically enhanced public appreciation of cultural heritage sites and showcase the cultural depth of the city of Chania.

scholarly journals THE WINCKELMANN300 PROJECT: DISSEMINATION OF CULTURE WITH VIRTUAL REALITY AT THE CAPITOLINE MUSEUM IN ROME

2018 ◽  
Vol XLII-2 ◽  
pp. 371-378 ◽  
Author(s):  
S. Gonizzi Barsanti ◽  
S. G. Malatesta ◽  
F. Lella ◽  
B. Fanini ◽  
F. Sala ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Augmented Reality ◽  
18Th Century ◽  
3D Models ◽  
Original Position ◽  
Space And Time ◽  
Interactive Tool ◽  
Digital Contents ◽  
Virtual And Augmented Reality ◽  
The Creation

The best way to disseminate culture is, nowadays, the creation of scenarios with virtual and augmented reality that supply the visitors of museums with a powerful, interactive tool that allows to learn sometimes difficult concepts in an easy, entertaining way. 3D models derived from reality-based techniques are nowadays used to preserve, document and restore historical artefacts. These digital contents are also powerful instrument to interactively communicate their significance to non-specialist, making easier to understand concepts sometimes complicated or not clear. Virtual and Augmented Reality are surely a valid tool to interact with 3D models and a fundamental help in making culture more accessible to the wide public. These technologies can help the museum curators to adapt the cultural proposal and the information about the artefacts based on the different type of visitor’s categories. These technologies allow visitors to travel through space and time and have a great educative function permitting to explain in an easy and attractive way information and concepts that could prove to be complicated. The aim of this paper is to create a virtual scenario and an augmented reality app to recreate specific spaces in the Capitoline Museum in Rome as they were during Winckelmann’s time, placing specific statues in their original position in the 18th century.

scholarly journals Use of Artificial Intelligence in the Field of Sustainable Architecture: Current Knowledge

2021 ◽  
Vol 26 (1) ◽  
pp. 20-29
Author(s):  
Veronika Krausková ◽  
Henrich Pifko
Keyword(s):  
Artificial Intelligence ◽  
Information Technologies ◽  
3D Model ◽  
Current Knowledge ◽  
3D Models ◽  
Critical Studies ◽  
Amount Of Information ◽  
Building Management ◽  
Building Information ◽  
2D Drawing

Abstract Innovative technologies help automate the work of the designer. A 3D model of the building can be used to calculate the required values. This will also allow you to create associative sections that, when changing the geometry of the 3D model, automatically adjust the drawn elements on the resulting 2D drawing. Information technologies enable participants from all over the world to work on one project and, thanks to the BIM (building information modelling) method, to design buildings during their life cycle more efficiently. At present, critical studies are published on interoper-ability in BIM and its lack of coordination or amount of information that is misinterpreted, etc. However, working in BIM is the most effective way to use computer technology to design buildings. There is a lot of information about the building in the 3D model itself, which can also be used for purposes other than construction (building management, reconstruction). But how to process a large amount of information in a 3D model? Many buildings already have their 3D models shared on cloud platforms, these contain information that could help, for example, find solutions for green construction using artificial intelligence (AI). We meet with AI every day. It supports internet search engines, predicts auto-completion words as you type. AI can also be found in architecture – not only as visions at exhibitions, but also in research on process optimization in BIM.

scholarly journals Scale-Variant Flight Planning for the Creation of 3D Geovisualization and Augmented Reality Maps of Geosites: The Case of Voulgaris Gorge, Lesvos, Greece

2021 ◽  
Vol 11 (22) ◽  
pp. 10733
Author(s):  
Ermioni-Eirini Papadopoulou ◽  
Apostolos Papakonstantinou ◽  
Nikolaos Zouros ◽  
Nikolaos Soulakellis
Keyword(s):  
Augmented Reality ◽  
Data Acquisition ◽  
Spatial Resolution ◽  
3D Model ◽  
Dynamic Range ◽  
3D Models ◽  
Virtual Space ◽  
Aerial Images ◽  
Unmanned Aerial Systems ◽  
Flight Planning

The purpose of this paper was to study the influence of cartographic scale and flight design on data acquisition using unmanned aerial systems (UASs) to create augmented reality 3D geovisualization of geosites. The relationship between geographical and cartographic scales, the spatial resolution of UAS-acquired images, along with their relationship with the produced 3D models of geosites, were investigated. Additionally, the lighting of the produced 3D models was examined as a key visual variable in the 3D space. Furthermore, the adaptation of the 360° panoramas as environmental lighting parameters was considered. The geosite selected as a case study was the gorge of the river Voulgaris in the western part of the island of Lesvos, which is located in the northeastern part of the Aegean Sea in Greece. The methodology applied consisted of four pillars: (i) scale-variant flight planning, (ii) data acquisition, (iii) data processing, (iv) AR, 3D geovisualization. Based on the geographic and cartographic scales, the flight design calculates the most appropriate flight parameters (height, speed, and image overlaps) to achieve the desired spatial resolution (3 cm) capable of illustrating all the scale-variant details of the geosite when mapped in 3D. High-resolution oblique aerial images and 360° panoramic aerial images were acquired using scale-variant flight plans. The data were processed using image processing algorithms to produce 3D models and create mosaic panoramas. The 3D geovisualization of the geosite selected was created using the textured 3D model produced from the aerial images. The panoramic images were converted to high-dynamic-range image (HDRI) panoramas and used as a background to the 3D model. The geovisualization was transferred and displayed in the virtual space where the panoramas were used as a light source, thus enlightening the model. Data acquisition and flight planning were crucial scale-variant steps in the 3D geovisualization. These two processes comprised the most important factors in 3D geovisualization creation embedded in the virtual space as they designated the geometry of the 3D model. The use of panoramas as the illumination parameter of an outdoor 3D scene of a geosite contributed significantly to its photorealistic performance into the 3D augmented reality and virtual space.

Sign in / Sign up

Export Citation Format

Share Document