Visualizing Standardized Model-based Design and Inspection Data in Augmented Reality

2021 ◽  
pp. 1-14
Author(s):  
Teodor Vernica ◽  
Robert Lipman ◽  
Thomas Kramer ◽  
Soonjo Kwon ◽  
William Bernstein
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Major Barrier ◽  
Specific Data ◽  
Domain Specific ◽  
Data Representations ◽  
Product Manufacturing ◽  
Inspection Data ◽  
Maintenance Process ◽  
Product Assembly

Abstract Augmented reality (AR) has already helped manufacturers realize value across a variety of domains, including assistance in maintenance, process monitoring, and product assembly. However, coordinating traditional engineering data representations into AR systems without loss of context and information remains a challenge. A major barrier is the lack of interoperability between manufacturing-specific data models and AR-capable data representations. In response, we present a pipeline for porting standards-based design and inspection data into an AR scene. As a result, product manufacturing information with three-dimensional (3D) model data and corresponding inspection results are successfully overlaid onto a physical part. We demonstrate our pipeline by interacting with annotated parts while continuously tracking their pose and orientation. We then validate the pipeline by testing against six fully toleranced design models, accompanied by idealized inspection results. Our work (1) pro-vides insight on how to address fundamental issues related to interoperability between domain-specific models and AR systems and (2) establishes an open software pipeline from which others can implement and further develop.

Visualizing Model-Based Product Definitions in Augmented Reality

2021 ◽  
Author(s):  
Teodor Vernica ◽  
Robert Lipman ◽  
William Z. Bernstein
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Major Barrier ◽  
Specific Data ◽  
Domain Specific ◽  
Engineering Data ◽  
Data Representations ◽  
Design And Manufacturing ◽  
Product Manufacturing ◽  
Immense Potential

Abstract Augmented reality (AR) technologies present immense potential for the design and manufacturing communities. However, coordinating traditional engineering data representations into AR systems without loss of context and information remains a challenge. A major barrier is the lack of interoperability between manufacturing-specific data models and AR-capable data representations. In response, we present a pipeline for porting standards-based Product Manufacturing Information (PMI) with three-dimensional (3D) model data into an AR scene. We demonstrate our pipeline by interacting with annotated parts while continuously tracking their pose and orientation. Our work provides insight on how to address fundamental issues related to interoperability between domain-specific models and AR systems.

Augmented reality for next generation infrastructure inspections

2020 ◽  
pp. 147592172095384
Author(s):  
David DL Mascareñas ◽  
JoAnn P Ballor ◽  
Oscar L McClain ◽  
Miranda A Mellor ◽  
Chih-Yu Shen ◽  
...  
Keyword(s):  
High Resolution ◽  
Augmented Reality ◽  
Critical Infrastructure ◽  
Three Dimensional ◽  
Next Generation ◽  
Multiple Sources ◽  
Dimensional Measurements ◽  
Infrastructure Inspection ◽  
Inspection Data ◽  
Structural Inspection

This article introduces the use of emerging augmented reality technology to enable the next generation of structural infrastructure inspection and awareness. This work is driven by the prevalence of visual structural inspection. It is known that current visual inspection techniques have multiple sources of variance that should be reduced in order to achieve less ambiguous visual inspections. Emerging augmented reality tools feature a variety of sensors, computation, and communication resources that can enable relevant structural inspection data to be collected at very high resolution in an unambiguous manner. This work shows how emerging augmented reality tools can be used to greatly enhance our ability to capture comprehensive, high-resolution, three-dimensional measurements of critical infrastructure. This work also provides detailed information on the software architecture for augmented reality structural inspection applications that helps meet the goals of the framework. The fact that the framework is designed to accommodate the considerations associated with high-consequence infrastructure implies that it is also comprehensive enough to be applied to less hazardous but still high-value infrastructure such as bridges, dams, and tunnels. Augmented reality has great potential to enable the next generation of smart infrastructure, and this work focuses on addressing how augmented reality can be leveraged to enable the next generation of structural awareness for high-consequence, long-lifespan structures.

scholarly journals A Novel Suture Training System for Open Surgery Replicating Procedures Performed by Experts Using Augmented Reality

2021 ◽  
Vol 45 (5) ◽  
Author(s):  
Yuri Nagayo ◽  
Toki Saito ◽  
Hiroshi Oyama
Keyword(s):  
Augmented Reality ◽  
Motion Capture ◽  
Open Surgery ◽  
Three Dimensional ◽  
Training System ◽  
Surgical Skills ◽  
Surgical Instruments ◽  
Interrupted Suture ◽  
Education Environment ◽  
Surgical Field

AbstractThe surgical education environment has been changing significantly due to restricted work hours, limited resources, and increasing public concern for safety and quality, leading to the evolution of simulation-based training in surgery. Of the various simulators, low-fidelity simulators are widely used to practice surgical skills such as sutures because they are portable, inexpensive, and easy to use without requiring complicated settings. However, since low-fidelity simulators do not offer any teaching information, trainees do self-practice with them, referring to textbooks or videos, which are insufficient to learn open surgical procedures. This study aimed to develop a new suture training system for open surgery that provides trainees with the three-dimensional information of exemplary procedures performed by experts and allows them to observe and imitate the procedures during self-practice. The proposed system consists of a motion capture system of surgical instruments and a three-dimensional replication system of captured procedures on the surgical field. Motion capture of surgical instruments was achieved inexpensively by using cylindrical augmented reality (AR) markers, and replication of captured procedures was realized by visualizing them three-dimensionally at the same position and orientation as captured, using an AR device. For subcuticular interrupted suture, it was confirmed that the proposed system enabled users to observe experts’ procedures from any angle and imitate them by manipulating the actual surgical instruments during self-practice. We expect that this training system will contribute to developing a novel surgical training method that enables trainees to learn surgical skills by themselves in the absence of experts.

Three-dimensional augmented reality transperitoneal robot assisted partial nephrectomy (3d ar-rapn): A new tool to identify the hidden tumours

2019 ◽  
Vol 18 (6) ◽  
pp. e2690 ◽  
Author(s):  
F. Porpiglia ◽  
E. Checcucci ◽  
D. Amparore ◽  
F. Piramide ◽  
P. Verri ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Partial Nephrectomy ◽  
Three Dimensional ◽  
Robot Assisted

Facilitating 3D Virtual World Learning Environments Creation by Non-Technical End Users through Template-Based Virtual World Instantiation

2013 ◽  
Vol 4 (1) ◽  
pp. 32-48 ◽  
Author(s):  
Chang Liu ◽  
Ying Zhong ◽  
Sertac Ozercan ◽  
Qing Zhu
Keyword(s):  
Learning Environments ◽  
Virtual Worlds ◽  
Virtual World ◽  
Three Dimensional ◽  
End Users ◽  
Preliminary Evaluation ◽  
3D Design ◽  
Domain Specific ◽  
Functional Learning ◽  
Preliminary Experimental Data

This paper presents a template-based solution to overcome technical barriers non-technical computer end users face when developing functional learning environments in three-dimensional virtual worlds (3DVW). iVirtualWorld, a prototype of a platform-independent 3DVW creation tool that implements the proposed solution, facilitates 3DVW learning environment creation through semantics-based abstract 3DVW representation and template-based 3DVW instantiation. iVirtualWorld provides a wizard to guide the 3DVW creation process, and hide low-level programming and 3D design details through higher-level abstracts supported by pre-defined templates. Preliminary evaluation of the effectiveness of iVirtualWorld showed positive results. The contribution of this study is threefold: 1) It provides a paradigm for investigating and developing 3DVW building tools from end users’ perspective; 2) It develops a prototype of a 3DVW building tool, which gives educators a framework to easily create educational virtual worlds using domain-specific concepts; 3) It conducts empirical research and collected preliminary experimental data for evaluation.

scholarly journals Augmented Reality Chemical Reaction with User-Centered Design

2018 ◽  
Vol 218 ◽  
pp. 04012
Author(s):  
Finsa Nurpandi ◽  
Agung Gumelar
Keyword(s):  
Augmented Reality ◽  
Chemical Reactions ◽  
Periodic Table ◽  
Three Dimensional ◽  
User Centered Design ◽  
Structure Of Molecules ◽  
Level Of Activity ◽  
Chemistry Learning ◽  
Chemical Concepts ◽  
User Centered

One of chemistry is the chemical element that is represented by the symbol on the periodic table. The low level of activity, interest, and the result of chemistry learning in school is caused by the students generally having difficulty in solving problems related to chemical reactions. In addition, most of the chemical concepts are abstract so it is difficult to imagine the structure of molecules clearly. Augmented Reality can integrate digital elements with the real world in real time and follow the circumstances surrounding environment. Augmented Reality can provide a new more interactive concept in the learning process because users can directly interact naturally. By using Augmented Reality, the atoms in the periodic table will be scanned using a camera from an Android-based smartphone that has installed this app. The scan results are then compared with existing data and will show the molecular structure in three-dimensional form. Users can also observe reactions between atoms by combining multiple markers simultaneously. Augmented Reality application is built using the concept of user-centered design and Unity with personal license as development tools. By using this app, studying chemical reactions no longer requires a variety of chemicals that could be harmful to users.

Sign in / Sign up

Export Citation Format

Share Document