scholarly journals Augmented reality in scientific visualization and communications: a new dawn of looking at antibody interactions

2020 ◽  
Vol 3 (3) ◽  
pp. 221-226
Author(s):  
Kwok-Fong Chan ◽  
Jun-Jie Poh ◽  
Wei-Ling Wu ◽  
Samuel Ken-En Gan
Keyword(s):  
Augmented Reality ◽  
Medical Training ◽  
3D Visualization ◽  
Three Dimensional ◽  
Molecular Structures ◽  
Stereo Images ◽  
Molecular Visualization ◽  
Holistic View ◽  
Visualization Software ◽  
Antibody Interactions

ABSTRACT The use of augmented reality (AR) in providing three-dimensional (3D) visual support and image depth have been applied in education, tourism, historical studies, and medical training. In research and development, there has been a slow but growing use of AR tools in chemical and drug discovery, but little has been implemented for whole 3D antibody structures (IgE, IgM, IgA, IgG, and IgD) and in communicating their interactions with the antigens or receptors in publications. Given that antibody interactions can vary significantly between different monoclonal antibodies, a convenient and easy to use 3D visualization can convey structural mechanisms clearer to readers, especially in how residues may interact with one another. While this was previously constrained to the use of stereo images on printed material or molecular visualization software on the computer, the revolution of smartphone and phablets now allows visualization of whole molecular structures on-the-go, allowing rotations, zooming in and out, and even animations without complex devices or the training of visual prowess. While not yet as versatile as molecular visualization software on the computer, such technology is an improvement from stereo-images and bridges the gap with molecular visualization tools. In this report, we discuss the use of AR and how they can be employed in the holistic view of antibodies and the future of the technology for better scientific communication.

scholarly journals MolAR: Bringing Chemical Structures to Life with Augmented Reality and Machine Learning

2021 ◽  
Author(s):  
Sukolsak Sakshuwong ◽  
Hayley Weir ◽  
Umberto Raucci ◽  
Todd J. Martínez
Keyword(s):  
Machine Learning ◽  
Augmented Reality ◽  
3D Structure ◽  
Three Dimensional ◽  
Real Life ◽  
Data Bank ◽  
Molecular Structures ◽  
Chemical Structures ◽  
Food And Drink ◽  
Research And Education

Visualizing three-dimensional molecular structures is crucial to understanding and predicting their chemical behavior. Existing visualization software, however, can be cumbersome to use, and, for many, hand-drawn skeletal structures remain the preferred method of chemical communication. Although convenient, the static, two-dimensional nature of these drawings can be misleading in conveying the molecule’s 3D structure, not to mention that dynamic movement is completely disregarded. Here, we combine machine learning and augmented reality (AR) to develop MolAR, an immersive mobile application for visualizing molecules in real-world scenes. The application uses deep learning to recognize hand-drawn hydrocarbons structures which it converts into interactive 3D molecules in AR. Users can also “hunt” for chemicals in food and drink to uncover molecules in their real-life environment. A variety of interesting molecules are pre-loaded into the application, and users can visualize molecules in PubChem by providing their name or SMILES string and proteins in the Protein Data Bank by providing their PDB ID. MolAR was designed to be used in both research and education settings, providing an almost barrierless platform to visualize and interact with 3D molecular structures in a uniquely immersive way.

scholarly journals Stereo3D: using stereo images to enrich 3D visualization

2020 ◽  
Vol 36 (14) ◽  
pp. 4189-4190
Author(s):  
Yang Liu ◽  
Vinod Kumar Singh ◽  
Deyou Zheng
Keyword(s):  
3D Visualization ◽  
Complex Structure ◽  
R Package ◽  
Supplementary Information ◽  
High Dimensional ◽  
Complex Data ◽  
Stereo Images ◽  
3D Space ◽  
Visualization Software ◽  
Critical Process

Abstract Summary Visualization in 3D space is a standard but critical process for examining the complex structure of high-dimensional data. Stereoscopic imaging technology can be adopted to enhance 3D representation of many complex data, especially those consisting of points and lines. We illustrate the simple steps that are involved and strongly recommend others to implement it in designing visualization software. To facilitate its application, we created a new software that can convert a regular 3D scatterplot or network figure to a pair of stereo images. Availability and implementation Stereo3D is freely available as an open source R package released under an MIT license at https://github.com/bioinfoDZ/Stereo3D. Others can integrate the codes and implement the method in academic software. Contact [email protected] Supplementary information Supplementary data are available at Bioinformatics online.

Learning Molecular Structures in a Tangible Augmented Reality Environment

2012 ◽  
pp. 1-18
Author(s):  
Kikuo Asai ◽  
Norio Takase
Keyword(s):  
User Interface ◽  
Augmented Reality ◽  
Performance Test ◽  
Three Dimensional ◽  
Preference Test ◽  
Molecular Structures ◽  
Web Browser ◽  
Usability Test ◽  
Sense Of Presence ◽  
Viewing Experience

This article presents the characteristics of using a tangible tabletop environment produced by augmented reality (AR), aimed at improving the environment in which learners observe three-dimensional molecular structures. The authors perform two evaluation experiments. A performance test for a user interface demonstrates that learners with a tangible AR environment were able to complete the task of identifying molecular structures more quickly and accurately than those with a typical desktop-PC environment using a Web browser. A usability test by participants who learned molecular structures and answered relevant questions demonstrates that the environments had no effect on their learning of molecular structures. However, a preference test reveals that learners preferred a more tangible AR environment to a Web-browser environment in terms of overall enjoyment, reality of manipulation, and sense of presence, and vice versa in terms of ease of viewing, experience, and durability.

scholarly journals 4D Building Information Modelling With Augmented Reality on Mobile Devices to Support Construction Management: Applications and key performance criteria from a stakeholder perspective

2021 ◽  
Author(s):  
◽  
Jay Vaai
Keyword(s):  
Project Management ◽  
Augmented Reality ◽  
Mobile Devices ◽  
Construction Management ◽  
3D Visualization ◽  
Three Dimensional ◽  
Performance Criteria ◽  
Building Industry ◽  
Structured Interviews ◽  
Building Information

<p>This research addresses the gap between construction project management and the 3D visualization of construction sequence. Typically project managers use software that presents construction stages as 2D Gantt charts, where the X axis represents time and the Y axis represents the construction activity. These are then typically cross referenced to either 2D or 3D construction drawings. The potential of linking construction sequencing charts and critical paths to Building Information Models is well established. So called ‘4D BIM’ applications such as Synchro enable the linking of three dimensional information and Gantt charts. There is also precedent in virtual reality simulations, such as the AR4BC project by (Woodward, Hakkarainen, & Rainio, 2010) and the desktop VR simulation applications for teaching construction management (Nikolic, 2006). From these and other precedents it is observed that 4D BIM is orientated towards the final stages of design where models are complex and not optimized, while full VR applications are typically not available in practice. Moreover, recent availability of augmented reality applications for mobile devices opens up new ways to integrate 4D BIM into project management. As part of initial discussions with consultants, a mock-up of an AR application running on a tablet that would enable on - site visualization was demonstrated. Given positive feedback, prototype applications were developed using the Unity interactive 3D authoring platform, which provides real time interaction between a Gantt chart and a 3D model. The final AR application uses a plan drawing as the marker and the user can switch between isometric and first person cameras to review construction sequencing, with the aim of identifying potential sequencing issues and / or clashes in the design while on site. The prototype interface and functionality have been evaluated through a series of structured interviews with building industry professionals. The results of these interviews have been analysed and from this, key performance criteria and guidelines for further development have been identified. This thesis illustrates the potential of AR on mobile devices for construction management, documents the design and implementation of a prototype application and articulates issues for further research from the perspective of key building industry stakeholders.</p>

scholarly journals UAV Forensic Analysis and Software Tools Assessment: DJI Phantom 4 and Matrice 210 as Case Studies

Electronics ◽  
2021 ◽  
Vol 10 (6) ◽  
pp. 733
Author(s):  
Fahad E. Salamh ◽  
Mohammad Meraj Mirza ◽  
Umit Karabiyik
Keyword(s):  
Data Storage ◽  
3D Visualization ◽  
Three Dimensional ◽  
Forensic Analysis ◽  
Software Tools ◽  
Storage Mechanism ◽  
Digital Forensic ◽  
Test And Evaluation ◽  
Multiple Components ◽  
Visualization Software

Unmanned Aerial Vehicles (UAVs) also known as drones have created many challenges to the digital forensic field. These challenges are introduced in all processes of the digital forensic investigation (i.e., identification, preservation, examination, documentation, and reporting). From identification of evidence to reporting, there are several challenges caused by the data type, source of evidence, and multiple components that operate UAVs. In this paper, we comprehensively reviewed the current UAV forensic investigative techniques from several perspectives. Moreover, the contributions of this paper are as follows: (1) discovery of personal identifiable information, (2) test and evaluation of currently available forensic software tools, (3) discussion on data storage mechanism and evidence structure in two DJI UAV models (e.g., Phantom 4 and Matrice 210), and (4) exploration of flight trajectories recovered from UAVs using a three-dimensional (3D) visualization software. The aforementioned contributions aim to aid digital investigators to encounter challenges posed by UAVs. In addition, we apply our testing, evaluation, and analysis on the two selected models including DJI Matrice 210, which have not been presented in previous works.

Learning Molecular Structures in a Tangible Augmented Reality Environment

2011 ◽  
Vol 2 (1) ◽  
pp. 1-18 ◽  
Author(s):  
Kikuo Asai ◽  
Norio Takase
Keyword(s):  
User Interface ◽  
Augmented Reality ◽  
Performance Test ◽  
Three Dimensional ◽  
Preference Test ◽  
Molecular Structures ◽  
Web Browser ◽  
Usability Test ◽  
Sense Of Presence ◽  
Viewing Experience

This article presents the characteristics of using a tangible tabletop environment produced by augmented reality (AR), aimed at improving the environment in which learners observe three-dimensional molecular structures. The authors perform two evaluation experiments. A performance test for a user interface demonstrates that learners with a tangible AR environment were able to complete the task of identifying molecular structures more quickly and accurately than those with a typical desktop-PC environment using a Web browser. A usability test by participants who learned molecular structures and answered relevant questions demonstrates that the environments had no effect on their learning of molecular structures. However, a preference test reveals that learners preferred a more tangible AR environment to a Web-browser environment in terms of overall enjoyment, reality of manipulation, and sense of presence, and vice versa in terms of ease of viewing, experience, and durability.

scholarly journals Interacting with Three-Dimensional Molecular Structures Using an Augmented Reality Mobile App

2020 ◽  
Vol 97 (10) ◽  
pp. 3877-3881
Author(s):  
Jonah Kailer Aw ◽  
Kevin Christopher Boellaard ◽  
Teck Kiang Tan ◽  
John Yap ◽  
Yi Ping Loh ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Mobile App ◽  
Molecular Structures

scholarly journals DEVELOPMENT OF A 3D CADASTRE AUGMENTED REALITY AND VISUALIZATION IN MALAYSIA

2022 ◽  
Vol XLVI-4/W3-2021 ◽  
pp. 123-130
Author(s):  
F. I. Hairuddin ◽  
A. R. Abdul Rasam ◽  
M. H. Razali
Keyword(s):  
Augmented Reality ◽  
Real World ◽  
3D Model ◽  
3D Visualization ◽  
Three Dimensional ◽  
3D Models ◽  
Land Administration ◽  
3D Cadastre ◽  
Property Registration ◽  
Enhanced Reality

Abstract. This paper discusses the capabilities of cadastre augmented reality (AR) and three-dimensional (3D) visualization in enhancing the stratified property visibility and information of the current strata plan in Malaysia. Currently, 2D information representation from the 2D+1D cadastre system is seen to be insufficient in serving real land management of the 3D aspect and property. Hence, toward a better digital 3D strata/property registration and land administration system in Malaysia, this study has explored the process in utilizing AR and 3D model to the current strata plan to enhance digital strata information contents and enabling the virtual strata plan presentation. The software used to develop the AR application smartphone was Unity3D software while Autodesk Revit applied to develop the 3D model and preparation of strata information. The interesting findings has been shown in this study. First result showed 3D models and strata parcel’s attribute that has been developed for AR digital content preparation. Secondly, this 3D-AR processes can continuously gather of user’s ambient information, conduct real-world recognition, and obtain real-world perception through smartphone device. Lastly, with utilization of AR technology in strata, it provides a more information to the strata plan without needing to change the current format of strata plan as the information are being displayed virtually onto the reality. With the integration of augmented reality and 3D visualization, the documentation of stratified properties in strata plan is potential to be enhanced from 2D planimetric to 3D representation. overlaid 3D model of the stratified property and standard strata information virtually on the present strata plan which has created an enhanced reality. This can allow the information to be viewed by more stakeholders with less restriction by using smartphone device.

scholarly journals 3D Visualization For Augmented Reality In ‘Jajanan Pasar’ Puzzles

2019 ◽  
Vol 11 (2) ◽  
Author(s):  
Jessica Carlina
Keyword(s):  
Augmented Reality ◽  
Mobile Devices ◽  
3D Model ◽  
3D Visualization ◽  
Three Dimensional ◽  
3D Models ◽  
Young Generation ◽  
3D Animation ◽  
Digital World

Jajanan Pasar is a term for Indonesian traditional snacks, a part of Indonesian culture that has been forgotten by the young generation. Three-dimensional (3D) animation and Augmented Reality (AR) can be used as a medium for introducing this culture to children aged 4 to 6. Because, in AR, visual between real and digital world can be altered, so the visual of 3D models can be enjoyed from various sides. This study focuses on 3D visualization for AR that packaged in 5 set of puzzles. Each piece has an illustration of the ingredients for making 5 kinds of Jajanan Pasar, after all, puzzle pieces of each set get arranged, a new 3D model of traditional snacks will be appeared. The data was collected using literature and existing studies method. The purpose of this study is to create an optimal 3D visualization for AR that will be applicated for mobile devices. Conclusion from this project are the polygon count and target marker’s quality, affect the appearance of the 3D model in AR form.

scholarly journals Molecular Modeling with Augmented Reality (MMAR)

2018 ◽  
Vol 6 (10) ◽  
pp. 187-205
Author(s):  
Alex Eder da Rocha Mazzuco ◽  
Aliane Loureiro Krassmann ◽  
Denis da Silva Garcia ◽  
Giliane Bernardi
Keyword(s):  
Molecular Modeling ◽  
Public School ◽  
Augmented Reality ◽  
Basic Education ◽  
Three Dimensional ◽  
Molecular Structures ◽  
Biomolecular Systems ◽  
Object Of Study ◽  
Education In Brazil ◽  
Complex Subject

Learning about molecular structures often becomes abstruse, due to its complex compositions, being aggravated by the restricted interactivity provided by the software commonly used. This difficulty can also be attached to the fact that most of the students do not present the necessary knowledge to work with biomolecular systems, affecting also the motivation in the object of study. In this context, the objective of this work is to analyze the influences related to interactivity, usability and motivation, provided by a web system called MMAR (Molecular Modeling with Augmented Reality), designed to support the learning of three-dimensional (3D) molecular structures. The system was applied to twenty-five students in the Chemistry discipline, from a technical course in a public school from basic education in Brazil. The results show that it was possible to assist students in the gain of knowledge, while simultaneously allowing them to enjoy themselves, providing unconventional learning, by increasing attractiveness, curiosity, attention, enthusiasm and relevance of such a complex subject in Chemistry.

Sign in / Sign up

Export Citation Format

Share Document