Learning Molecular Structures in a Tangible Augmented Reality Environment

2011 ◽  
Vol 2 (1) ◽  
pp. 1-18 ◽  
Author(s):  
Kikuo Asai ◽  
Norio Takase
Keyword(s):  
User Interface ◽  
Augmented Reality ◽  
Performance Test ◽  
Three Dimensional ◽  
Preference Test ◽  
Molecular Structures ◽  
Web Browser ◽  
Usability Test ◽  
Sense Of Presence ◽  
Viewing Experience

This article presents the characteristics of using a tangible tabletop environment produced by augmented reality (AR), aimed at improving the environment in which learners observe three-dimensional molecular structures. The authors perform two evaluation experiments. A performance test for a user interface demonstrates that learners with a tangible AR environment were able to complete the task of identifying molecular structures more quickly and accurately than those with a typical desktop-PC environment using a Web browser. A usability test by participants who learned molecular structures and answered relevant questions demonstrates that the environments had no effect on their learning of molecular structures. However, a preference test reveals that learners preferred a more tangible AR environment to a Web-browser environment in terms of overall enjoyment, reality of manipulation, and sense of presence, and vice versa in terms of ease of viewing, experience, and durability.

Learning Molecular Structures in a Tangible Augmented Reality Environment

2012 ◽  
pp. 1-18
Author(s):  
Kikuo Asai ◽  
Norio Takase
Keyword(s):  
User Interface ◽  
Augmented Reality ◽  
Performance Test ◽  
Three Dimensional ◽  
Preference Test ◽  
Molecular Structures ◽  
Web Browser ◽  
Usability Test ◽  
Sense Of Presence ◽  
Viewing Experience

This article presents the characteristics of using a tangible tabletop environment produced by augmented reality (AR), aimed at improving the environment in which learners observe three-dimensional molecular structures. The authors perform two evaluation experiments. A performance test for a user interface demonstrates that learners with a tangible AR environment were able to complete the task of identifying molecular structures more quickly and accurately than those with a typical desktop-PC environment using a Web browser. A usability test by participants who learned molecular structures and answered relevant questions demonstrates that the environments had no effect on their learning of molecular structures. However, a preference test reveals that learners preferred a more tangible AR environment to a Web-browser environment in terms of overall enjoyment, reality of manipulation, and sense of presence, and vice versa in terms of ease of viewing, experience, and durability.

The Studierstube Augmented Reality Project

2002 ◽  
Vol 11 (1) ◽  
pp. 33-54 ◽  
Author(s):  
Dieter Schmalstieg ◽  
Anton Fuhrmann ◽  
Gerd Hesina ◽  
Zsolt Szalavári ◽  
L. Miguel Encarnação ◽  
...  
Keyword(s):  
User Interface ◽  
Augmented Reality ◽  
Work Environment ◽  
Three Dimensional ◽  
Daily Routine ◽  
Interface Management ◽  
Personal Interaction ◽  
Starting Point ◽  
Collaborative Augmented Reality ◽  
Interface Metaphor

Our starting point for developing the Studierstube system was the belief that augmented reality, the less obtrusive cousin of virtual reality, has a better chance of becoming a viable user interface for applications requiring manipulation of complex three-dimensional information as a daily routine. In essence, we are searching for a 3-D user interface metaphor as powerful as the desktop metaphor for 2-D. At the heart of the Studierstube system, collaborative augmented reality is used to embed computer-generated images into the real work environment. In the first part of this paper, we review the user interface of the initial Studierstube system, in particular the implementation of collaborative augmented reality, and the Personal Interaction Panel, a two-handed interface for interaction with the system. In the second part, an extended Studierstube system based on a heterogeneous distributed architecture is presented. This system allows the user to combine multiple approaches— augmented reality, projection displays, and ubiquitous computing—to the interface as needed. The environment is controlled by the Personal Interaction Panel, a twohanded, pen-and-pad interface that has versatile uses for interacting with the virtual environment. Studierstube also borrows elements from the desktop, such as multitasking and multi-windowing. The resulting software architecture is a user interface management system for complex augmented reality applications. The presentation is complemented by selected application examples.

scholarly journals MolAR: Bringing Chemical Structures to Life with Augmented Reality and Machine Learning

2021 ◽  
Author(s):  
Sukolsak Sakshuwong ◽  
Hayley Weir ◽  
Umberto Raucci ◽  
Todd J. Martínez
Keyword(s):  
Machine Learning ◽  
Augmented Reality ◽  
3D Structure ◽  
Three Dimensional ◽  
Real Life ◽  
Data Bank ◽  
Molecular Structures ◽  
Chemical Structures ◽  
Food And Drink ◽  
Research And Education

Visualizing three-dimensional molecular structures is crucial to understanding and predicting their chemical behavior. Existing visualization software, however, can be cumbersome to use, and, for many, hand-drawn skeletal structures remain the preferred method of chemical communication. Although convenient, the static, two-dimensional nature of these drawings can be misleading in conveying the molecule’s 3D structure, not to mention that dynamic movement is completely disregarded. Here, we combine machine learning and augmented reality (AR) to develop MolAR, an immersive mobile application for visualizing molecules in real-world scenes. The application uses deep learning to recognize hand-drawn hydrocarbons structures which it converts into interactive 3D molecules in AR. Users can also “hunt” for chemicals in food and drink to uncover molecules in their real-life environment. A variety of interesting molecules are pre-loaded into the application, and users can visualize molecules in PubChem by providing their name or SMILES string and proteins in the Protein Data Bank by providing their PDB ID. MolAR was designed to be used in both research and education settings, providing an almost barrierless platform to visualize and interact with 3D molecular structures in a uniquely immersive way.

scholarly journals Augmented reality in scientific visualization and communications: a new dawn of looking at antibody interactions

2020 ◽  
Vol 3 (3) ◽  
pp. 221-226
Author(s):  
Kwok-Fong Chan ◽  
Jun-Jie Poh ◽  
Wei-Ling Wu ◽  
Samuel Ken-En Gan
Keyword(s):  
Augmented Reality ◽  
Medical Training ◽  
3D Visualization ◽  
Three Dimensional ◽  
Molecular Structures ◽  
Stereo Images ◽  
Molecular Visualization ◽  
Holistic View ◽  
Visualization Software ◽  
Antibody Interactions

ABSTRACT The use of augmented reality (AR) in providing three-dimensional (3D) visual support and image depth have been applied in education, tourism, historical studies, and medical training. In research and development, there has been a slow but growing use of AR tools in chemical and drug discovery, but little has been implemented for whole 3D antibody structures (IgE, IgM, IgA, IgG, and IgD) and in communicating their interactions with the antigens or receptors in publications. Given that antibody interactions can vary significantly between different monoclonal antibodies, a convenient and easy to use 3D visualization can convey structural mechanisms clearer to readers, especially in how residues may interact with one another. While this was previously constrained to the use of stereo images on printed material or molecular visualization software on the computer, the revolution of smartphone and phablets now allows visualization of whole molecular structures on-the-go, allowing rotations, zooming in and out, and even animations without complex devices or the training of visual prowess. While not yet as versatile as molecular visualization software on the computer, such technology is an improvement from stereo-images and bridges the gap with molecular visualization tools. In this report, we discuss the use of AR and how they can be employed in the holistic view of antibodies and the future of the technology for better scientific communication.

IMPLEMENTASI AR DENGAN METODE MARKER SEBAGAI KATALOG PADA TOKO MEBEL BERBASIS WEB-AR.pdf

2019 ◽  
Vol 3 (1) ◽  
pp. 1-9
Author(s):  
Aulia Sari Prihatini ◽  
Mahrizal Masri ◽  
Mhd. Zulfansyuri Siambaton
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Real World ◽  
Three Dimensional ◽  
Two Dimensional ◽  
Web Browser ◽  
Web Based ◽  
The Real ◽  
Real Objects

Reality Increasing or often also called AR (Augmented Reality) in English, is a technology that can add two-dimensional or three-dimensional illusions of objects together into a 3D into the real world then project illusion objects into real time. Unlike the illusion of reality where in the real world is completely replaced, reality only adds to or completes reality. Augmented Reality unites real objects and illusions into real circles, works interactively in real time and found integration between objects in 3D and good integration requires effective investigation. Web AR provides Web-based access using Augmented Reality through a web browser using a combination of technologies including WebRTC, WebGL, WebVR, and Modern APLs sensors. Catalogs are publicity tools used by companies as a way to promote their products and services. Examples of companies that use catalogs are Furniture stores that promote products. Here it will be visualized into 3D until it looks more clear and attractive to consumers. So, based on the description above, the author takes the title "Implementation of Augmented Reality with Marker Method as Media Catalog in AR-Based Furniture Stores. Keywords: Augmented Reality, WEB AR, catalog

scholarly journals Interacting with Three-Dimensional Molecular Structures Using an Augmented Reality Mobile App

2020 ◽  
Vol 97 (10) ◽  
pp. 3877-3881
Author(s):  
Jonah Kailer Aw ◽  
Kevin Christopher Boellaard ◽  
Teck Kiang Tan ◽  
John Yap ◽  
Yi Ping Loh ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Mobile App ◽  
Molecular Structures

Explorations in the Use of Augmented Reality for Geographic Visualization

2002 ◽  
Vol 11 (2) ◽  
pp. 119-133 ◽  
Author(s):  
Nicholas R. Hedley ◽  
Mark Billinghurst ◽  
Lori Postner ◽  
Richard May ◽  
Hirokazu Kato
Keyword(s):  
Computer Vision ◽  
Virtual Reality ◽  
User Interface ◽  
Augmented Reality ◽  
User Interfaces ◽  
Three Dimensional ◽  
Data Representation ◽  
Immersive Virtual Reality ◽  
Geographic Visualization ◽  
Terrain Models

In this paper, we describe two explorations in the use of hybrid user interfaces for collaborative geographic data visualization. Our first interface combines three technologies: augmented reality (AR), immersive virtual reality (VR), and computer vision-based hand and object tracking. Wearing a lightweight display with an attached camera, users can look at a real map and see three-dimensional virtual terrain models overlaid on the map. From this AR interface, they can fly in and experience the model immersively, or use free hand gestures or physical markers to change the data representation. Building on this work, our second interface explores alternative interface techniques, including a zoomable user interface, paddle interactions, and pen annotations. We describe the system hardware and software and the implications for GIS and spatial science applications.

scholarly journals Molecular Modeling with Augmented Reality (MMAR)

2018 ◽  
Vol 6 (10) ◽  
pp. 187-205
Author(s):  
Alex Eder da Rocha Mazzuco ◽  
Aliane Loureiro Krassmann ◽  
Denis da Silva Garcia ◽  
Giliane Bernardi
Keyword(s):  
Molecular Modeling ◽  
Public School ◽  
Augmented Reality ◽  
Basic Education ◽  
Three Dimensional ◽  
Molecular Structures ◽  
Biomolecular Systems ◽  
Object Of Study ◽  
Education In Brazil ◽  
Complex Subject

Learning about molecular structures often becomes abstruse, due to its complex compositions, being aggravated by the restricted interactivity provided by the software commonly used. This difficulty can also be attached to the fact that most of the students do not present the necessary knowledge to work with biomolecular systems, affecting also the motivation in the object of study. In this context, the objective of this work is to analyze the influences related to interactivity, usability and motivation, provided by a web system called MMAR (Molecular Modeling with Augmented Reality), designed to support the learning of three-dimensional (3D) molecular structures. The system was applied to twenty-five students in the Chemistry discipline, from a technical course in a public school from basic education in Brazil. The results show that it was possible to assist students in the gain of knowledge, while simultaneously allowing them to enjoy themselves, providing unconventional learning, by increasing attractiveness, curiosity, attention, enthusiasm and relevance of such a complex subject in Chemistry.

Visualizing 3D Molecular Structures Using an Augmented Reality App

2019 ◽  
Author(s):  
Kristina Eriksen ◽  
Bjarne Nielsen ◽  
Michael Pittelkow
Keyword(s):  
Augmented Reality ◽  
Small Molecules ◽  
Computer Modelling ◽  
Simple Procedure ◽  
3D Structure ◽  
Molecular Structures ◽  
Free Software ◽  
Programming Skills ◽  
2D Space ◽  
Made In

<p>We present a simple procedure to make an augmented reality app to visualize any 3D chemical model. The molecular structure may be based on data from crystallographic data or from computer modelling. This guide is made in such a way, that no programming skills are needed and the procedure uses free software and is a way to visualize 3D structures that are normally difficult to comprehend in the 2D space of paper. The process can be applied to make 3D representation of any 2D object, and we envisage the app to be useful when visualizing simple stereochemical problems, when presenting a complex 3D structure on a poster presentation or even in audio-visual presentations. The method works for all molecules including small molecules, supramolecular structures, MOFs and biomacromolecules.</p>

Virtual and augmented reality in anatomy education: Need for comparison with other three-dimensional visualization methods

Morphologie ◽  
2021 ◽  
Author(s):  
G.P. Skandalakis ◽  
D. Chytas ◽  
G. Paraskevas ◽  
G. Noussios ◽  
M. Salmas ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Anatomy Education ◽  
Virtual And Augmented Reality
Sign in / Sign up

Export Citation Format

Share Document