scholarly journals Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology

2018 ◽  
Vol 142 (5) ◽  
pp. 638-644 ◽  
Author(s):  
Matthew G. Hanna ◽  
Ishtiaque Ahmed ◽  
Jeffrey Nine ◽  
Shyam Prajapati ◽  
Liron Pantanowitz
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Mixed Reality ◽  
Digital Pathology ◽  
Remote Supervision ◽  
Augmented Reality Technology ◽  
Microsoft Hololens ◽  
Microscopic Pathology ◽  
Areas Of Interest ◽  
Whole Slide Images

Context Augmented reality (AR) devices such as the Microsoft HoloLens have not been well used in the medical field. Objective To test the HoloLens for clinical and nonclinical applications in pathology. Design A Microsoft HoloLens was tested for virtual annotation during autopsy, viewing 3D gross and microscopic pathology specimens, navigating whole slide images, telepathology, as well as real-time pathology-radiology correlation. Results Pathology residents performing an autopsy wearing the HoloLens were remotely instructed with real-time diagrams, annotations, and voice instruction. 3D-scanned gross pathology specimens could be viewed as holograms and easily manipulated. Telepathology was supported during gross examination and at the time of intraoperative consultation, allowing users to remotely access a pathologist for guidance and to virtually annotate areas of interest on specimens in real-time. The HoloLens permitted radiographs to be coregistered on gross specimens and thereby enhanced locating important pathologic findings. The HoloLens also allowed easy viewing and navigation of whole slide images, using an AR workstation, including multiple coregistered tissue sections facilitating volumetric pathology evaluation. Conclusions The HoloLens is a novel AR tool with multiple clinical and nonclinical applications in pathology. The device was comfortable to wear, easy to use, provided sufficient computing power, and supported high-resolution imaging. It was useful for autopsy, gross and microscopic examination, and ideally suited for digital pathology. Unique applications include remote supervision and annotation, 3D image viewing and manipulation, telepathology in a mixed-reality environment, and real-time pathology-radiology correlation.

Augmented Reality Berbasis Android Sebagai Media Pembelajaran Sistem Tata Surya

2021 ◽  
Vol 2 (1) ◽  
pp. 53-59
Author(s):  
Yulia Fatma ◽  
Armen Salim ◽  
Regiolina Hayami
Keyword(s):  
Augmented Reality ◽  
Solar System ◽  
Real Time ◽  
Real World ◽  
Virtual World ◽  
The Real ◽  
Virtual Objects ◽  
Augmented Reality Technology ◽  
The Revolution

Along with the development, the application can be used as a medium for learning. Augmented Reality is a technology that combines two-dimensional’s virtual objects and three-dimensional’s virtual objects into a real three-dimensional’s  then projecting the virtual objects in real time and simultaneously. The introduction of Solar System’s material, students are invited to get to know the planets which are directly encourage students to imagine circumtances in the Solar System. Explenational of planets form and how the planets make the revolution and rotation in books are considered less material’s explanation because its only display objects in 2D. In addition, students can not practice directly in preparing the layout of the planets in the Solar System. By applying Augmented Reality Technology, information’s learning delivery can be clarified, because in these applications are combined the real world and the virtual world. Not only display the material, the application also display images of planets in 3D animation’s objects with audio.

scholarly journals Впровадження технологій доповненої реальності у навчальному процесі з конструювання авіаційної техніки

2021 ◽  
pp. 110-118
Author(s):  
Олександр Володимирович Каратанов ◽  
Андрій Миколайович Биков ◽  
Марія Вадимівна Сергієнко ◽  
Дмитро Михайлович Мірошниченко
Keyword(s):  
Augmented Reality ◽  
Mixed Reality ◽  
Educational Process ◽  
Modern Education ◽  
Augmented Reality Application ◽  
The World ◽  
Augmented Reality Technology ◽  
Increase Productivity ◽  
Virtual And Augmented Reality ◽  
The Cost

This study examines augmented reality, which imposes on the world around us virtual objects, characters, filters, or other effects through a special camera. Currently, augmented reality is considered potential for pedagogical programs and it is beginning to gain momentum and be actively used. The use of augmented reality technology opens up new opportunities that increase productivity and efficiency in various industries, improve communication and knowledge transfer and make distance learning more comfortable and realistic. However, the factor of reducing the cost of production or the educational process due to the introduction of augmented reality is not yet fully disclosed and requires a detailed analysis, part of which is conducted in this paper. The existing types of augmented, virtual and mixed reality technologies were analyzed, their comparison was made, the current place in the market was determined, as well as their influence and role in modern education. The paper presents examples of the use of augmented reality technology in various fields, including in production, which demonstrates a significant increase in efficiency and confirms the relevance. An overview of the premises and laboratories, which now use virtual and augmented reality technologies for the educational process. The article also describes the shortcomings of the educational process, which can be corrected by introducing augmented reality technology. The economic benefit of using augmented reality in the educational process on a real example was calculated, due to which the expediency of this implementation was proved. Elements of the educational process are considered, the replacement of which with augmented reality will make education cheaper, and this means more accessible. An example of markers used for an augmented reality application in the field of aircraft construction is given. The tendency of the application of augmented reality and use in the educational process for the next years is analyzed, the branches in which it can be applied are considered and the expediency of its use is confirmed.

scholarly journals Real Time Shadow Mapping for Augmented Reality Photorealistic Rendering

2019 ◽  
Vol 9 (11) ◽  
pp. 2225 ◽  
Author(s):  
Francesco Osti ◽  
Gian Maria Santi ◽  
Gianni Caligiana
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Real Life ◽  
Shadow Mapping ◽  
Photorealistic Rendering ◽  
Real Time Image ◽  
Image Capturing ◽  
Microsoft Hololens ◽  
The Right ◽  
Time Image

In this paper, we present a solution for the photorealistic ambient light render of holograms into dynamic real scenes, in augmented reality applications. Based on Microsoft HoloLens, we achieved this result with an Image Base Lighting (IBL) approach. The real-time image capturing that has been designed is able to automatically locate and position directional lights providing the right illumination to the holograms. We also implemented a negative “shadow drawing” shader that contributes to the final photorealistic and immersive effect of holograms in real life. The main focus of this research was to achieve a superior photorealism through the combination of real-time lights placement and negative “shadow drawing” shader. The solution was evaluated in various Augmented Reality case studies, from classical ones (using Vuforia Toolkit) to innovative applications (using HoloLens).

scholarly journals 28 Shifting to Virtual MDT in the COVID-19 Era and Beyond

2021 ◽  
Vol 108 (Supplement_2) ◽  
Author(s):  
D Vijayan ◽  
K Malik ◽  
K Natarajan ◽  
J Berland ◽  
D Morton ◽  
...  
Keyword(s):  
Real Time ◽  
Large Scale ◽  
Mixed Reality ◽  
Clinician Training ◽  
Smart Glasses ◽  
Digital Network ◽  
Image Characteristics ◽  
Microsoft Hololens ◽  
2D And 3D ◽  
Virtual Ecosystem

Abstract Aim The COVID19 pandemic has accelerated the need for staff to work remotely. Our aim was to demonstrate how a next-generation digital platform could be used to create a virtual MDT ecosystem in order to manipulate holographic 2D and 3D images in real-time. Method This study involved setting up a mock virtual MDT using de-identified DICOM files from a patient who had been treated for colorectal cancer and then subsequently found to have a liver metastasis. The image file was segmented and converted into a 2D and 3D format for visualisation within Microsoft HoloLens 2 ® (smart glasses) using Holocare Solutions ® (Mixed Reality software). Results A seamless cross-border pipeline was developed that involved "clinician" training, DICOM segmentation and virtual connection. We successfully performed a virtual MDT with participants able to visualise and manipulate a virtual 3D organ in real-time. The digital network remotely connected sites in England and Norway. The streaming quality was stable and HIPAA compliant. Each participant could observe others as "avatars" interacting with images within the virtual ecosystem allowing image characteristics to be highlighted. Conclusions We successfully conducted a virtual MDT using novel hardware and software. Our intention is to conduct a large-scale study to assess the platform's effectiveness in “Real World" MDTs.

scholarly journals Designing Ray-Pointing using Real hand and Touch-based in Handheld Augmented Reality for Object Selection

2021 ◽  
Vol 11 (2) ◽  
pp. 95-102
Author(s):  
Nur Ameerah Abdul Halim ◽  
Ajune Wanis Ismail
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Mixed Reality ◽  
Touch Screen ◽  
Conventional Technique ◽  
Handheld Devices ◽  
Information Representation ◽  
3D Object ◽  
Object Selection ◽  
Real Hand

Augmented Reality (AR) have been widely explored worldwide for their potential as a technology that enhances information representation. As technology progresses, smartphones (handheld devices) now have sophisticated processors and cameras for capturing static photographs and video, as well as a variety of sensors for tracking the user's position, orientation, and motion. Hence, this paper would discuss a finger-ray pointing technique in real-time for interaction in handheld AR and comparing the technique with the conventional technique in handheld, touch-screen interaction. The aim of this paper is to explore the ray pointing interaction in handheld AR for 3D object selection. Previous works in handheld AR and also covers Mixed Reality (MR) have been recapped.

scholarly journals Development of a Real-Time Detection System for Augmented Reality Driving

2015 ◽  
Vol 2015 ◽  
pp. 1-5 ◽  
Author(s):  
Kuei-Shu Hsu ◽  
Chia-Sui Wang ◽  
Jinn-Feng Jiang ◽  
Hung-Yuan Wei
Keyword(s):  
Virtual Reality ◽  
Augmented Reality ◽  
Real Time ◽  
Detection System ◽  
Real Life ◽  
Error Rates ◽  
Interactive Effects ◽  
Gaming Technology ◽  
Augmented Reality Technology ◽  
Real Scenario

Augmented reality technology is applied so that driving tests may be performed in various environments using a virtual reality scenario with the ultimate goal of improving visual and interactive effects of simulated drivers. Environmental conditions simulating a real scenario are created using an augmented reality structure, which guarantees the test taker’s security since they are not subject to real-life elements and dangers. Furthermore, the accuracy of tests conducted through virtual reality is not influenced by either environmental or human factors. Driver posture is captured in real time using Kinect’s depth perception function and then applied to driving simulation effects that are emulated by Unity3D’s gaming technology. Subsequently, different driving models may be collected through different drivers. In this research, nearly true and realistic street environments are simulated to evaluate driver behavior. A variety of different visual effects are easily available to effectively reduce error rates, thereby significantly improving test security as well as the reliability and reality of this project. Different situation designs are simulated and evaluated to increase development efficiency and build more security verification test platforms using such technology in conjunction with driving tests, vehicle fittings, environmental factors, and so forth.

The Potential of Augmented Reality Technology for Pre-Construction

2013 ◽  
Vol 405-408 ◽  
pp. 3419-3422 ◽  
Author(s):  
Che Mohd Lukman Khalid ◽  
Zainai Mohamed ◽  
Mohamad Syazli Fathi ◽  
Mohd Zulakhmar Zakiyudin ◽  
Norshakila Rawai ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Planning Process ◽  
Construction Project ◽  
Digital Information ◽  
Monitoring And Control ◽  
Construction Stage ◽  
Planning Stage ◽  
Augmented Reality Technology ◽  
Construction Services

Construction project management covering various aspects such as planning, coordinating, directing, scheduling, monitoring and control. Pre-construction services are used in planning a construction project before the actual construction begins. However, various problems happened at the pre-construction planning stage. This paper present an overview of the major problems in pre-construction stage and look at the potential of using augmented reality technology to overcome those problems. It was found that, at the pre-construction stage, good planning can not be done by the project teams especially to engineers and contractors due to the lack of supporting data, particularly when it involves information relating to underground utilities such as telecommunications, gas, electricity, water and sewerage. There are several approaches that can been undertaken in pre-construction services, especially in making an informed decision. The potential technology is using Augmented Reality (AR)-based approach in pre-construction service. Augmented reality is the integration of digital information with the users environment in real-time. It was one of the tool that support the concept of cyber-physical systems (CPS). CPS is the integration systems between computational network and physical processes. Currently, there are many fields utilised the application of AR such as medical, militiry, vehicles, gaming and navigation. This paper presents the applications of an AR-based approach to medical and gaming industry and explore the potential of using AR in pre-construction. The finding shows that the AR is a potential decision support tool that will speed up the planning process of the project team in the pre-construction phase in real-time.

scholarly journals USING AUGMENTED REALITY AND HOLOGRAPHIC TECHNOLOGY IN AN INTRODUCTORY COURSE ON DATA STRUCTURES AND ALGORITHMS

2018 ◽  
Author(s):  
Igor Ivkovic ◽  
Sage Franch
Keyword(s):  
Augmented Reality ◽  
Data Structures ◽  
Mixed Reality ◽  
Three Dimensional ◽  
Physical Space ◽  
First Year ◽  
A Algorithm ◽  
Three Dimensional Objects ◽  
Data Structures And Algorithms ◽  
Microsoft Hololens

Abstract – Augmented reality (AR) technology facilitates augmentation of current views with digital artifacts, such as information, three-dimensional objects, audio, and video. Mixed reality (MR) represents an enhanced version of AR, where advanced spatial mapping is used to anchor digital artifacts in physical space. Using MR technology, digital artifacts can be more closely integrated into the natural environment, thereby transcending physical limitations and creating enhanced blended learning environments. In this paper, we propose an approach for integration of MR technology into engineering education. Specifically, we propose to integrate Microsoft HoloLens into a first-year course on data structures and algorithms to improve student engagement and learning outcomes. In the pilot study, students were assigned to implement A* algorithm and then given a chance to visualize their implementation using Microsoft HoloLens. The feedback provided by students indicated increased engagement and interest in graph-based path-finding algorithms as well as MR technology.

Sign in / Sign up

Export Citation Format

Share Document