scholarly journals DIVA: natural navigation inside 3D images using virtual reality

2020 ◽  
Author(s):  
Mohamed El Beheiry ◽  
Charlotte Godard ◽  
Clément Caporal ◽  
Valentin Marcon ◽  
Cécilia Ostertag ◽  
...  

AbstractAs three-dimensional microscopy becomes commonplace in biological re-search, there is an increasing need for researchers to be able to view experimental image stacks in a natural three-dimensional viewing context. Through stereoscopy and motion tracking, commercial virtual reality headsets provide a solution to this important visualization challenge by allowing researchers to view volumetric objects in an entirely intuitive fashion. With this motivation, we present DIVA, a user-friendly software tool that automatically creates detailed three-dimensional reconstructions of raw experimental image stacks that are integrated in virtual reality. In DIVA’s immersive virtual environment, users can view, manipulate and perform volumetric measurements on their microscopy images as they would to real physical objects. In contrast to similar solutions, our software provides high-quality volume rendering with native TIFF file compatibility. We benchmark the software with diverse image types including those generated by confocal, light-sheet and electron microscopy. DIVA is available at https://diva.pasteur.fr and will be regularly updated.

Neurosurgery ◽  
2019 ◽  
Vol 85 (2) ◽  
pp. E343-E349 ◽  
Author(s):  
David Bairamian ◽  
Shinuo Liu ◽  
Behzad Eftekhar

Abstract BACKGROUND Three-dimensional (3D) visualization of the neurovascular structures has helped preoperative surgical planning. 3D printed models and virtual reality (VR) devices are 2 options to improve 3D stereovision and stereoscopic depth perception of cerebrovascular anatomy for aneurysm surgery. OBJECTIVE To investigate and compare the practicality and potential of 3D printed and VR models in a neurosurgical education context. METHODS The VR angiogram was introduced through the development and testing of a VR smartphone app. Ten neurosurgical trainees from Australia and New Zealand participated in a 2-part interactive exercise using 3 3D printed and VR angiogram models followed by a questionnaire about their experience. In a separate exercise to investigate the learning curve effect on VR angiogram application, a qualified neurosurgeon was subjected to 15 exercises involving manipulating VR angiograms models. RESULTS VR angiogram outperformed 3D printed model in terms of resolution. It had statistically significant advantage in ability to zoom, resolution, ease of manipulation, model durability, and educational potential. VR angiogram had a higher questionnaire total score than 3D models. The 3D printed models had a statistically significant advantage in depth perception and ease of manipulation. The results were independent of trainee year level, sequence of the tests, or anatomy. CONCLUSION In selected cases with challenging cerebrovascular anatomy where stereoscopic depth perception is helpful, VR angiogram should be considered as a viable alternative to the 3D printed models for neurosurgical training and preoperative planning. An immersive virtual environment offers excellent resolution and ability to zoom, potentiating it as an untapped educational tool.


Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Gaixin Li

Virtual reality technology is an emerging technology developed on the basis of information technology. It is widely used in military, medical, mining, entertainment, and other fields. Therefore, many countries have been vigorously conducting research in recent years. As one of the important components of the virtual reality system, the three-dimensional human motion tracking system is of great significance to the research of practical virtual reality systems. It introduces the measurement principle of the spatial three-dimensional coordinate dynamic measurement device and discusses in detail the ultrasonic transmission, reception, amplification, filtering, comparison, shaping circuit, and single-chip interface circuit. This paper introduces the working principle and characteristics of the virtual experiment system and gives the structure diagram, hardware schematic diagram, and software flow diagram of the system. We mainly study the method of tracking human motion by measuring the three-dimensional coordinates of the space point, which lays a good foundation for the research of the actual three-dimensional motion tracking system. At the same time, the three-dimensional human body modeling is discussed, and the interactive movement policy of the human arm is briefly introduced. It has a certain effect on the actual virtual reality human-computer interaction system.


2000 ◽  
Vol 122 (11) ◽  
pp. 98-101 ◽  
Author(s):  
Jean Thilmany

This article discusses that virtual reality can be expected to be the next big thing in product design and prototype, especially for products too small to be seen with the naked eye. Virtual reality will be new technology for engineering, according to many companies. Virtual reality applications could become commonplace as soon as five years down the road. By using virtual reality systems, designers touch a stylus or pen to manipulate a three-dimensional image. They get their hands on tiny sensing devices, the way you would tinker under the hood of a car. They can still determine, through the system’s visualization and animation capabilities, how the MEMS devices will function in their tiny world. Intersense of Burlington, MA, provides the motion-tracking sensors that literally track a user’s eyes and hand motions, to ensure the object they feel and manipulate in three dimensions matches the movements of their hands and eyes. It is this key piece of technology that allows users to interact in a three-dimensional environment the same way they move in their real environments.


1996 ◽  
Vol 2 (3) ◽  
pp. 1-14
Author(s):  
Jing-Jing Fang ◽  
Douglas E.R. Clark ◽  
John E. L. Simmons

The authors built a pseudo-immersive three-dimensional computer generated virtual environment (VE) as a shell for research in detailed collision detection. The purpose of the virtual world construction described in this paper is to handle engineering applications such as the mechanical assembly and disassembly of complex systems. A virtual space ball is attached to the VE in order to control the motion of virtual objects in that environment. This software interface simulates a real three-dimensional space ball device. The contribution of the pseudo-immersive system removes the absolute necessity for expensive Virtual Reality equipment and software for research work on virtual reality.


Author(s):  
Maxim Mironenko ◽  
Viktor Chertopolokhov ◽  
Margarita Belousova

The article summarizes the results of a two-year study of the issues related to the virtual reality and augmented reality technologies use to virtually reconstruct Moscow Bely Gorod in the 16th-18th centuries. The authors describe mathematical methods, software and hardware which grant access to the historical reconstruction of historical urban landscapes. An important feature of the reconstruction is the source verification module which was used to construct three-dimensional models of the landscape, buildings and the general scenery. The article names the basic principles which the verification module and its interface are based on and considers some optimum problems solved when constructing the interface. The project uses a hybrid motion tracking system as a combination of optical and inertial data. The archival sources used in the reconstruction process are presented in the virtual environment by means of a 3D graphical user interface for the virtual reality. The information displayed is generated from the database of historical sources which includes information about the urban development and individual buildings of Bely Gorod, their parts, location, purpose, owners and construction date. The database contains both text and graphic historical sources. The results obtained also include new algorithms, software and hardware systems as well as the experiment results. 


Author(s):  
Raimo Hartmann ◽  
Hannah Jeckel ◽  
Eric Jelli ◽  
Praveen K. Singh ◽  
Sanika Vaidya ◽  
...  

AbstractBiofilms are microbial communities that represent a highly abundant form of microbial life on Earth. Inside biofilms, phenotypic and genotypic variations occur in three-dimensional space and time; microscopy and quantitative image analysis are therefore crucial for elucidating their functions. Here, we present BiofilmQ—a comprehensive image cytometry software tool for the automated and high-throughput quantification, analysis and visualization of numerous biofilm-internal and whole-biofilm properties in three-dimensional space and time.


2020 ◽  
Vol 1 (1) ◽  
pp. 62-70
Author(s):  
Amir H Sadeghi ◽  
Wouter Bakhuis ◽  
Frank Van Schaagen ◽  
Frans B S Oei ◽  
Jos A Bekkers ◽  
...  

Abstract Aims Increased complexity in cardiac surgery over the last decades necessitates more precise preoperative planning to minimize operating time, to limit the risk of complications during surgery and to aim for the best possible patient outcome. Novel, more realistic, and more immersive techniques, such as three-dimensional (3D) virtual reality (VR) could potentially contribute to the preoperative planning phase. This study shows our initial experience on the implementation of immersive VR technology as a complementary research-based imaging tool for preoperative planning in cardiothoracic surgery. In addition, essentials to set up and implement a VR platform are described. Methods Six patients who underwent cardiac surgery at the Erasmus Medical Center, Rotterdam, The Netherlands, between March 2020 and August 2020, were included, based on request by the surgeon and availability of computed tomography images. After 3D VR rendering and 3D segmentation of specific structures, the reconstruction was analysed via a head mount display. All participating surgeons (n = 5) filled out a questionnaire to evaluate the use of VR as preoperative planning tool for surgery. Conclusion Our study demonstrates that immersive 3D VR visualization of anatomy might be beneficial as a supplementary preoperative planning tool for cardiothoracic surgery, and further research on this topic may be considered to implement this innovative tool in daily clinical practice. Lay summary Over the past decades, surgery on the heart and vessels is becoming more and more complex, necessitating more precise and accurate preoperative planning. Nowadays, operative planning is feasible on flat, two-dimensional computer screens, however, requiring a lot of spatial and three-dimensional (3D) thinking of the surgeon. Since immersive 3D virtual reality (VR) is an upcoming imaging technique with promising results in other fields of surgery, we aimed in this study to explore the additional value of this technique in heart surgery. Our surgeons planned six different heart operations by visualizing computed tomography scans with a dedicated VR headset, enabling them to visualize the patient’s anatomy in an immersive and 3D environment. The outcomes of this preliminary study are positive, with a much more reality-like simulation for the surgeon. In such, VR could potentially be beneficial as a preoperative planning tool for complex heart surgery.


Sign in / Sign up

Export Citation Format

Share Document