Integrating 3D Reconstruction and Virtual Reality: A New Approach for Immersive Teleoperation

Abstract This paper presents a new approach to using virtual reality (VR) to design spherical mechanisms. VR provides a three dimensional design space where a designer can input design positions using a combination of hand gestures and motions and view the resultant mechanism in stereo using natural head movement to change the viewpoint. Because of the three dimensional nature of the design and verification of spherical mechanisms, VR is examined as a new design interface in this research. In addition to providing a VR environment for design, the research presented in this paper has focused on developing a “design in context” approach to spherical mechanism design. Previous design methods have involved placing coordinate frames along the surface of a constraint sphere. The new “design in context” approach allows a designer to freely place geometric models of movable objects inside an environment consisting of fixed objects. The fixed objects could either act as a base for a mechanism or be potential sources of interference with the motion of the mechanism. This approach allows a designer to perform kinematic synthesis of a mechanism while giving consideration to the interaction of that mechanism with its application environment.

Download Full-text

Special Issue on “Augmented Reality, Virtual Reality & Semantic 3D Reconstruction”

Applied Sciences ◽

10.3390/app11188590 ◽

2021 ◽

Vol 11 (18) ◽

pp. 8590

Author(s):

Zhihan Lv ◽

Jing-Yan Wang ◽

Neeraj Kumar ◽

Jaime Lloret

Keyword(s):

Virtual Reality ◽

Augmented Reality ◽

3D Reconstruction ◽

Paradigm Shift ◽

Special Issue ◽

Key Technology ◽

Viable Solution ◽

The Way ◽

Critical Needs

Augmented Reality is a key technology that will facilitate a major paradigm shift in the way users interact with data and has only just recently been recognized as a viable solution for solving many critical needs [...]

Download Full-text

A New Approach in Metal Artifact Reduction for CT 3D Reconstruction

Lecture Notes in Computer Science - Bioinspired Applications in Artificial and Natural Computation ◽

10.1007/978-3-642-02267-8_2 ◽

2009 ◽

pp. 11-19 ◽

Cited By ~ 4

Author(s):

Valery Naranjo ◽

Roberto Llorens ◽

Patricia Paniagua ◽

Mariano Alcañiz ◽

Salvador Albalat

Keyword(s):

3D Reconstruction ◽

Artifact Reduction ◽

Metal Artifact ◽

Metal Artifact Reduction ◽

New Approach

Download Full-text

A New Approach to Multiplayer Virtual Reality Games

Proceedings of the 2019 4th International Conference on Mathematics and Artificial Intelligence - ICMAI 2019 ◽

10.1145/3325730.3325749 ◽

2019 ◽

Author(s):

Alice J. Lin ◽

Charles B. Chen ◽

Fuhua Frank Cheng

Keyword(s):

Virtual Reality ◽

New Approach

Download Full-text

Augmented and Virtual Reality for Underground Facilities Management

Journal of Computing and Information Science in Engineering ◽

10.1115/1.4040460 ◽

2018 ◽

Vol 18 (4) ◽

Cited By ~ 4

Author(s):

Gregorio Soria ◽

L. M. Ortega Alvarado ◽

Francisco R. Feito

Keyword(s):

Virtual Reality ◽

Life Cycle ◽

Data Model ◽

Three Dimensional ◽

Real Data ◽

Life Cycle Management ◽

Facilities Management ◽

New Approach ◽

3D Data ◽

The City

Augmented reality (AR) has experienced a breakthrough in many areas of application thanks to cheaper hardware and a strong industry commitment. In the field of management of urban facilities, this technology allows virtual access and interaction with hidden underground elements. This paper presents a new approach to enable AR in mobile devices such as Google Tango, which has specific capabilities to be used outdoors. The first objective is to provide full functionality in the life-cycle management of subsoil infrastructures through this technology. This implies not only visualization, interaction, and free navigation, but also editing, deleting, and inserting elements ubiquitously. For this, a topological data model for three-dimensional (3D) data has been designed. Another important contribution of the paper is getting exact location and orientation performed in only a few minutes, using no additional markers or hardware. This accuracy in the initial positioning, together with the device sensing, avoids the usual errors during the navigation process in AR. Similar functionality has also been implemented in a nonubiquitous way to be supported by any other device through virtual reality (VR). The tests have been performed using real data of the city of Jaén (Spain).

Download Full-text

Nextmed: Automatic Imaging Segmentation, 3D Reconstruction, and 3D Model Visualization Platform Using Augmented and Virtual Reality

Sensors ◽

10.3390/s20102962 ◽

2020 ◽

Vol 20 (10) ◽

pp. 2962 ◽

Cited By ~ 7

Author(s):

Santiago González Izard ◽

Ramiro Sánchez Torres ◽

Óscar Alonso Plaza ◽

Juan Antonio Juanes Méndez ◽

Francisco José García-Peñalvo

Keyword(s):

Virtual Reality ◽

3D Reconstruction ◽

Medical Image ◽

New Technologies ◽

Medical Images ◽

3D Visualization ◽

Automatic Segmentation ◽

Individual Case ◽

Medical Professionals ◽

Anatomical Structures

The visualization of medical images with advanced techniques, such as augmented reality and virtual reality, represent a breakthrough for medical professionals. In contrast to more traditional visualization tools lacking 3D capabilities, these systems use the three available dimensions. To visualize medical images in 3D, the anatomical areas of interest must be segmented. Currently, manual segmentation, which is the most commonly used technique, and semi-automatic approaches can be time consuming because a doctor is required, making segmentation for each individual case unfeasible. Using new technologies, such as computer vision and artificial intelligence for segmentation algorithms and augmented and virtual reality for visualization techniques implementation, we designed a complete platform to solve this problem and allow medical professionals to work more frequently with anatomical 3D models obtained from medical imaging. As a result, the Nextmed project, due to the different implemented software applications, permits the importation of digital imaging and communication on medicine (dicom) images on a secure cloud platform and the automatic segmentation of certain anatomical structures with new algorithms that improve upon the current research results. A 3D mesh of the segmented structure is then automatically generated that can be printed in 3D or visualized using both augmented and virtual reality, with the designed software systems. The Nextmed project is unique, as it covers the whole process from uploading dicom images to automatic segmentation, 3D reconstruction, 3D visualization, and manipulation using augmented and virtual reality. There are many researches about application of augmented and virtual reality for medical image 3D visualization; however, they are not automated platforms. Although some other anatomical structures can be studied, we focused on one case: a lung study. Analyzing the application of the platform to more than 1000 dicom images and studying the results with medical specialists, we concluded that the installation of this system in hospitals would provide a considerable improvement as a tool for medical image visualization.

Download Full-text

Virtual reality – level of immersion within the crime investigation

MATEC Web of Conferences ◽

10.1051/matecconf/201929201031 ◽

2019 ◽

Vol 292 ◽

pp. 01031 ◽

Cited By ~ 1

Author(s):

Václav Mach ◽

Jan Valouch ◽

Milan Adámek ◽

Jiří Ševčík

Keyword(s):

Virtual Reality ◽

Virtual Environment ◽

Traffic Accidents ◽

Criminal Investigation ◽

New Approach ◽

Immersive Virtual Environment ◽

Crime Investigation ◽

Crime Scenarios ◽

Investigation Process ◽

Different Levels

The 3D reconstruction and visualization of crime scenarios, such as criminal assaults, traffic accidents or homicides are defining a new approach with potential for increasing effectiveness within the criminal investigation process. Modern 3D capturing and processing methods are utilized to create an authentic and immersive virtual environment. Nonetheless, an immersion to virtual environment enables different levels of view. Virtual reality immersion views which are proposed and described. These views are specific by reasons of its role within the criminal investigation as well as its technical severity. Moreover, the possible methods for the design of proposed virtual views are analyzed and the next research steps are exposed.

Download Full-text