Evaluation of Adaptive Interaction Systems for Virtual Museum Development

Virtual Museum (VM) is an application of Virtual Reality (VR) technology generating realistic visualization and sensation to convince museum visitors to interact with digital content. There are many immersive VR devices that support interactive VM applications. We investigate appropriate devices for interaction within VM. We proposed a Storytelling platform to achieve device organization without modification, the story and interaction were self-adapted to the selected device. Three types of interactive content were designed on our Storytelling platform to be applied on different interaction systems: a 2D standard display, a 3D stereoscopic display and a full immersive CAVE. The results showed different performances of each system supporting VM developers to select an appropriate interaction system. The evaluation contributes to the design of content and interaction of VM development with more efficiency based on user requirements. HIGHLIGHTS Three types of interactive content were designed on our Storytelling platform to be applied on different interaction systems: A 2D standard display, a 3D stereoscopic display, and a full immersive CAVE The 2D Powerwall system with a wide range of views provides immersion. However, with two-dimensional displays, users lack depth perception Users spent more time in selection and manipulation in the 3D stereoscopic system because depth perception is added The CAVE system has user attraction or holding power, users spent more interacting time GRAPHICAL ABSTRACT

Design of 3D volumetric display

Stereoscopic, or multi-view, display systems that can give significant visual clues for the human brain to understand three-dimensional (3D) objects, they are regarded as better alternatives to traditional two-dimensional (2D) displays. A device that can render 3D images for viewers without the use of specific headgear or glasses is known as an auto-stereoscopic display. Manipulation of light rays via Light engines is also used to create 3D images in 3D space. We introduce a new auto-stereoscopic swept-volume display (SVD) system based on light-emitting diode (LED) arrays in this research. A display device plus a graphics control sub-system makes up this system. The display device is a 2D revolving panel of LEDs that generates 3D images using “persistence of vision”.

English Classroom Immersive Teaching Based on Digital Twin Technology

In order to improve the effect of English classroom teaching, this paper builds an immersive teaching model of English classroom based on digital twin technology. Moreover, in order to reduce the cost of the system, simplify the system structure, and enable learners to observe the stereoscopic display image with the naked eye, this paper builds an immersive hemispherical projection teaching system, designs the overall structure of the system and various components of the hardware, and studies the projection image predistortion algorithm. In addition, this paper uses the immersive experience between virtual reality technology and immersive teaching as a connection point to design an immersive teaching based on VR and apply it to teaching practice to test the effect of immersive teaching, and perfect the immersive teaching design model based on VR. Finally, this paper designs an experiment to verify and analyze the performance of the system. From the experimental results, it can be seen that the English classroom immersive teaching model based on digital twin technology constructed in this paper is effective.

Visual Fatigue Alleviating in Stereo Imaging of Anaglyphs by Reducing Retinal Rivalry and Color Distortion Based on Mobile Virtual Reality Technology

Stereoscopic display is the means of showing scenes in Virtual Reality (VR). As a type of stereo images, anaglyphs can be displayed not only on the screen, but are currently the only solution of stereo images that can be displayed on paper. However, its deficiencies, like retinal rivalry and color distortion, could cause visual fatigue. To address this issue, an algorithm is proposed for anaglyph generation. Unlike previous studies only considering one aspect, it considers both retinal rivalry and color distortion at the same time. The algorithm works in the CIE L ∗ a ∗ b ∗ color space and focuses on matching the perceptual color attributes especially the hue, rather than directly minimizes the sum of the distances between the perceived anaglyph color and the stereo image pair. In addition, the paper builds a relatively complete framework to generate anaglyphs so that it is more controllable to adjust the parameters and choose the appropriate process. The subjective tests are conducted to compare the results with several techniques which generate anaglyphs including empirical methods and computing methods. Results show that the proposed algorithm has a good performance.

A Novel Anatomy Education Method Using a Spatial Reality Display Capable of Stereoscopic Imaging with the Naked Eye

Several efforts have been made to use virtual reality (VR) and augmented reality (AR) for medical and dental education and surgical support. The current methods still require users to wear devices such as a head-mounted display (HMD) and smart glasses, which pose challenges in hygiene management and long-term use. Additionally, it is necessary to measure the user’s inter-pupillary distance and to reflect it in the device settings each time to accurately display 3D images. This setting is difficult for daily use. We developed and implemented a novel anatomy education method using a spatial reality display capable of stereoscopic viewing with the naked eye without an HMD or smart glasses. In this study, we developed two new applications: (1) a head and neck anatomy education application, which can display 3D-CG models of the skeleton and blood vessels of the head and neck region using 3D human body data available free of charge from public research institutes, and (2) a DICOM image autostereoscopic viewer, which can automatically convert 2D CT/MRI/CBCT image data into 3D-CG models. In total, 104 students at the School of Dentistry experienced and evaluated the system, and the results suggest its usefulness. A stereoscopic display without a head-mounted display is highly useful and promising for anatomy education.

Design and Research of Interactive Animation of Immersive Space Scene Based on Computer Vision Technology

With the development of computational simulation technology, the need for stable and immersive display effects of space scene animation in the field of life experience and visual art has gradually increased. In this case, the requirements for immersive characteristics of space scene animation have also been strengthened. The existing 3D space scene animation has a limited degree of stereoscopic display model and data visualization. However, the current space scene interactive animation adopts a plane layout as a whole, and the size of the view interface is generally fixed, including the size of virtual elements. However, the immersion in this paper interactive animation of spatial scene can effectively solve the problems of incomplete display of 3D effects and unstable view simulation in 3D effects. This paper takes immersive space scene animation as the research object and studies the 3D and characteristics of space scene animation based on computer parallel computing in different immersive space scenes and different virtual space technologies, as well as the animation effects of different scene transformations and art forms. The result of research shows that, with the continuous increase of the degree of virtuality within a certain range, the immersive effect of spatial scene interactive animation gradually becomes better. When the color of the space scene animation is below 15, the virtual immersive effect changes less. When the space scene is in the range of 15–20, the space scene will make people feel the atmosphere of a beautiful and mysterious illusion.