Augmented Reality Vector Light Field Display with Large Viewing Distance Based on Pixelated Multilevel Blazed Gratings

Glasses-free augmented reality (AR) 3D display has attracted great interest in its ability to merge virtual 3D objects with real scenes naturally, without the aid of any wearable devices. Here we propose an AR vector light field display based on a view combiner and an off-the-shelf purchased projector. The view combiner is sparsely covered with pixelated multilevel blazed gratings (MBG) for the projection of perspective virtual images. Multi-order diffraction of the MBG is designed to increase the viewing distance and vertical viewing angle. In a 20-inch prototype, multiple sets of 16 horizontal views form a smooth parallax. The viewing distance of the 3D scene is larger than 5 m. The vertical viewing angle is 15.6°. The light efficiencies of all views are larger than 53%. We demonstrate that the displayed virtual 3D scene retains natural motion parallax and high brightness while having a consistent occlusion effect with natural objects. This research can be extended to applications in areas such as human–computer interaction, entertainment, education, and medical care.

Download Full-text

Spatial multiplexing holographic combiner for glasses-free augmented reality

Nanophotonics ◽

10.1515/nanoph-2020-0243 ◽

2020 ◽

Vol 9 (9) ◽

pp. 3003-3010

Author(s):

Jiacheng Shi ◽

Wen Qiao ◽

Jianyu Hua ◽

Ruibin Li ◽

Linsen Chen

Keyword(s):

Augmented Reality ◽

Large Scale ◽

Motion Parallax ◽

Visible Spectrum ◽

Physical World ◽

Spatial Multiplexing ◽

White Balance ◽

Full Color ◽

Entire Visible Spectrum ◽

3D Scene

AbstractGlasses-free augmented reality is of great interest by fusing virtual 3D images naturally with physical world without the aid of any wearable equipment. Here we propose a large-scale spatial multiplexing holographic see-through combiner for full-color 3D display. The pixelated metagratings with varied orientation and spatial frequency discretely reconstruct the propagating lightfield. The irradiance pattern of each view is tailored to form super Gaussian distribution with minimized crosstalk. What’s more, spatial multiplexing holographic combiner with customized aperture size is adopted for the white balance of virtually displayed full-color 3D scene. In a 32-inch prototype, 16 views form a smooth parallax with a viewing angle of 47°. A high transmission (>75%) over the entire visible spectrum range is achieved. We demonstrated that the displayed virtual 3D scene not only preserved natural motion parallax, but also mixed well with the natural objects. The potential applications of this study include education, communication, product design, advertisement, and head-up display.

Download Full-text

Augmented reality using holographic display

Optical Data Processing and Storage ◽

10.1515/odps-2017-0014 ◽

2017 ◽

Vol 3 (1) ◽

Cited By ~ 1

Author(s):

Hung-Chun Lin ◽

Yung-Hsun Wu

Keyword(s):

Image Quality ◽

Augmented Reality ◽

Depth Information ◽

Viewing Angle ◽

Virtual Image ◽

The Real ◽

Holographic Display ◽

Extra Information ◽

Wide Viewing Angle ◽

3D Scene

AbstractAugmented reality (AR) provided extra information to the user by applying virtual image onto the real environment. There are many methods achieving AR. Holographic display is one of the potential ways due to its perfect 3D demonstration. Holographic display can provide the virtual 3D object with depth information. It can be realized an AR device with real 3D scene by combing holographic display. However, it is difficult to realize a compact holographic display with wide viewing angle and enough resolution. It limits holographic display to apply to AR. In this paper, we will discuss the requirements of holographic display based on the development of LCD, including resolution (ppi), viewing angle, image quality and backlight. We wish this article can provide preliminary direction for the LCD industry to develop AR technology using holographic display.

Download Full-text

Metalens Eyepiece for 3D Holographic Near-Eye Display

Nanomaterials ◽

10.3390/nano11081920 ◽

2021 ◽

Vol 11 (8) ◽

pp. 1920

Author(s):

Chang Wang ◽

Zeqing Yu ◽

Qiangbo Zhang ◽

Yan Sun ◽

Chenning Tao ◽

...

Keyword(s):

Light Field ◽

Three Dimensional ◽

Fresnel Diffraction ◽

Virtual Image ◽

Display Devices ◽

Computer Generated Holography ◽

Wavefront Shaping ◽

3D Scene ◽

Optimum Solution ◽

532 Nm

Near-eye display (NED) systems for virtual reality (VR) and augmented reality (AR) have been rapidly developing; however, the widespread use of VR/AR devices is hindered by the bulky refractive and diffractive elements in the complicated optical system as well as the visual discomfort caused by excessive binocular parallax and accommodation-convergence conflict. To address these problems, an NED system combining a 5 mm diameter metalens eyepiece and a three-dimensional (3D), computer-generated holography (CGH) based on Fresnel diffraction is proposed in this paper. Metalenses have been extensively studied for their extraordinary capabilities at wavefront shaping at a subwavelength scale, their ultrathin compactness, and their significant advantages over conventional lenses. Thus, the introduction of the metalens eyepiece is likely to reduce the issue of bulkiness in NED systems. Furthermore, CGH has typically been regarded as the optimum solution for 3D displays to overcome limitations of binocular systems, since it can restore the whole light field of the target 3D scene. Experiments are carried out for this design, where a 5 mm diameter metalens eyepiece composed of silicon nitride anisotropic nanofins is fabricated with diffraction efficiency and field of view for a 532 nm incidence of 15.7% and 31°, respectively. Furthermore, a novel partitioned Fresnel diffraction and resample method is applied to simulate the wave propagations needed to produce the hologram, with the metalens capable of transforming the reconstructed 3D image into a virtual image for the NED. Our work combining metalens and CGH may pave the way for portable optical display devices in the future.

Download Full-text

A Flexible Coding Scheme Based on Block Krylov Subspace Approximation for Light Field Displays with Stacked Multiplicative Layers

Sensors ◽

10.3390/s21134574 ◽

2021 ◽

Vol 21 (13) ◽

pp. 4574

Author(s):

Joshitha Ravishankar ◽

Mansi Sharma ◽

Pradeep Gopalakrishnan

Keyword(s):

Light Field ◽

Krylov Subspace ◽

Motion Parallax ◽

Low Rank ◽

Coding Scheme ◽

Krylov Subspace Approximation ◽

New Type ◽

Value Decomposition ◽

Subspace Approximation ◽

Inter Frame

To create a realistic 3D perception on glasses-free displays, it is critical to support continuous motion parallax, greater depths of field, and wider fields of view. A new type of Layered or Tensor light field 3D display has attracted greater attention these days. Using only a few light-attenuating pixelized layers (e.g., LCD panels), it supports many views from different viewing directions that can be displayed simultaneously with a high resolution. This paper presents a novel flexible scheme for efficient layer-based representation and lossy compression of light fields on layered displays. The proposed scheme learns stacked multiplicative layers optimized using a convolutional neural network (CNN). The intrinsic redundancy in light field data is efficiently removed by analyzing the hidden low-rank structure of multiplicative layers on a Krylov subspace. Factorization derived from Block Krylov singular value decomposition (BK-SVD) exploits the spatial correlation in layer patterns for multiplicative layers with varying low ranks. Further, encoding with HEVC eliminates inter-frame and intra-frame redundancies in the low-rank approximated representation of layers and improves the compression efficiency. The scheme is flexible to realize multiple bitrates at the decoder by adjusting the ranks of BK-SVD representation and HEVC quantization. Thus, it would complement the generality and flexibility of a data-driven CNN-based method for coding with multiple bitrates within a single training framework for practical display applications. Extensive experiments demonstrate that the proposed coding scheme achieves substantial bitrate savings compared with pseudo-sequence-based light field compression approaches and state-of-the-art JPEG and HEVC coders.

Download Full-text

Motion Parallax Representation for Indirect Augmented Reality

2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct) ◽

10.1109/ismar-adjunct.2016.0051 ◽

2016 ◽

Cited By ~ 1

Author(s):

Fumio Okura ◽

Yuya Nishizaki ◽

Tomokazu Sato ◽

Norihiko Kawai ◽

Naokazu Yokoya

Keyword(s):

Augmented Reality ◽

Motion Parallax

Download Full-text

Evaluation of Linear Blending between view images and Depth Perception by Monocular Motion Parallax in Visually Equivalent Light Field 3D display

Proceedings of the International Display Workshops ◽

10.36463/idw.2020.0507 ◽

2020 ◽

pp. 507

Author(s):

Ren Kamada ◽

Haruki Mizushina ◽

Munekazu Date ◽

Shinya Shimizu ◽

Susumu Yamamoto ◽

...

Keyword(s):

Depth Perception ◽

Light Field ◽

Motion Parallax ◽

3D Display

Download Full-text

Implementasi Augmented Reality (AR) Berbasis Android Sebagai Pengenalan Rumah Adat Indonesia Bagian Barat

JUSS (Jurnal Sains dan Sistem Informasi) ◽

10.22437/juss.v3i1.8919 ◽

2021 ◽

Vol 3 (1) ◽

pp. 1-6

Author(s):

Novia Sulistyowati ◽

Rahmat Robi Waliyansyah ◽

Febrian Murti Dewanto

Keyword(s):

Augmented Reality ◽

School Children ◽

Learning Process ◽

User Acceptance ◽

Development Stage ◽

Acceptance Test ◽

3D Objects ◽

Form Function ◽

To Come ◽

Design Aspect

A traditional house is a house that has a unique building characteristic in an area that describes the culture of the area itself. Traditional houses are also unique in terms of form, function and meaning of the building. As Indonesians, we must introduce one of the existing cultures so that it is not forgotten by the community, especially school children. Judging from the development of technology, we must make new things in introducing traditional houses. From the results of research conducted at SD IT BINA INSANI, the teachers there still use conventional media in the form of textbooks and thematic books for the learning process. Therefore, the authors created an application to introduce western Indonesian traditional houses using Augmented Reality called RA-IBB as an introduction medium. This application is based on Android so that teachers can easily explain material about traditional houses and can show traditional houses in 3D without having to come directly to the province. And for students to be able to study traditional houses wherever and whenever. The making of this application uses the waterfall method for the development stage. The RA-IBB application contains materials about western Indonesian traditional houses and their 3d objects and quiz questions that use random shuffle algorithm questions. The random shuffle algorithm is a randomized question from an array or record. Based on the User Acceptance Test (UAT) for teachers, the results obtained from several aspects, namely the design aspect yields a percentage of 91%, the application information aspect produces a percentage of 91.

Download Full-text

Projection Screen with Wide-FOV and Motion Parallax Display for Teleoperation of Construction Machinery

Journal of Robotics and Mechatronics ◽

10.20965/jrm.2021.p0604 ◽

2021 ◽

Vol 33 (3) ◽

pp. 604-609

Author(s):

Daisuke Kondo ◽

Keyword(s):

Motion Parallax ◽

Field Of View ◽

Depth Information ◽

Wide Field ◽

Viewing Angle ◽

Cooperative Research ◽

Construction Machinery ◽

Cooperative Research Center ◽

Projection Screen ◽

Wide Field Of View

The teleoperation of construction machinery has been introduced to mines and disaster sites. However, the work efficiency of teleoperations is lower than that of onboard operations owing to limitations in the viewing angle and insufficient depth information. To solve these problems and realize effective teleoperations, the Komatsu MIRAI Construction Equipment Cooperative Research Center is developing the next-generation teleoperation cockpit. In this study, we develop a display for teleoperations with a wide field-of-view, a portable projection screen, and a system that reproduces motion parallax, which is suitable for depth perception in the operating range of construction machinery.

Download Full-text

3D Image Edge Detection Algorithm for Depth Detection

International Journal of Recent Technology and Engineering - 2 ◽

10.35940/ijrte.b1440.0982s1119 ◽

2019 ◽

Vol 8 (2S11) ◽

pp. 3555-3557

Keyword(s):

Edge Detection ◽

Detection Algorithm ◽

Edge Detection Algorithm ◽

3 Dimensional ◽

3D Objects ◽

Image Edge Detection ◽

Canny Edge ◽

Image Edge ◽

3D Scene ◽

Edge Recognition

Showing a genuine 3 dimensional (3D) objects with the striking profundity data is dependably a troublesome and cost-devouring procedure. Speaking to 3D scene without a noise (raw image) is another case. With a honed technique for survey profundity measurement can be effortlessly gotten, without requiring any extraordinary instrument. In this paper, we have proposed an edge recognition process in a profundity picture dependent on the picture based smoothing and morphological activities.In this strategy, we have utilized the guideline of Median sifting, which has a prestigious element for edge safeguarding properties. The edge discovery was done dependent on the Canny Edge Detection Algorithm. Along these lines this strategy will help to identify edges powerfully from profundity pictures and add to advance applications top to bottom pictures

Download Full-text