scholarly journals Fusion Coding of 3D Real and Virtual Scenes Information for Augmented Reality-Based Holographic Stereogram

2021 ◽  
Vol 9 ◽  
Author(s):  
Yunpeng Liu ◽  
Xingpeng Yan ◽  
Xinlei Liu ◽  
Xi Wang ◽  
Tao Jing ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Depth Map ◽  
Depth Information ◽  
Sampling System ◽  
The Real ◽  
Coding Method ◽  
Holographic Stereogram ◽  
3D Scene ◽  
Instance Segmentation

In this paper, an optical field coding method for the fusion of real and virtual scenes is proposed to implement an augmented reality (AR)-based holographic stereogram. The occlusion relationship between the real and virtual scenes is analyzed, and a fusion strategy based on instance segmentation and depth determination is proposed. A real three-dimensional (3D) scene sampling system is built, and the foreground contour of the sampled perspective image is extracted by the Mask R-CNN instance segmentation algorithm. The virtual 3D scene is rendered by a computer to obtain the virtual sampled images as well as their depth maps. According to the occlusion relation of the fusion scenes, the pseudo-depth map of the real scene is derived, and the fusion coding of 3D real and virtual scenes information is implemented by the depth information comparison. The optical experiment indicates that AR-based holographic stereogram fabricated by our coding method can reconstruct real and virtual fused 3D scenes with correct occlusion and depth cues on full parallax.

scholarly journals Augmented reality using holographic display

2017 ◽  
Vol 3 (1) ◽  
Author(s):  
Hung-Chun Lin ◽  
Yung-Hsun Wu
Keyword(s):  
Image Quality ◽  
Augmented Reality ◽  
Depth Information ◽  
Viewing Angle ◽  
Virtual Image ◽  
The Real ◽  
Holographic Display ◽  
Extra Information ◽  
Wide Viewing Angle ◽  
3D Scene

AbstractAugmented reality (AR) provided extra information to the user by applying virtual image onto the real environment. There are many methods achieving AR. Holographic display is one of the potential ways due to its perfect 3D demonstration. Holographic display can provide the virtual 3D object with depth information. It can be realized an AR device with real 3D scene by combing holographic display. However, it is difficult to realize a compact holographic display with wide viewing angle and enough resolution. It limits holographic display to apply to AR. In this paper, we will discuss the requirements of holographic display based on the development of LCD, including resolution (ppi), viewing angle, image quality and backlight. We wish this article can provide preliminary direction for the LCD industry to develop AR technology using holographic display.

scholarly journals Real-Time Calibration and Registration Method for Indoor Scene with Joint Depth and Color Camera

2018 ◽  
Vol 32 (07) ◽  
pp. 1854021 ◽  
Author(s):  
Fengquan Zhang ◽  
Tingshen Lei ◽  
Jinhong Li ◽  
Xingquan Cai ◽  
Xuqiang Shao ◽  
...  
Keyword(s):  
Real Time ◽  
Color Image ◽  
Random Noise ◽  
Three Dimensional ◽  
Depth Map ◽  
Video Stream ◽  
Depth Information ◽  
Registration Method ◽  
The Real ◽  
Time Calibration

Traditional vision registration technologies require the design of precise markers or rich texture information captured from the video scenes, and the vision-based methods have high computational complexity while the hardware-based registration technologies lack accuracy. Therefore, in this paper, we propose a novel registration method that takes advantages of RGB-D camera to obtain the depth information in real-time, and a binocular system using the Time of Flight (ToF) camera and a commercial color camera is constructed to realize the three-dimensional registration technique. First, we calibrate the binocular system to get their position relationships. The systematic errors are fitted and corrected by the method of B-spline curve. In order to reduce the anomaly and random noise, an elimination algorithm and an improved bilateral filtering algorithm are proposed to optimize the depth map. For the real-time requirement of the system, it is further accelerated by parallel computing with CUDA. Then, the Camshift-based tracking algorithm is applied to capture the real object registered in the video stream. In addition, the position and orientation of the object are tracked according to the correspondence between the color image and the 3D data. Finally, some experiments are implemented and compared using our binocular system. Experimental results are shown to demonstrate the feasibility and effectiveness of our method.

scholarly journals Real-Life Continuous Flash Suppression - Rendering The Real World Unconscious Using Augmented Reality Goggles

2018 ◽  
Author(s):  
Uri Korisky ◽  
Rony Hirschhorn ◽  
Liad Mudrik
Keyword(s):  
Augmented Reality ◽  
Real World ◽  
Three Dimensional ◽  
Real Life ◽  
Continuous Flash Suppression ◽  
Future Studies ◽  
The Real ◽  
Dominant Eye ◽  
Novel Variant ◽  
Real Objects

Notice: a peer-reviewed version of this preprint has been published in Behavior Research Methods and is available freely at http://link.springer.com/article/10.3758/s13428-018-1162-0Continuous Flash Suppression (CFS) is a popular method for suppressing visual stimuli from awareness for relatively long periods. Thus far, it has only been used for suppressing two-dimensional images presented on-screen. We present a novel variant of CFS, termed ‘real-life CFS’, with which the actual immediate surroundings of an observer – including three-dimensional, real life objects – can be rendered unconscious. Real-life CFS uses augmented reality goggles to present subjects with CFS masks to their dominant eye, leaving their non-dominant eye exposed to the real world. In three experiments we demonstrate that real objects can indeed be suppressed from awareness using real-life CFS, and that duration suppression is comparable that obtained using the classic, on-screen CFS. We further provide an example for an experimental code, which can be modified for future studies using ‘real-life CFS’. This opens the gate for new questions in the study of consciousness and its functions.

scholarly journals An Exploration of Augmented Reality in Computer Assisted Orthopaedic Surgery

10.29007/72d4 ◽  
2018 ◽  
Author(s):  
He Liu ◽  
Edouard Auvinet ◽  
Joshua Giles ◽  
Ferdinando Rodriguez Y Baena
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Hole Drilling ◽  
Depth Information ◽  
Computer Assisted ◽  
Pilot Hole ◽  
Surgical Workflow ◽  
Processing Depth ◽  
Computer Assisted Orthopaedic Surgery ◽  
Preoperative Plan

Computer Aided Surgery (CAS) is helpful, but it clutters an already overcrowded operating theatre, and tends to disrupt the workflow of conventional surgery. In order to provide seamless computer assistance with improved immersion and a more natural surgical workflow, we propose an augmented-reality based navigation system for CAS. Here, we choose to focus on the proximal femoral anatomy, which we register to a plan by processing depth information of the surgical site captured by a commercial depth camera. Intra-operative three-dimensional surgical guidance is then provided to the surgeon through a commercial augmented reality headset, to drill a pilot hole in the femoral head, so that the user can perform the operation without additional physical guides. The user can interact intuitively with the system by simple gestures and voice commands, resulting in a more natural workflow. To assess the surgical accuracy of the proposed setup, 30 experiments of pilot hole drilling were performed on femur phantoms. The position and the orientation of the drilled guide holes were measured and compared with the preoperative plan, and the mean errors were within 2mm and 2°, results which are in line with commercial computer assisted orthopedic systems today.

scholarly journals Efficient Hogel-Based Hologram Synthesis Method for Holographic Stereogram Printing

2020 ◽  
Vol 10 (22) ◽  
pp. 8088
Author(s):  
Erkhembaatar Dashdavaa ◽  
Anar Khuderchuluun ◽  
Hui-Ying Wu ◽  
Young-Tae Lim ◽  
Chang-Won Shin ◽  
...  
Keyword(s):  
Numerical Simulation ◽  
Spatial Resolution ◽  
Angular Resolution ◽  
Synthesis Method ◽  
Three Dimensional ◽  
Lateral Resolution ◽  
Trade Off ◽  
Optical Experiment ◽  
Holographic Stereogram ◽  
3D Scene

With the development of the holographic printer, printing synthetic hologram requires smaller holographic element (hogel) size to improve spatial resolution of the reconstruction. On the contrary, a larger hogel size affords higher angular resolution, but it leads to a lower lateral resolution and there exists a trade-off problem. In this paper, a hologram synthesis method based on three-dimensional (3D) rendering of computer-generated holographic stereogram (HS) is proposed to limit the spatial-angular trade-off problem. The perspectives of the 3D scene are captured by re-centering the camera method and transformed into parallax-related images by a proposed pixel re-arrangement algorithm for holographic printing. Unlike the conventional approaches, the proposed algorithm not only improves the angular resolution of the reconstruction while maintaining the hogel size fixed, but also keeps the spatial resolution without degradation. The effectiveness of the proposed method is verified by numerical simulation and an optical experiment.

scholarly journals Penerapan Teknologi Augmented Reality Sebagai Model Media Edukasi Kesehatan Gigi Bagi Anak

2015 ◽  
Vol 2 (1) ◽  
pp. 77
Author(s):  
Tonny Hidayat
Keyword(s):  
Computer Vision ◽  
Augmented Reality ◽  
Real World ◽  
Dental Health ◽  
Three Dimensional ◽  
Video Stream ◽  
Public Understanding ◽  
Added Value ◽  
Input Device ◽  
The Real

Augmented Reality adalah sebuah teknologi yang relatif baru dan masih dikembangkan sampai saat ini. Konsepnya adalah menggabungkan dimensi dunia nyata dengan dimensi 'dunia nyata' yang termediasi, atau dunia virtual, untuk menciptakan kesan bahwa dimensi dunia nyata kita diperkaya dengan objek maya tiga dimensi. Hal ini dilakukan dengan cara 'menggambar' objek tiga dimensi pada marker, yakni sebuah 'pola' dalam bingkai segi empat yang bersifat unik dan dapat dikenali oleh aplikasinya. Aplikasi yang bersangkutan menerima input berupa video stream, yang berarti menggunakan input berupa citraan dari perangkat keras yang berfungsi menangkap gambar, biasanya sebuah webcam. Karena berupa video stream, artinya gambaran yang ditangkap sebagai input akan berubah-ubah, dan program harus dapat tetap mengenali marker meskipun berubah posisi dan orientasi relatif terhadap perangkat input. Pengenalan terhadap posisi dan pergerakan ini adalah salah satu konsep Teknologi Informasi yang bernama Computer Vision, dan digunakan untuk mendeteksi pola pergerakan relatif objek terhadap kamera.Pendidikan terhadap anak harus dilakukan sedini mungkin terutama dalam hal kesehatan. Seiring dengan berkembangnya pemahaman masyarakat tentang pentingnya kesehatan gigi, banyak pihak yang telah memberikan informasi terkait kesehatan gigi di berbagai media. Tidak hanya orang dewasa yang menjadi sasaran akan tetapi juga mulai dari anak-anak sudah dikenalkan dengan pengetahuan tersebut. Karena dibutuhkan media penyampaian untuk anak maka banyak bermunculan media edukasi yang diharapkan bisamendidik anak dengan berbagai macam cara..Pemanfaatan Augmented Realitysebagai alat untuk mengedukasi anak, ini akan memberikan pandangan baru terhadap media edukasi yang ada pada saat ini, bukan hanya menggunakan objek secara nyata tapi juga bisa digunakan objek berbentuk virtual dalam penyampaian informasi. Nilai tambah dari media ini adalah mempermudah penyampaian dan membuat informasi semakin menarik terutama bagi anak.Augmented Reality is a technology that is relatively new and still being developed today. The concept is to combine real-world dimensions to the dimensions of the 'real world' are mediated, or the virtual world, to create the impression that the dimensions of the real world we are enriched by virtual three-dimensional objects. This is done by 'drawing' a three-dimensional object on the marker, which is a 'pattern' in a rectangular frame that is unique and can be recognized by the application. Pertinent application accepts input in the form of a video stream, which means using the input in the form of images of the hardware image capture function, typically a webcam. Because the form of a video stream, meaning that as the input image captured will vary, and programs must be able to recognize the markers remained unchanged despite the position and orientation relative to the input device. Introduction to the position and movement is one of the Information Technology concept called Computer Vision, and is used to detect object movement patterns relative to the camera.Education of children should be done as early as possible, especially in terms of health. Along with the development of public understanding about the importance of dental health, many people who have provided information related to dental health in a variety of media. Not only adults who were targeted but also start from the children has been introduced with such knowledge. Because it takes delivery of media for children then many emerging medium of education is expected to educate children with a variety of ways.Utilization of Augmented Reality as a tool to educate the child, this will provide a new perspective on media education that existed at this time, instead of just using the real object but also can be used in the form of a virtual object in the delivery of information. The added value of this medium is to facilitate the delivery and make the information more interesting, especially for children.

scholarly journals A Reflective Augmented Reality Integral Imaging 3D Display by Using a Mirror-Based Pinhole Array

2019 ◽  
Vol 9 (15) ◽  
pp. 3124
Author(s):  
Qiang Li ◽  
Huan Deng ◽  
Senlin Pang ◽  
Wenhao Jiang ◽  
Qionghua Wang
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
3D Display ◽  
Projection System ◽  
Imaging Device ◽  
Integral Imaging ◽  
The Real ◽  
Large Size ◽  
Low Weight ◽  
Real Objects

In this paper, we propose a reflective augmented reality (AR) display system based on integral imaging (II) using a mirror-based pinhole array (MBPA). The MBPA, obtained by punching pinholes on a mirror, functions as a three-dimensional (3D) imaging device, as well as an image combiner. The pinhole array of MBPA can realize a pinhole array-based II display, while the mirror of MBPA can image the real objects, so as to combine the images of the real objects with the reconstructed 3D images. The structure of the proposed reflective AR display is very simple, and only a projection system or a two-dimensional display screen is needed to combine with the MBPA. In our experiment, a 25cm × 14cm sized AR display was built up, a combination of a 3D virtual image and a real 3D object was presented by the proposed AR 3D display. The proposed device could realize an AR display of large size due to its compact form factor and low weight.

scholarly journals Rendering Distortion Estimation Model for 3D High Efficiency Depth Coding

2014 ◽  
Vol 2014 ◽  
pp. 1-7 ◽  
Author(s):  
Qiuwen Zhang ◽  
Liang Tian ◽  
Lixun Huang ◽  
Xiaobing Wang ◽  
Haodong Zhu
Keyword(s):  
High Efficiency ◽  
Three Dimensional ◽  
Rate Distortion ◽  
Depth Map ◽  
Depth Image ◽  
High Efficiency Video Coding ◽  
Estimation Model ◽  
Depth Image Based Rendering ◽  
Distortion Estimation ◽  
3D Scene

A depth map represents three-dimensional (3D) scene geometry information and is used for depth image based rendering (DIBR) to synthesize arbitrary virtual views. Since the depth map is only used to synthesize virtual views and is not displayed directly, the depth map needs to be compressed in a certain way that can minimize distortions in the rendered views. In this paper, a modified distortion estimation model is proposed based on view rendering distortion instead of depth map distortion itself and can be applied to the high efficiency video coding (HEVC) rate distortion cost function process for rendering view quality optimization. Experimental results on various 3D video sequences show that the proposed algorithm provides about 31% BD-rate savings in comparison with HEVC simulcast and 1.3 dB BD-PSNR coding gain for the rendered view.

scholarly journals Scaling of Three-Dimensional Computer-Generated Holograms with Layer-Based Shifted Fresnel Diffraction

2019 ◽  
Vol 9 (10) ◽  
pp. 2118 ◽  
Author(s):  
Hao Zhang ◽  
Liangcai Cao ◽  
Guofan Jin
Keyword(s):  
Three Dimensional ◽  
Fresnel Diffraction ◽  
Depth Image ◽  
Depth Information ◽  
Display System ◽  
3D Images ◽  
Holographic Display ◽  
Computer Generated Holograms ◽  
3D Scene ◽  
Human Eyes

Holographic three-dimensional (3D) displays can reconstruct a whole wavefront of a 3D scene and provide rich depth information for the human eyes. Computer-generated holographic techniques offer an efficient way for reconstructing holograms without complicated interference recording systems. In this work, we present a technique for generating 3D computer-generated holograms (CGHs) with scalable samplings, by using layer-based diffraction calculations. The 3D scene is partitioned into multiple layers according to its depth image. Shifted Fresnel diffraction is used for calculating the wave diffractions from the partitioned layers to the CGH plane with adjustable sampling rates, while maintaining the depth information. The algorithm provides an effective method for scaling 3D CGHs without an optical zoom module in the holographic display system. Experiments have been performed, demonstrating that the proposed method can reconstruct quality 3D images at different scale factors.

scholarly journals Rancang Bangun Aplikasi Augmented Reality Museum Bali Berbasis Android Studi Kasus Gedung Karangasem dan Gedung Tabanan

2016 ◽  
pp. 93
Author(s):  
I Gede Aditya Nugraha ◽  
I Ketut Gede Darma Putra ◽  
I Made Sukarsa
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Two Dimensional ◽  
Museum Collections ◽  
3D Object ◽  
The Real ◽  
Virtual Objects ◽  
The People ◽  
Augmented Reality Application ◽  
Augmented Reality Technology

Museum Bali is one of the museum which is located in Denpasar City that established since 1910. The Museum collections consist of items such as living equipment, art, religion, handwriting, and other things that show the situation and the development of the Balinese culture. Augmented Reality is a technology which combines two-dimensional virtual objects or three-dimensional virtual objects into the real environment. Museum Bali has decreased the amount of visitors in recent years and requires an innovation to promote Museum Bali. One innovation that is expected to promote the Museum Bali is to create an augmented reality application that called Augmented Reality Museum Bali in Android platform. Utilizing augmented reality technology that works by detecting the marker then it show up the 3D object and the information from one of the objectsin Museum Bali. Markerless method used in detection marker that make this application moreattractive and expected to be a new experience for the people who want to know more about Museum Bali.

Sign in / Sign up

Export Citation Format

Share Document