scholarly journals A study on recognizing multi-real world object and estimating 3D position in augmented reality

2021 ◽  
Author(s):  
Taemin Lee ◽  
Changhun Jung ◽  
Kyungtaek Lee ◽  
Sanghyun Seo
Keyword(s):  
Augmented Reality ◽  
Real World ◽  
Visual Information ◽  
Point Cloud ◽  
Three Dimensional ◽  
Point Clouds ◽  
Location Estimation ◽  
Virtual Space ◽  
Camera Tracking ◽  
The Real

AbstractAs augmented reality technologies develop, real-time interactions between objects present in the real world and virtual space are required. Generally, recognition and location estimation in augmented reality are carried out using tracking techniques, typically markers. However, using markers creates spatial constraints in simultaneous tracking of space and objects. Therefore, we propose a system that enables camera tracking in the real world and visualizes virtual visual information through the recognition and positioning of objects. We scanned the space using an RGB-D camera. A three-dimensional (3D) dense point cloud map is created using point clouds generated through video images. Among the generated point cloud information, objects are detected and retrieved based on the pre-learned data. Finally, using the predicted pose of the detected objects, other information may be augmented. Our system estimates object recognition and 3D pose based on simple camera information, enabling the viewing of virtual visual information based on object location.

scholarly journals Real-Life Continuous Flash Suppression - Rendering The Real World Unconscious Using Augmented Reality Goggles

2018 ◽  
Author(s):  
Uri Korisky ◽  
Rony Hirschhorn ◽  
Liad Mudrik
Keyword(s):  
Augmented Reality ◽  
Real World ◽  
Three Dimensional ◽  
Real Life ◽  
Continuous Flash Suppression ◽  
Future Studies ◽  
The Real ◽  
Dominant Eye ◽  
Novel Variant ◽  
Real Objects

Notice: a peer-reviewed version of this preprint has been published in Behavior Research Methods and is available freely at http://link.springer.com/article/10.3758/s13428-018-1162-0Continuous Flash Suppression (CFS) is a popular method for suppressing visual stimuli from awareness for relatively long periods. Thus far, it has only been used for suppressing two-dimensional images presented on-screen. We present a novel variant of CFS, termed ‘real-life CFS’, with which the actual immediate surroundings of an observer – including three-dimensional, real life objects – can be rendered unconscious. Real-life CFS uses augmented reality goggles to present subjects with CFS masks to their dominant eye, leaving their non-dominant eye exposed to the real world. In three experiments we demonstrate that real objects can indeed be suppressed from awareness using real-life CFS, and that duration suppression is comparable that obtained using the classic, on-screen CFS. We further provide an example for an experimental code, which can be modified for future studies using ‘real-life CFS’. This opens the gate for new questions in the study of consciousness and its functions.

scholarly journals Virtual Object Replacement Based on Real Environments: Potential Application in Augmented Reality Systems

2019 ◽  
Vol 9 (9) ◽  
pp. 1797
Author(s):  
Chen ◽  
Lin
Keyword(s):  
Augmented Reality ◽  
Virtual Environments ◽  
Real World ◽  
Point Clouds ◽  
Virtual Object ◽  
Movement Trajectory ◽  
The Real ◽  
Virtual Objects ◽  
Real Environment ◽  
Localization And Mapping

Augmented reality (AR) is an emerging technology that allows users to interact with simulated environments, including those emulating scenes in the real world. Most current AR technologies involve the placement of virtual objects within these scenes. However, difficulties in modeling real-world objects greatly limit the scope of the simulation, and thus the depth of the user experience. In this study, we developed a process by which to realize virtual environments that are based entirely on scenes in the real world. In modeling the real world, the proposed scheme divides scenes into discrete objects, which are then replaced with virtual objects. This enables users to interact in and with virtual environments without limitations. An RGB-D camera is used in conjunction with simultaneous localization and mapping (SLAM) to obtain the movement trajectory of the user and derive information related to the real environment. In modeling the environment, graph-based segmentation is used to segment point clouds and perform object segmentation to enable the subsequent replacement of objects with equivalent virtual entities. Superquadrics are used to derive shape parameters and location information from the segmentation results in order to ensure that the scale of the virtual objects matches the original objects in the real world. Only after the objects have been replaced with their virtual counterparts in the real environment converted into a virtual scene. Experiments involving the emulation of real-world locations demonstrated the feasibility of the proposed rendering scheme. A rock-climbing application scenario is finally presented to illustrate the potential use of the proposed system in AR applications.

scholarly journals Penerapan Teknologi Augmented Reality Sebagai Model Media Edukasi Kesehatan Gigi Bagi Anak

2015 ◽  
Vol 2 (1) ◽  
pp. 77
Author(s):  
Tonny Hidayat
Keyword(s):  
Computer Vision ◽  
Augmented Reality ◽  
Real World ◽  
Dental Health ◽  
Three Dimensional ◽  
Video Stream ◽  
Public Understanding ◽  
Added Value ◽  
Input Device ◽  
The Real

Augmented Reality adalah sebuah teknologi yang relatif baru dan masih dikembangkan sampai saat ini. Konsepnya adalah menggabungkan dimensi dunia nyata dengan dimensi 'dunia nyata' yang termediasi, atau dunia virtual, untuk menciptakan kesan bahwa dimensi dunia nyata kita diperkaya dengan objek maya tiga dimensi. Hal ini dilakukan dengan cara 'menggambar' objek tiga dimensi pada marker, yakni sebuah 'pola' dalam bingkai segi empat yang bersifat unik dan dapat dikenali oleh aplikasinya. Aplikasi yang bersangkutan menerima input berupa video stream, yang berarti menggunakan input berupa citraan dari perangkat keras yang berfungsi menangkap gambar, biasanya sebuah webcam. Karena berupa video stream, artinya gambaran yang ditangkap sebagai input akan berubah-ubah, dan program harus dapat tetap mengenali marker meskipun berubah posisi dan orientasi relatif terhadap perangkat input. Pengenalan terhadap posisi dan pergerakan ini adalah salah satu konsep Teknologi Informasi yang bernama Computer Vision, dan digunakan untuk mendeteksi pola pergerakan relatif objek terhadap kamera.Pendidikan terhadap anak harus dilakukan sedini mungkin terutama dalam hal kesehatan. Seiring dengan berkembangnya pemahaman masyarakat tentang pentingnya kesehatan gigi, banyak pihak yang telah memberikan informasi terkait kesehatan gigi di berbagai media. Tidak hanya orang dewasa yang menjadi sasaran akan tetapi juga mulai dari anak-anak sudah dikenalkan dengan pengetahuan tersebut. Karena dibutuhkan media penyampaian untuk anak maka banyak bermunculan media edukasi yang diharapkan bisamendidik anak dengan berbagai macam cara..Pemanfaatan Augmented Realitysebagai alat untuk mengedukasi anak, ini akan memberikan pandangan baru terhadap media edukasi yang ada pada saat ini, bukan hanya menggunakan objek secara nyata tapi juga bisa digunakan objek berbentuk virtual dalam penyampaian informasi. Nilai tambah dari media ini adalah mempermudah penyampaian dan membuat informasi semakin menarik terutama bagi anak.Augmented Reality is a technology that is relatively new and still being developed today. The concept is to combine real-world dimensions to the dimensions of the 'real world' are mediated, or the virtual world, to create the impression that the dimensions of the real world we are enriched by virtual three-dimensional objects. This is done by 'drawing' a three-dimensional object on the marker, which is a 'pattern' in a rectangular frame that is unique and can be recognized by the application. Pertinent application accepts input in the form of a video stream, which means using the input in the form of images of the hardware image capture function, typically a webcam. Because the form of a video stream, meaning that as the input image captured will vary, and programs must be able to recognize the markers remained unchanged despite the position and orientation relative to the input device. Introduction to the position and movement is one of the Information Technology concept called Computer Vision, and is used to detect object movement patterns relative to the camera.Education of children should be done as early as possible, especially in terms of health. Along with the development of public understanding about the importance of dental health, many people who have provided information related to dental health in a variety of media. Not only adults who were targeted but also start from the children has been introduced with such knowledge. Because it takes delivery of media for children then many emerging medium of education is expected to educate children with a variety of ways.Utilization of Augmented Reality as a tool to educate the child, this will provide a new perspective on media education that existed at this time, instead of just using the real object but also can be used in the form of a virtual object in the delivery of information. The added value of this medium is to facilitate the delivery and make the information more interesting, especially for children.

scholarly journals Automatic Reconstruction of Building-Scale Indoor 3D Environment with a Deep-Reinforcement-Learning-Based Mobile Robot

2021 ◽  
Vol 6 ◽  
pp. 11-23
Author(s):  
Menglong Yang ◽  
Katashi Nagao
Keyword(s):  
Reinforcement Learning ◽  
Mobile Robot ◽  
Real World ◽  
Low Cost ◽  
Three Dimensional ◽  
Point Clouds ◽  
Autonomous Agent ◽  
Entire Area ◽  
The Real ◽  
3D Point Clouds

The aim of this paper is to digitize the environments in which humans live, at low cost, and reconstruct highly accurate three-dimensional environments that are based on those in the real world. This three-dimensional content can be used such as for virtual reality environments and three-dimensional maps for automatic driving systems. In general, however, a three-dimensional environment must be carefully reconstructed by manually moving the sensors used to first scan the real environment on which the three-dimensional one is based. This is done so that every corner of an entire area can be measured, but time and costs increase as the area expands. Therefore, a system that creates three-dimensional content that is based on real-world large-scale buildings at low cost is proposed. This involves automatically scanning the indoors with a mobile robot that uses low-cost sensors and generating 3D point clouds. When the robot reaches an appropriate measurement position, it collects the three-dimensional data of shapes observable from that position by using a 3D sensor and 360-degree panoramic camera. The problem of determining an appropriate measurement position is called the “next best view problem,” and it is difficult to solve in a complicated indoor environment. To deal with this problem, a deep reinforcement learning method is employed. It combines reinforcement learning, with which an autonomous agent learns strategies for selecting behavior, and deep learning done using a neural network. As a result, 3D point cloud data can be generated with better quality than the conventional rule-based approach.

IMPLEMENTASI AR DENGAN METODE MARKER SEBAGAI KATALOG PADA TOKO MEBEL BERBASIS WEB-AR.pdf

2019 ◽  
Vol 3 (1) ◽  
pp. 1-9
Author(s):  
Aulia Sari Prihatini ◽  
Mahrizal Masri ◽  
Mhd. Zulfansyuri Siambaton
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Real World ◽  
Three Dimensional ◽  
Two Dimensional ◽  
Web Browser ◽  
Web Based ◽  
The Real ◽  
Real Objects

Reality Increasing or often also called AR (Augmented Reality) in English, is a technology that can add two-dimensional or three-dimensional illusions of objects together into a 3D into the real world then project illusion objects into real time. Unlike the illusion of reality where in the real world is completely replaced, reality only adds to or completes reality. Augmented Reality unites real objects and illusions into real circles, works interactively in real time and found integration between objects in 3D and good integration requires effective investigation. Web AR provides Web-based access using Augmented Reality through a web browser using a combination of technologies including WebRTC, WebGL, WebVR, and Modern APLs sensors. Catalogs are publicity tools used by companies as a way to promote their products and services. Examples of companies that use catalogs are Furniture stores that promote products. Here it will be visualized into 3D until it looks more clear and attractive to consumers. So, based on the description above, the author takes the title "Implementation of Augmented Reality with Marker Method as Media Catalog in AR-Based Furniture Stores. Keywords: Augmented Reality, WEB AR, catalog

Augmented and virtual reality art: a new frontier of legal protection

2021 ◽  
Vol 4 (2) ◽  
pp. 102-111
Author(s):  
Olivia Jean-Baptiste
Keyword(s):  
Virtual Reality ◽  
Augmented Reality ◽  
Real World ◽  
Virtual World ◽  
Three Dimensional ◽  
Legal Protection ◽  
The United States ◽  
Moral Rights ◽  
Current Status ◽  
The Real

Augmented reality (AR) refers to a type of technology in which a digital overlay can be added to the real world in order to present the viewer with aspects of both reality and a virtual world. Virtual reality (VR) environments consist of a computer-generated, three-dimensional, virtual world. However, in contrast to augmented reality technology these environments are self-contained, and do not allow users to interact directly with the real world around them. 1 This article will explore the current status of protection for AR and VR art in relation to moral rights drawing from three jurisdictions: France, the United Kingdom and the United States.

Real-world environment affects the color appearance of virtual stimuli produced by augmented reality

2019 ◽  
Vol 2019 (1) ◽  
pp. 237-242
Author(s):  
Siyuan Chen ◽  
Minchen Wei
Keyword(s):  
Augmented Reality ◽  
Real World ◽  
Mixed Reality ◽  
Rapid Development ◽  
Light Level ◽  
Color Appearance ◽  
Chromatic Adaptation ◽  
Lighting Condition ◽  
The Real ◽  
World Environment

Color appearance models have been extensively studied for characterizing and predicting the perceived color appearance of physical color stimuli under different viewing conditions. These stimuli are either surface colors reflecting illumination or self-luminous emitting radiations. With the rapid development of augmented reality (AR) and mixed reality (MR), it is critically important to understand how the color appearance of the objects that are produced by AR and MR are perceived, especially when these objects are overlaid on the real world. In this study, nine lighting conditions, with different correlated color temperature (CCT) levels and light levels, were created in a real-world environment. Under each lighting condition, human observers adjusted the color appearance of a virtual stimulus, which was overlaid on a real-world luminous environment, until it appeared the whitest. It was found that the CCT and light level of the real-world environment significantly affected the color appearance of the white stimulus, especially when the light level was high. Moreover, a lower degree of chromatic adaptation was found for viewing the virtual stimulus that was overlaid on the real world.

scholarly journals Multi-Dimensional Underwater Point Cloud Detection Based on Deep Learning

Sensors ◽  
2021 ◽  
Vol 21 (3) ◽  
pp. 884
Author(s):  
Chia-Ming Tsai ◽  
Yi-Horng Lai ◽  
Yung-Da Sun ◽  
Yu-Jen Chung ◽  
Jau-Woei Perng
Keyword(s):  
Deep Learning ◽  
Point Cloud ◽  
Three Dimensional ◽  
Point Clouds ◽  
Training Data ◽  
Network Architectures ◽  
Point Cloud Data ◽  
Data Types ◽  
Raw Data ◽  
Cloud Data

Numerous sensors can obtain images or point cloud data on land, however, the rapid attenuation of electromagnetic signals and the lack of light in water have been observed to restrict sensing functions. This study expands the utilization of two- and three-dimensional detection technologies in underwater applications to detect abandoned tires. A three-dimensional acoustic sensor, the BV5000, is used in this study to collect underwater point cloud data. Some pre-processing steps are proposed to remove noise and the seabed from raw data. Point clouds are then processed to obtain two data types: a 2D image and a 3D point cloud. Deep learning methods with different dimensions are used to train the models. In the two-dimensional method, the point cloud is transferred into a bird’s eye view image. The Faster R-CNN and YOLOv3 network architectures are used to detect tires. Meanwhile, in the three-dimensional method, the point cloud associated with a tire is cut out from the raw data and is used as training data. The PointNet and PointConv network architectures are then used for tire classification. The results show that both approaches provide good accuracy.

scholarly journals Comparison of Depth Camera and Terrestrial Laser Scanner in Monitoring Structural Deflections

Sensors ◽  
2020 ◽  
Vol 21 (1) ◽  
pp. 201
Author(s):  
Michael Bekele Maru ◽  
Donghwan Lee ◽  
Kassahun Demissie Tola ◽  
Seunghee Park
Keyword(s):  
Optical Sensors ◽  
Point Cloud ◽  
Three Dimensional ◽  
Laser Scanner ◽  
Point Clouds ◽  
Depth Camera ◽  
Terrestrial Laser Scanner ◽  
Cloud Data ◽  
3D Point Clouds ◽  
3D Information

Modeling a structure in the virtual world using three-dimensional (3D) information enhances our understanding, while also aiding in the visualization, of how a structure reacts to any disturbance. Generally, 3D point clouds are used for determining structural behavioral changes. Light detection and ranging (LiDAR) is one of the crucial ways by which a 3D point cloud dataset can be generated. Additionally, 3D cameras are commonly used to develop a point cloud containing many points on the external surface of an object around it. The main objective of this study was to compare the performance of optical sensors, namely a depth camera (DC) and terrestrial laser scanner (TLS) in estimating structural deflection. We also utilized bilateral filtering techniques, which are commonly used in image processing, on the point cloud data for enhancing their accuracy and increasing the application prospects of these sensors in structure health monitoring. The results from these sensors were validated by comparing them with the outputs from a linear variable differential transformer sensor, which was mounted on the beam during an indoor experiment. The results showed that the datasets obtained from both the sensors were acceptable for nominal deflections of 3 mm and above because the error range was less than ±10%. However, the result obtained from the TLS were better than those obtained from the DC.

Augmented Reality Berbasis Android Sebagai Media Pembelajaran Sistem Tata Surya

2021 ◽  
Vol 2 (1) ◽  
pp. 53-59
Author(s):  
Yulia Fatma ◽  
Armen Salim ◽  
Regiolina Hayami
Keyword(s):  
Augmented Reality ◽  
Solar System ◽  
Real Time ◽  
Real World ◽  
Virtual World ◽  
The Real ◽  
Virtual Objects ◽  
Augmented Reality Technology ◽  
The Revolution

Along with the development, the application can be used as a medium for learning. Augmented Reality is a technology that combines two-dimensional’s virtual objects and three-dimensional’s virtual objects into a real three-dimensional’s  then projecting the virtual objects in real time and simultaneously. The introduction of Solar System’s material, students are invited to get to know the planets which are directly encourage students to imagine circumtances in the Solar System. Explenational of planets form and how the planets make the revolution and rotation in books are considered less material’s explanation because its only display objects in 2D. In addition, students can not practice directly in preparing the layout of the planets in the Solar System. By applying Augmented Reality Technology, information’s learning delivery can be clarified, because in these applications are combined the real world and the virtual world. Not only display the material, the application also display images of planets in 3D animation’s objects with audio.

Sign in / Sign up

Export Citation Format

Share Document