A real-time interactive system of surface reconstruction and dynamic projection mapping with RGB-depth sensor and projector

Reconstruction and projection mapping enable us to bring virtual worlds into real spaces, which can give spectators an immersive augmented reality experience. Based on an interactive system with RGB-depth sensor and projector, we present a combined hardware and software solution for surface reconstruction and dynamic projection mapping in real time. In this article, a novel and adaptable calibration scheme is proposed, which is used to estimate approximate models to correct and transform raw depth data. Besides, our system allows for smooth real-time performance using an optimization framework, including denoising and stabilizing. In the entire pipeline, markers are only used in the calibration procedure, and any priors are not needed. Our approach enables us to interact with the target surface in real time, while maintaining correct illumination. It is easy and fast to develop different applications for our system, and some interesting cases are demonstrated at last.

Download Full-text

Projection Mapping User Interface for Disabled People

Journal of Healthcare Engineering ◽

10.1155/2018/6916204 ◽

2018 ◽

Vol 2018 ◽

pp. 1-6 ◽

Cited By ~ 2

Author(s):

Julius Gelšvartas ◽

Rimvydas Simutis ◽

Rytis Maskeliūnas

Keyword(s):

User Interface ◽

Calibration Procedure ◽

Assistive Technologies ◽

Mapping Technique ◽

Depth Sensor ◽

Projection Mapping ◽

User Input ◽

Multiple User ◽

Severe Motor ◽

Main Component

Difficulty in communicating is one of the key challenges for people suffering from severe motor and speech disabilities. Often such person can communicate and interact with the environment only using assistive technologies. This paper presents a multifunctional user interface designed to improve communication efficiency and person independence. The main component of this interface is a projection mapping technique used to highlight objects in the environment. Projection mapping makes it possible to create a natural augmented reality information presentation method. The user interface combines a depth sensor and a projector to create camera-projector system. We provide a detailed description of camera-projector system calibration procedure. The described system performs tabletop object detection and automatic projection mapping. Multiple user input modalities have been integrated into the multifunctional user interface. Such system can be adapted to the needs of people with various disabilities.

Download Full-text

Real-Time Internet of Things (IOT) Application Big Data Stream Graph Optimization Framework

International Journal of Computer Sciences and Engineering ◽

10.26438/ijcse/v7i8.163167 ◽

2019 ◽

Vol 7 (8) ◽

pp. 163-167

Author(s):

Sharmila G.

Keyword(s):

Big Data ◽

Internet Of Things ◽

Real Time ◽

Data Stream ◽

Optimization Framework ◽

Graph Optimization

Download Full-text

Mass Spectrometric Calibration Procedure for Real-Time Detection of Lighter Hydrocarbons

Energies ◽

10.3390/en14082123 ◽

2021 ◽

Vol 14 (8) ◽

pp. 2123

Author(s):

Makuachukwu F. Mbaegbu ◽

Puspa L. Adhikari ◽

Ipsita Gupta ◽

Mathew Rowe

Keyword(s):

Real Time ◽

Mass Spectrometer ◽

Calibration Procedure ◽

Mass Spectrometric ◽

Spectrometric Method ◽

Mass Selection ◽

Mass Spectrometric Method ◽

Mass Spectrometers ◽

Drilling Rig

Determining gas compositions from live well fluids on a drilling rig is critical for real time formation evaluation. Development and utilization of a reliable mass spectrometric method to accurately characterize these live well fluids are always challenging due to lack of a robust and effectively selective instrument and procedure. The methods currently utilized need better calibration for the characterization of light hydrocarbons (C1–C6) at lower concentrations. The primary goal of this research is to develop and optimize a powerful and reliable analytical method to characterize live well fluid using a quadruple mass spectrometer (MS). The mass spectrometers currently being used in the field have issues with detection, spectra deconvolution, and quantification of analytes at lower concentrations (10–500 ppm), particularly for the lighter (<30 m/z) hydrocarbons. The objectives of the present study are thus to identify the detection issues, develop and optimize a better method, calibrate and QA/QC the MS, and validate the MS method in lab settings. In this study, we used two mass spectrometers to develop a selective and precise method to quantitatively analyze low level lighter analytes (C1–C6 hydrocarbons) with masses <75 m/z at concentrations 10–500 ppm. Our results suggest that proper mass selection like using base peaks with m/z 15, 26, 41, 43, 73, and 87, respectively, for methane, ethane, propane, butane, pentane, and hexane can help detect and accurately quantify hydrocarbons from gas streams. This optimized method in quadrupole mass spectrometer (QMS) will be invaluable for early characterization of the fluid components from a live hydrocarbon well in the field in real time.

Download Full-text

High-Speed Dynamic Projection Mapping onto Human Arm with Realistic Skin Deformation

Applied Sciences ◽

10.3390/app11093753 ◽

2021 ◽

Vol 11 (9) ◽

pp. 3753

Author(s):

Hao-Lun Peng ◽

Yoshihiro Watanabe

Keyword(s):

User Interfaces ◽

High Speed ◽

Target Surface ◽

Human Vision ◽

Surface Model ◽

Projection Mapping ◽

Skin Deformation ◽

Human Arm ◽

Conventional Methods ◽

Joint Tracking

Dynamic projection mapping for a moving object according to its position and shape is fundamental for augmented reality to resemble changes on a target surface. For instance, augmenting the human arm surface via dynamic projection mapping can enhance applications in fashion, user interfaces, prototyping, education, medical assistance, and other fields. For such applications, however, conventional methods neglect skin deformation and have a high latency between motion and projection, causing noticeable misalignment between the target arm surface and projected images. These problems degrade the user experience and limit the development of more applications. We propose a system for high-speed dynamic projection mapping onto a rapidly moving human arm with realistic skin deformation. With the developed system, the user does not perceive any misalignment between the arm surface and projected images. First, we combine a state-of-the-art parametric deformable surface model with efficient regression-based accuracy compensation to represent skin deformation. Through compensation, we modify the texture coordinates to achieve fast and accurate image generation for projection mapping based on joint tracking. Second, we develop a high-speed system that provides a latency between motion and projection below 10 ms, which is generally imperceptible by human vision. Compared with conventional methods, the proposed system provides more realistic experiences and increases the applicability of dynamic projection mapping.

Download Full-text

Switching filtering method for interactive systems

Proceedings of the Institution of Mechanical Engineers Part I Journal of Systems and Control Engineering ◽

10.1177/0959651819836304 ◽

2019 ◽

Vol 233 (10) ◽

pp. 1340-1350

Author(s):

Junyi Hou ◽

Lei Yu ◽

Yifan Fang ◽

Shumin Fei

Keyword(s):

Real Time ◽

Subjective Evaluation ◽

Objective Evaluation ◽

Interactive Systems ◽

Interactive System ◽

The Real ◽

Noise Interference ◽

Filtering Method ◽

Time Performance ◽

Filtering Effect

Aiming at the problem that the mixed noise interference caused by the mixed projection noise system is not accurate and the real-time performance is poor, this article proposes an adaptive system switching filtering method based on Bayesian estimation switching rules. The method chooses joint bilateral filtering and improved adaptive median filtering as the filtering subsystems and selects the sub-filtering system suitable for the noise by switching rules to achieve the purpose of effectively removing noise. The simulation experiment was carried out by the self-developed human–computer interactive projection image system platform. Through the subjective evaluation, objective evaluation, and running time comparison analysis, a better filtering effect was achieved, and the balance between the filtering precision and the real-time performance of the interactive system was well obtained. Therefore, the proposed method can be widely applied to various human–computer interactive image filtering systems.

Download Full-text

Some Remarks on Ontological-Cognitive Structures in the Metaverse

Journal of Virtual Worlds Research ◽

10.4101/jvwr.v2i5.770 ◽

2010 ◽

Vol 2 (5) ◽

Cited By ~ 1

Author(s):

Luis Carlos Petry

Keyword(s):

Virtual Environments ◽

Real Time ◽

Virtual Worlds ◽

Cognitive Structures ◽

Genetic Epistemology ◽

Virtual Experiments ◽

Philosophical Basis ◽

Physical Experiments ◽

Physical Interfaces

Abstract: This paper aims to bring forth some ontological elements that we believe are fundamental to a wider philosophical basis of the Metaverses. We start from some indications presented by physical experiments which reproduce virtual environments in real time, searching for its eidetic-methodological relations with genetic epistemology and construtivism, showing that the structures of physical interfaces, which are founded in virtual experiments, dialogging with the concepts of body, mind, projection, cognition, and other concepts, which are present in the possible formulation of an ontology of the virtual worlds and the Metaverses. We conclude the paper with the idea of the necessity to think the issue of the ontological fundamentation of cyberspace and its metaverses.

Download Full-text