scholarly journals Real-time face view correction for front-facing cameras

2021 ◽  
Author(s):  
Yudong Guo ◽  
Juyong Zhang ◽  
Yihua Chen ◽  
Hongrui Cai ◽  
Zhangjin Huang ◽  
...  
Keyword(s):  
Real Time ◽  
Video Stream ◽  
High Quality ◽  
Virtual Camera ◽  
Face Shape ◽  
Lighting Conditions ◽  
Out Of Plane ◽  
Camera Location ◽  
The Face ◽  
Head Rotations

AbstractFace views are particularly important in person-to-person communication. Differenes between the camera location and the face orientation can result in undesirable facial appearances of the participants during video conferencing. This phenomenon is particularly noticeable when using devices where the front-facing camera is placed in unconventional locations such as below the display or within the keyboard. In this paper, we take a video stream from a single RGB camera as input, and generate a video stream that emulates the view from a virtual camera at a designated location. The most challenging issue in this problem is that the corrected view often needs out-of-plane head rotations. To address this challenge, we reconstruct the 3D face shape and re-render it into synthesized frames according to the virtual camera location. To output the corrected video stream with natural appearance in real time, we propose several novel techniques including accurate eyebrow reconstruction, high-quality blending between the corrected face image and background, and template-based 3D reconstruction of glasses. Our system works well for different lighting conditions and skin tones, and can handle users wearing glasses. Extensive experiments and user studies demonstrate that our method provides high-quality results.

Implementation of Video Capture Based on DirectShow Technology

2011 ◽  
Vol 65 ◽  
pp. 113-116
Author(s):  
Qi Li ◽  
Yan Dong Zhang
Keyword(s):  
Real Time ◽  
Video Stream ◽  
Software System ◽  
Test Results ◽  
Video Capture ◽  
High Quality ◽  
Design Scheme

The basic conception of DirectShow is introduced, to conquer the limitation of the major capture plans that the picture forms obtained from different device that are difficult to deal with, by the filter graph is built, a design scheme of video capture software system based on DirectShow is presented, which is based on Windows and give supports to different drive models and different interface ; the structure of the software is discussed, software has reusability .Test results show that the system can run steadily and reliably, and has the characteristics of real time ,high quality of the video stream; the system is flexible and expansive.

scholarly journals A study on the solid image projection mapping system in the curved display of the face shape for the performance art

2018 ◽  
Vol 7 (3.3) ◽  
pp. 111
Author(s):  
Eun Seo Song ◽  
Gil Sang Yoo ◽  
Sung Dae Hong
Keyword(s):  
Real Time ◽  
Three Dimensional ◽  
Advanced Technology ◽  
Actual Object ◽  
Projection Mapping ◽  
Face Shape ◽  
Three Dimensional Mapping ◽  
Mapping Technology ◽  
The Face ◽  
Multi Phase

Background/Objectives: Aims to study the projection mapping technology which will project the multi-phase solid image in the curved display real time in the performance.Methods/Statistical analysis: Analyze the shape of the object to be mapped for the project and based on the analyzed characteristics, the structure of the installation of the applicable project to the actual object and the projection mapping production tool shall be developed and be applied to the elastic shape.Findings: According to the analysis result of the curved display, one projector did not suit the image and the distortion of the image occurred. According, it was divided into the four sections and projection mapping was made to minimize the problems, and the projection production tool which applied the geometric matching technology, edge blending technology, UDP telecommunication method etc based on the grid for the image matching using the Max/Msp was developed and the actual face shaped curved display was applied.Improvements/Applications: In order to conduct projection map precisely to the actuator moving real time, Z-depth should be considered and the advanced technology which matches the three dimensional mapping image should be applied.  

Creating adaptive predictions for packaging-critical quality parameters using advanced analytics and machine learning

TAPPI Journal ◽  
2019 ◽  
Vol 18 (11) ◽  
pp. 679-689
Author(s):  
CYDNEY RECHTIN ◽  
CHITTA RANJAN ◽  
ANTHONY LEWIS ◽  
BETH ANN ZARKO
Keyword(s):  
Machine Learning ◽  
Real Time ◽  
Predictive Analytics ◽  
Paper Industry ◽  
Quality Parameters ◽  
Fast Change ◽  
The Face ◽  
Model Tuning ◽  
Reducing Costs ◽  
Time Critical

Packaging manufacturers are challenged to achieve consistent strength targets and maximize production while reducing costs through smarter fiber utilization, chemical optimization, energy reduction, and more. With innovative instrumentation readily accessible, mills are collecting vast amounts of data that provide them with ever increasing visibility into their processes. Turning this visibility into actionable insight is key to successfully exceeding customer expectations and reducing costs. Predictive analytics supported by machine learning can provide real-time quality measures that remain robust and accurate in the face of changing machine conditions. These adaptive quality “soft sensors” allow for more informed, on-the-fly process changes; fast change detection; and process control optimization without requiring periodic model tuning. The use of predictive modeling in the paper industry has increased in recent years; however, little attention has been given to packaging finished quality. The use of machine learning to maintain prediction relevancy under everchanging machine conditions is novel. In this paper, we demonstrate the process of establishing real-time, adaptive quality predictions in an industry focused on reel-to-reel quality control, and we discuss the value created through the availability and use of real-time critical quality.

Sky Segmentation for Enhanced Depth Reconstruction and Bokeh Rendering with Efficient Architectures

2020 ◽  
Vol 2020 (14) ◽  
pp. 378-1-378-7
Author(s):  
Tyler Nuanes ◽  
Matt Elsey ◽  
Radek Grzeszczuk ◽  
John Paul Shen
Keyword(s):  
Real Time ◽  
Mobile Device ◽  
Computational Cost ◽  
False Positives ◽  
Compact Model ◽  
High Quality ◽  
False Negatives ◽  
Trade Off ◽  
Depth Reconstruction ◽  
Binary Classifiers

We present a high-quality sky segmentation model for depth refinement and investigate residual architecture performance to inform optimally shrinking the network. We describe a model that runs in near real-time on mobile device, present a new, highquality dataset, and detail a unique weighing to trade off false positives and false negatives in binary classifiers. We show how the optimizations improve bokeh rendering by correcting stereo depth misprediction in sky regions. We detail techniques used to preserve edges, reject false positives, and ensure generalization to the diversity of sky scenes. Finally, we present a compact model and compare performance of four popular residual architectures (ShuffleNet, MobileNetV2, Resnet-101, and Resnet-34-like) at constant computational cost.

ALGORITHMS FOR IMAGE PRE-PROCESSING IN THE FACE IDENTIFICATION SYSTEM IN THE VIDEO STREAM

2019 ◽  
Vol 4 (91) ◽  
pp. 21-29 ◽  
Author(s):  
Yaroslav Trofimenko ◽  
Lyudmila Vinogradova ◽  
Evgeniy Ershov
Keyword(s):  
Video Stream ◽  
Face Identification ◽  
Identification System ◽  
The Face

Real Time Person Recognition and Attendance Marking Using Holistic Based Approach

2017 ◽  
Vol 7 (7) ◽  
pp. 302
Author(s):  
Reshma P ◽  
Muneer VK ◽  
Muhammed Ilyas P
Keyword(s):  
Face Recognition ◽  
Real Time ◽  
High Accuracy ◽  
Efficient Technique ◽  
Human Face ◽  
Traditional Methods ◽  
Person Recognition ◽  
The Face

Face recognition is a challenging task for the researches. It is very useful for personal verification and recognition and also it is very difficult to implement due to all different situation that a human face can be found. This system makes use of the face recognition approach for the computerized attendance marking of students or employees in the room environment without lectures intervention or the employee. This system is very efficient and requires very less maintenance compared to the traditional methods. Among existing methods PCA is the most efficient technique. In this project Holistic based approach is adapted. The system is implemented using MATLAB and provides high accuracy.

Real Time Gender and Age Prediction using Deep Learning Techniques

2020 ◽  
Vol 9 (6) ◽  
pp. 797-801
Keyword(s):  
Deep Learning ◽  
Face Recognition ◽  
Real Time ◽  
Vital Role ◽  
Learning Techniques ◽  
Gender And Age ◽  
The Face ◽  
And Gender ◽  
Gender Detection ◽  
Age Prediction

Face recognition plays a vital role in security purpose. In recent years, the researchers have focused on the pose illumination, face recognition, etc,. The traditional methods of face recognition focus on Open CV’s fisher faces which results in analyzing the face expressions and attributes. Deep learning method used in this proposed system is Convolutional Neural Network (CNN). Proposed work includes the following modules: [1] Face Detection [2] Gender Recognition [3] Age Prediction. Thus the results obtained from this work prove that real time age and gender detection using CNN provides better accuracy results compared to other existing approaches.

Research on Improved Gamma Transform Face Image Preprocessing Fusion Algorithm under Complex Lighting Conditions

2020 ◽  
Vol 13 ◽  
Author(s):  
Xiaolin Tang ◽  
Xiaogang Wang ◽  
Jin Hou ◽  
Huafeng Wu ◽  
Ping He
Keyword(s):  
Edge Detection ◽  
Face Image ◽  
Light Sources ◽  
Fusion Algorithm ◽  
Edge Information ◽  
Image Preprocessing ◽  
Lighting Conditions ◽  
Weighted Fusion ◽  
The Face ◽  
Sobel Edge Detection

Introduction: Under complex illumination conditions such as poor light sources and light changes rapidly, there are two disadvantages of current gamma transform in preprocessing face image: one is that the parameters of transformation need to be set based on experience; the other is the details of the transformed image are not obvious enough. Objective: Improve the current gamma transform. Methods: This paper proposes a weighted fusion algorithm of adaptive gamma transform and edge feature extraction. First, this paper proposes an adaptive gamma transform algorithm for face image preprocessing, that is, the parameter of transformation generated by calculation according to the specific gray value of the input face image. Secondly, this paper uses Sobel edge detection operator to extract the edge information of the transformed image to get the edge detection image. Finally, this paper uses the adaptively transformed image and the edge detection image to obtain the final processing result through a weighted fusion algorithm. Results: The contrast of the face image after preprocessing is appropriate, and the details of the image are obvious. Conclusion: The method proposed in this paper can enhance the face image while retaining more face details, without human-computer interaction, and has lower computational complexity degree.

scholarly journals Global optimization of an encapsulated Si/SiO$$_2$$ L3 cavity with a 43 million quality factor

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
J. P. Vasco ◽  
V. Savona
Keyword(s):  
Global Optimization ◽  
Photonic Crystal ◽  
Quality Factor ◽  
State Of The Art ◽  
Optimization Strategy ◽  
High Quality ◽  
Optimal Value ◽  
Out Of Plane ◽  
Fabrication Tolerances ◽  
Structural Imperfections

AbstractWe optimize a silica-encapsulated silicon L3 photonic crystal cavity for ultra-high quality factor by means of a global optimization strategy, where the closest holes surrounding the cavity are varied to minimize out-of-plane losses. We find an optimal value of $$Q_c=4.33\times 10^7$$ Q c = 4.33 × 10 7 , which is predicted to be in the 2 million regime in presence of structural imperfections compatible with state-of-the-art silicon fabrication tolerances.

Sign in / Sign up

Export Citation Format

Share Document