scholarly journals Low-Complexity Pupil Tracking for Sunglasses-Wearing Faces for Glasses-Free 3D HUDs

2021 ◽  
Vol 11 (10) ◽  
pp. 4366
Author(s):  
Dongwoo Kang ◽  
Hyun Sung Chang

This study proposes a pupil-tracking method applicable to drivers both with and without sunglasses on, which has greater compatibility with augmented reality (AR) three-dimensional (3D) head-up displays (HUDs). Performing real-time pupil localization and tracking is complicated by drivers wearing facial accessories such as masks, caps, or sunglasses. The proposed method fulfills two key requirements: low complexity and algorithm performance. Our system assesses both bare and sunglasses-wearing faces by first classifying images according to these modes and then assigning the appropriate eye tracker. For bare faces with unobstructed eyes, we applied our previous regression-algorithm-based method that uses scale-invariant feature transform features. For eyes occluded by sunglasses, we propose an eye position estimation method: our eye tracker uses nonoccluded face area tracking and a supervised regression-based pupil position estimation method to locate pupil centers. Experiments showed that the proposed method achieved high accuracy and speed, with a precision error of <10 mm in <5 ms for bare and sunglasses-wearing faces for both a 2.5 GHz CPU and a commercial 2.0 GHz CPU vehicle-embedded system. Coupled with its performance, the low CPU consumption (10%) demonstrated by the proposed algorithm highlights its promise for implementation in AR 3D HUD systems.

2010 ◽  
Vol E93-B (8) ◽  
pp. 2211-2214
Author(s):  
Bin SHENG ◽  
Pengcheng ZHU ◽  
Xiaohu YOU ◽  
Lan CHEN

Author(s):  
Xiao Chen ◽  
Zaichen Zhang ◽  
Liang Wu ◽  
Jian Dang

Abstract In this journal, we investigate the beam-domain channel estimation and power allocation in hybrid architecture massive multiple-input and multiple-output (MIMO) communication systems. First, we propose a low-complexity channel estimation method, which utilizes the beam steering vectors achieved from the direction-of-arrival (DOA) estimation and beam gains estimated by low-overhead pilots. Based on the estimated beam information, a purely analog precoding strategy is also designed. Then, the optimal power allocation among multiple beams is derived to maximize spectral efficiency. Finally, simulation results show that the proposed schemes can achieve high channel estimation accuracy and spectral efficiency.


Electronics ◽  
2021 ◽  
Vol 10 (14) ◽  
pp. 1715
Author(s):  
Michele Alessandrini ◽  
Giorgio Biagetti ◽  
Paolo Crippa ◽  
Laura Falaschetti ◽  
Claudio Turchetti

Photoplethysmography (PPG) is a common and practical technique to detect human activity and other physiological parameters and is commonly implemented in wearable devices. However, the PPG signal is often severely corrupted by motion artifacts. The aim of this paper is to address the human activity recognition (HAR) task directly on the device, implementing a recurrent neural network (RNN) in a low cost, low power microcontroller, ensuring the required performance in terms of accuracy and low complexity. To reach this goal, (i) we first develop an RNN, which integrates PPG and tri-axial accelerometer data, where these data can be used to compensate motion artifacts in PPG in order to accurately detect human activity; (ii) then, we port the RNN to an embedded device, Cloud-JAM L4, based on an STM32 microcontroller, optimizing it to maintain an accuracy of over 95% while requiring modest computational power and memory resources. The experimental results show that such a system can be effectively implemented on a constrained-resource system, allowing the design of a fully autonomous wearable embedded system for human activity recognition and logging.


2021 ◽  
Vol 13 (15) ◽  
pp. 2997
Author(s):  
Zheng Zhao ◽  
Weiming Tian ◽  
Yunkai Deng ◽  
Cheng Hu ◽  
Tao Zeng

Wideband multiple-input-multiple-output (MIMO) imaging radar can achieve high-resolution imaging with a specific multi-antenna structure. However, its imaging performance is severely affected by the array errors, including the inter-channel errors and the position errors of all the transmitting and receiving elements (TEs/REs). Conventional calibration methods are suitable for the narrow-band signal model, and cannot separate the element position errors from the array errors. This paper proposes a method for estimating and compensating the array errors of wideband MIMO imaging radar based on multiple prominent targets. Firstly, a high-precision target position estimation method is proposed to acquire the prominent targets’ positions without other equipment. Secondly, the inter-channel amplitude and delay errors are estimated by solving an equation-constrained least square problem. After this, the element position errors are estimated with the genetic algorithm to eliminate the spatial-variant error phase. Finally, the feasibility and correctness of this method are validated with both simulated and experimental datasets.


2020 ◽  
Vol 57 (12) ◽  
pp. 1392-1401
Author(s):  
Mark P. Pressler ◽  
Emily L. Geisler ◽  
Rami R. Hallac ◽  
James R. Seaward ◽  
Alex A. Kane

Introduction and Objectives: Surgical treatment for trigonocephaly aims to eliminate a stigmatizing deformity, yet the severity that captures unwanted attention is unknown. Surgeons intervene at different points of severity, eliciting controversy. This study used eye tracking to investigate when deformity is perceived. Material and Methods: Three-dimensional photogrammetric images of a normal child and a child with trigonocephaly were mathematically deformed, in 10% increments, to create a spectrum of 11 images. These images were shown to participants using an eye tracker. Participants’ gaze patterns were analyzed, and participants were asked if each image looked “normal” or “abnormal.” Results: Sixty-six graduate students were recruited. Average dwell time toward pathologic areas of interest (AOIs) increased proportionally, from 0.77 ± 0.33 seconds at 0% deformity to 1.08 ± 0.75 seconds at 100% deformity ( P < .0001). A majority of participants did not agree an image looked “abnormal” until 90% deformity from any angle. Conclusion: Eye tracking can be used as a proxy for attention threshold toward orbitofrontal deformity. The amount of attention toward orbitofrontal AOIs increased proportionally with severity. Participants did not generally agree there was “abnormality” until deformity was severe. This study supports the assertion that surgical intervention may be best reserved for more severe deformity.


Sign in / Sign up

Export Citation Format

Share Document