scholarly journals iCatcher+: Robust and automatic gaze classification of infant webcam videos

2021 ◽  
Author(s):  
Peng Cao ◽  
Xincheng Tan ◽  
Kimberly Megan Scott ◽  
Shari Liu

Studies of human infants provide a window into the origins of the mind, and collecting and annotating behavioral data from them remains slow and laborious. Although online platforms enable families to participate in studies via webcam, it remains time- and energy- consuming to manually annotate gaze directions on the collected videos. Existing gaze coding algorithms on videos either suffer from low video quality or still require considerable manual effort. In this project, we built on a promising system for automatic gaze annotation in human infants, iCatcher (Erel et al., 2020), and added two key additional features: a more robust infant face detector, and a gaze estimator that takes into account not only the features of the selected face, but where and how far it is from the screen. In our framework, iCatcher+, all possible faces in a video frame are first extracted by a face extractor, and then the infant face is selected by a infant selector; finally, the gaze direction is classified by a gaze estimator based on both the selected face and features of its bounding box. We evaluated iCatcher+ on a large-scale infant video dataset collected via webcam. The experimental results show improvements in gaze estimation accuracy, compared to the baseline framework. We see iCatcher+ as a key tool for enabling rapid large-scale studies of infant behavior.

Author(s):  
Robert C. Allen ◽  
Daniel P. McDonald ◽  
Michael J. Singer

The current paper describes our classification of errors participants made when estimating direction and distances in a large scale (2000 m × 2000 m) Virtual Environment (VE). Two VE configuration groups (Low or High Interactivity) traversed a 400 m route through one of two Virtual Terrain's (Distinctive or Non-Distinctive or Terrain 1 and 2, respectively) in 100 m increments. The High VE group used a treadmill to move through the VE with head tracked visual displays; the Low VE group used a joystick for movement and visual display control. Results indicate that as experience within either terrain increased, participants demonstrated an improved ability to directionally locate landmarks. Experience in the environment did not affect distance estimation accuracy. Terrain 1 participants were more accurate in locating proximal, as opposed to distal, landmarks. They also overestimated distances to near landmarks and underestimated distances to far landmarks. In Terrain 2, the Low VE group gave more accurate distance estimations. We believe this result can be explained in terms of increased task demands placed on the High VE Group.


2009 ◽  
pp. 27-53
Author(s):  
A. Yu. Kudryavtsev

Diversity of plant communities in the nature reserve “Privolzhskaya Forest-Steppe”, Ostrovtsovsky area, is analyzed on the basis of the large-scale vegetation mapping data from 2000. The plant community classi­fication based on the Russian ecologic-phytocoenotic approach is carried out. 12 plant formations and 21 associations are distinguished according to dominant species and a combination of ecologic-phytocoenotic groups of species. A list of vegetation classification units as well as the characteristics of theshrub and woody communities are given in this paper.


1996 ◽  
pp. 64-67 ◽  
Author(s):  
Nguen Nghia Thin ◽  
Nguen Ba Thu ◽  
Tran Van Thuy

The tropical seasonal rainy evergreen broad-leaved forest vegetation of the Cucphoung National Park has been classified and the distribution of plant communities has been shown on the map using the relations of vegetation to geology, geomorphology and pedology. The method of vegetation mapping includes: 1) the identifying of vegetation types in the remote-sensed materials (aerial photographs and satellite images); 2) field work to compile the interpretation keys and to characterize all the communities of a study area; 3) compilation of the final vegetation map using the combined information. In the classification presented a number of different level vegetation units have been identified: formation classes (3), formation sub-classes (3), formation groups (3), formations (4), subformations (10) and communities (19). Communities have been taken as mapping units. So in the vegetation map of the National Park 19 vegetation categories has been shown altogether, among them 13 are natural primary communities, and 6 are the secondary, anthropogenic ones. The secondary succession goes through 3 main stages: grassland herbaceous xerophytic vegetation, xerophytic scrub, dense forest.


2020 ◽  
Author(s):  
Thomas Gaisl ◽  
Naser Musli ◽  
Patrick Baumgartner ◽  
Marc Meier ◽  
Silvana K Rampini ◽  
...  

BACKGROUND The health aspects, disease frequencies, and specific health interests of prisoners and refugees are poorly understood. Importantly, access to the health care system is limited for this vulnerable population. There has been no systematic investigation to understand the health issues of inmates in Switzerland. Furthermore, little is known on how recent migration flows in Europe may have affected the health conditions of inmates. OBJECTIVE The Swiss Prison Study (SWIPS) is a large-scale observational study with the aim of establishing a public health registry in northern-central Switzerland. The primary objective is to establish a central database to assess disease prevalence (ie, International Classification of Diseases-10 codes [German modification]) among prisoners. The secondary objectives include the following: (1) to compare the 2015 versus 2020 disease prevalence among inmates against a representative sample from the local resident population, (2) to assess longitudinal changes in disease prevalence from 2015 to 2020 by using cross-sectional medical records from all inmates at the Police Prison Zurich, Switzerland, and (3) to identify unrecognized health problems to prepare successful public health strategies. METHODS Demographic and health-related data such as age, sex, country of origin, duration of imprisonment, medication (including the drug name, brand, dosage, and release), and medical history (including the International Classification of Diseases-10 codes [German modification] for all diagnoses and external results that are part of the medical history in the prison) have been deposited in a central register over a span of 5 years (January 2015 to August 2020). The final cohort is expected to comprise approximately 50,000 to 60,000 prisoners from the Police Prison Zurich, Switzerland. RESULTS This study was approved on August 5, 2019 by the ethical committee of the Canton of Zurich with the registration code KEK-ZH No. 2019-01055 and funded in August 2020 by the “Walter and Gertrud Siegenthaler” foundation and the “Theodor and Ida Herzog-Egli” foundation. This study is registered with the International Standard Randomized Controlled Trial Number registry. Data collection started in August 2019 and results are expected to be published in 2021. Findings will be disseminated through scientific papers as well as presentations and public events. CONCLUSIONS This study will construct a valuable database of information regarding the health of inmates and refugees in Swiss prisons and will act as groundwork for future interventions in this vulnerable population. CLINICALTRIAL ISRCTN registry ISRCTN11714665; http://www.isrctn.com/ISRCTN11714665 INTERNATIONAL REGISTERED REPORT DERR1-10.2196/23973


Author(s):  
Mathieu Turgeon-Pelchat ◽  
Samuel Foucher ◽  
Yacine Bouroubi

Computers ◽  
2021 ◽  
Vol 10 (6) ◽  
pp. 82
Author(s):  
Ahmad O. Aseeri

Deep Learning-based methods have emerged to be one of the most effective and practical solutions in a wide range of medical problems, including the diagnosis of cardiac arrhythmias. A critical step to a precocious diagnosis in many heart dysfunctions diseases starts with the accurate detection and classification of cardiac arrhythmias, which can be achieved via electrocardiograms (ECGs). Motivated by the desire to enhance conventional clinical methods in diagnosing cardiac arrhythmias, we introduce an uncertainty-aware deep learning-based predictive model design for accurate large-scale classification of cardiac arrhythmias successfully trained and evaluated using three benchmark medical datasets. In addition, considering that the quantification of uncertainty estimates is vital for clinical decision-making, our method incorporates a probabilistic approach to capture the model’s uncertainty using a Bayesian-based approximation method without introducing additional parameters or significant changes to the network’s architecture. Although many arrhythmias classification solutions with various ECG feature engineering techniques have been reported in the literature, the introduced AI-based probabilistic-enabled method in this paper outperforms the results of existing methods in outstanding multiclass classification results that manifest F1 scores of 98.62% and 96.73% with (MIT-BIH) dataset of 20 annotations, and 99.23% and 96.94% with (INCART) dataset of eight annotations, and 97.25% and 96.73% with (BIDMC) dataset of six annotations, for the deep ensemble and probabilistic mode, respectively. We demonstrate our method’s high-performing and statistical reliability results in numerical experiments on the language modeling using the gating mechanism of Recurrent Neural Networks.


2021 ◽  
Vol 1757 (1) ◽  
pp. 012121
Author(s):  
Mengting Song ◽  
Hang Zheng ◽  
Zhen Tao ◽  
Jia Jiang ◽  
Bin Pan
Keyword(s):  

Author(s):  
René Selbmann ◽  
Markus Baumann ◽  
Mateus Dobecki ◽  
Markus Bergmann ◽  
Verena Kräusel ◽  
...  

AbstractThe residual stress distribution in extruded components and wires after a conventional forming process is frequently unfavourable for subsequent processes, such as bending operations. High tensile residual stresses typically occur near the surface of the wire and thus limit further processability of the material. Additional heat treatment operations or shot peening are often inserted to influence the residual stress distribution in the material after conventional manufacturing. This is time and energy consuming. The research presented in this paper contains an approach to influence the residual stress distribution by modifying the forming process for wire-like applications. The aim of this process is to lower the resulting tensile stress levels near the surface or even to generate compressive stresses. To achieve these residual compressive stresses, special forming elements are integrated in the dies. These modifications in the forming zone have a significant influence on process properties, such as degree of deformation and deformation direction, but typically have no influence on the diameter of the product geometry. In the present paper, the theoretical approach is described, as well as the model set-up, the FE-simulation and the results of the experimental tests. The characterization of the residual stress states in the specimen was carried out by X-ray diffraction using the sin2Ψ method.


2019 ◽  
Vol 12 (1) ◽  
pp. 96 ◽  
Author(s):  
James Brinkhoff ◽  
Justin Vardanega ◽  
Andrew J. Robson

Land cover mapping of intensive cropping areas facilitates an enhanced regional response to biosecurity threats and to natural disasters such as drought and flooding. Such maps also provide information for natural resource planning and analysis of the temporal and spatial trends in crop distribution and gross production. In this work, 10 meter resolution land cover maps were generated over a 6200 km2 area of the Riverina region in New South Wales (NSW), Australia, with a focus on locating the most important perennial crops in the region. The maps discriminated between 12 classes, including nine perennial crop classes. A satellite image time series (SITS) of freely available Sentinel-1 synthetic aperture radar (SAR) and Sentinel-2 multispectral imagery was used. A segmentation technique grouped spectrally similar adjacent pixels together, to enable object-based image analysis (OBIA). K-means unsupervised clustering was used to filter training points and classify some map areas, which improved supervised classification of the remaining areas. The support vector machine (SVM) supervised classifier with radial basis function (RBF) kernel gave the best results among several algorithms trialled. The accuracies of maps generated using several combinations of the multispectral and radar bands were compared to assess the relative value of each combination. An object-based post classification refinement step was developed, enabling optimization of the tradeoff between producers’ accuracy and users’ accuracy. Accuracy was assessed against randomly sampled segments, and the final map achieved an overall count-based accuracy of 84.8% and area-weighted accuracy of 90.9%. Producers’ accuracies for the perennial crop classes ranged from 78 to 100%, and users’ accuracies ranged from 63 to 100%. This work develops methods to generate detailed and large-scale maps that accurately discriminate between many perennial crops and can be updated frequently.


2015 ◽  
Vol 19 (9) ◽  
pp. 3845-3856 ◽  
Author(s):  
F. Todisco ◽  
L. Brocca ◽  
L. F. Termite ◽  
W. Wagner

Abstract. The potential of coupling soil moisture and a Universal Soil Loss Equation-based (USLE-based) model for event soil loss estimation at plot scale is carefully investigated at the Masse area, in central Italy. The derived model, named Soil Moisture for Erosion (SM4E), is applied by considering the unavailability of in situ soil moisture measurements, by using the data predicted by a soil water balance model (SWBM) and derived from satellite sensors, i.e., the Advanced SCATterometer (ASCAT). The soil loss estimation accuracy is validated using in situ measurements in which event observations at plot scale are available for the period 2008–2013. The results showed that including soil moisture observations in the event rainfall–runoff erosivity factor of the USLE enhances the capability of the model to account for variations in event soil losses, the soil moisture being an effective alternative to the estimated runoff, in the prediction of the event soil loss at Masse. The agreement between observed and estimated soil losses (through SM4E) is fairly satisfactory with a determination coefficient (log-scale) equal to ~ 0.35 and a root mean square error (RMSE) of ~ 2.8 Mg ha−1. These results are particularly significant for the operational estimation of soil losses. Indeed, currently, soil moisture is a relatively simple measurement at the field scale and remote sensing data are also widely available on a global scale. Through satellite data, there is the potential of applying the SM4E model for large-scale monitoring and quantification of the soil erosion process.


Sign in / Sign up

Export Citation Format

Share Document