scholarly journals Person Re-ID by Fusion of Video Silhouettes and Wearable Signals for Home Monitoring Applications

Sensors ◽  
2020 ◽  
Vol 20 (9) ◽  
pp. 2576
Author(s):  
Alessandro Masullo ◽  
Tilo Burghardt ◽  
Dima Damen ◽  
Toby Perrett ◽  
Majid Mirmehdi

The use of visual sensors for monitoring people in their living environments is critical in processing more accurate health measurements, but their use is undermined by the issue of privacy. Silhouettes, generated from RGB video, can help towards alleviating the issue of privacy to some considerable degree. However, the use of silhouettes would make it rather complex to discriminate between different subjects, preventing a subject-tailored analysis of the data within a free-living, multi-occupancy home. This limitation can be overcome with a strategic fusion of sensors that involves wearable accelerometer devices, which can be used in conjunction with the silhouette video data, to match video clips to a specific patient being monitored. The proposed method simultaneously solves the problem of Person ReID using silhouettes and enables home monitoring systems to employ sensor fusion techniques for data analysis. We develop a multimodal deep-learning detection framework that maps short video clips and accelerations into a latent space where the Euclidean distance can be measured to match video and acceleration streams. We train our method on the SPHERE Calorie Dataset, for which we show an average area under the ROC curve of 76.3% and an assignment accuracy of 77.4%. In addition, we propose a novel triplet loss for which we demonstrate improving performances and convergence speed.

2019 ◽  
Vol 17 (2) ◽  
pp. 147470491983972 ◽  
Author(s):  
Chunna Hou ◽  
Zhijun Liu

Researchers have found that compared with other existing conditions (e.g., pleasantness), information relevant to survival produced a higher rate of retrieval; this effect is known as the survival processing advantage (SPA). Previous experiments have examined that the advantage of memory can be extended to some different types of visual pictorial material, such as pictures and short video clips, but there were some arguments for whether face stimulus could be seen as a boundary condition of SPA. The current work explores whether there is a mnemonic advantage to different trustworthiness of face for human adaptation. In two experiments, we manipulated the facial trustworthiness (untrustworthy, neutral, and trustworthy), which is believed to provide information regarding survival decisions. Participants were asked to predict their avoidance or approach response tendency, when encountering strangers (represented by three classified faces of trustworthiness) in a survival scenario and the control scenario. The final surprise memory tests revealed that it was better to recognize both the trustworthy faces and untrustworthy faces, when the task was related to survival. Experiment 1 demonstrated the existence of a SPA in the bipolarity of facial untrustworthiness and trustworthiness. In Experiment 2, we replicated the SPA of trustworthy and untrustworthy face recognitions using a matched design, where we found this kind of memory benefits only in recognition tasks but not in source memory tasks. These results extend the generality of SPAs to face domain.


Pythagoras ◽  
2010 ◽  
Vol 0 (72) ◽  
Author(s):  
Helmut Linneweber‐Lammerskitten ◽  
Marc Schäfer ◽  
Duncan Samson

This paper describes a collaborative research and development project between the University of Applied Sciences Northwestern Switzerland and Rhodes University in South Africa. The project seeks to establish, disseminate and research the efficacy and use of short video clips designed specifically for the autonomous learning of mathematics. Specific to the South African context is our interest in capitalising on the ubiquity of cellphone technology and the autonomous affordances offered by mobile learning. This paper engages with a number of theoretical and pedagogical issues relating to the design, production and use of these video clips. Although the focus is specific to the contexts of South Africa and Switzerland, the discussion is of broad applicability.


2020 ◽  
Vol 1 ◽  
Author(s):  
G. Collavo ◽  
A. Lalayev ◽  
S. Angerer ◽  
M. Kraml ◽  
S. Bachner ◽  
...  

In this project, high school students (aged 16-17) tested various protocols of experiments in nanotechnology and evaluated them whether such experiments could also be performed by middle school students (aged 11-15) or even elementary school students (aged 6-10). Protocols pre-selected and provided by the instructing team consisting of Sciencetainment and the Department of Biosciences, University of Salzburg were applied. Laboratory techniques such as thin-layer chromatography, measuring the contact angle by high-resolution 3D microscopy and analyzing and constructing surface layers represented some of the experiments performed. Moreover, students produced short video clips and images and designed photo-collages out of microscopic and electron microscopic pictures. Hence, the school students acquired a number of soft skills during this special science day. 


Sensors ◽  
2020 ◽  
Vol 20 (5) ◽  
pp. 1321 ◽  
Author(s):  
Enrique Villa ◽  
Natalia Arteaga-Marrero ◽  
Juan Ruiz-Alzola

Thermal imaging is a promising technology in the medical field. Recent developments in low-cost infrared (IR) sensors, compatible with smartphones, provide competitive advantages for home-monitoring applications. However, these sensors present reduced capabilities compared to more expensive high-end devices. In this work, the characterization of thermal cameras is described and carried out. This characterization includes non-uniformity (NU) effects and correction as well as the thermal cameras’ dependence on room temperature, noise-equivalent temperature difference (NETD), and response curve stability with temperature. Results show that low-cost thermal cameras offer good performance, especially when used in temperature-controlled environments, providing evidence of the suitability of such sensors for medical applications, particularly in the assessment of diabetic foot ulcers on which we focused this study.


2018 ◽  
Vol 22 (2) ◽  
pp. 220-229 ◽  
Author(s):  
Thalia R. Goldstein ◽  
Aline Filipe

Acting is everywhere: TV, movies, and theater. Yet psychologists know surprisingly little about how acting is processed and understood by viewers. This is despite popular, scholarly, and journalistic obsession both with how actors are able to create characters with fully realized personalities, emotional arcs, physical attributes, and skills, and with whether actors and their characters merge during or after performance. Theoretically, there are several possibilities for how audience members process actors and acting: as literary fiction; as if someone is telling a lie; like essentialist traits and states; or like the personalities and emotions of real people in our every day lives. The authors consider each of these possibilities in turn. They then present 3 studies investigating the amount audiences conflate actors’ and characters’ characteristics ( N = 231) by asking participants directly how much they perceive actors as experiencing the characteristics they portray (Study 1), by showing short video clips of actors and asking participants how much they thought actors were experiencing what they portrayed (Study 2) and by asking participants to judge the overlap in personality characteristics between actors and characters (Study 3). Overall, audience members are conflating actors and their characters. However, how much depends on the characteristic being portrayed and the knowledge of the audience. We propose a theoretical model of when and how audience members think of actors and their characters as blended, and we lay out a research agenda to determine how acting and actors are understood.


Author(s):  
Kim Shearer ◽  
Svetha Venkatesh ◽  
Dorota Kieronska

One of the results of the surge in interest in the internet is the great increase in availability of pictorial and video data. Web browsers such as Netscape give access to an enormous range of such data. In order to make use of large amounts of pictorial and video data, it is necessary to develop indexing and retrieval methods.Pictorial databases have made great progress recently, to theextent that there are now a number of commercially available products. Video databases are now being researched and developed from a number ofdifferent viewpoints.Given a general indexing scheme for video, the next step is to reuse clipsin further applications. In this paper we present an initial application for the reuse of video clips. The aim of the system is to resequence video clips for a particularapplication. We have chosen a well-constrained application for this purpose,the aim being to produce a video tour of a campus between designatedstart and destination points from a set of indexed videoclips. We use clips of a guide entering and leaving buildings on ourcampus, and when visitors select a start location and a destination, the systemwill retrieve clips suitable for guiding the visitor along the correct path.The system uses an index of spatial relationships of key objects for thevideo clips to decide which clips provide the correct sequence of motionaround the campus. Although the full power of the indexing notation is unnecessary for this simple problem, the results from this initial implementation indicate that the concept could be applicable to more complex problems.


2016 ◽  
Vol 22 (1) ◽  
pp. 47-64 ◽  
Author(s):  
Nobuhiro Kamiya

This study investigated how learners’ ages affect their interpretation of the nonverbal behaviors (NVBs) of teachers and other students in distinguishing between questions and statements in the second language (L2) classroom. After watching 48 short video clips without sound in which three L2 teachers asked a question or made a statement with or without gesture, 36 elementary school pupils and 30 university students judged whether they thought the teachers asked a question or made a statement along with their reasons. The findings show that, regardless of learners’ ages, L2 teacher’s gestures were found to help learners better identify questions. Furthermore, the six major types of NVBs used for judgments most frequently were identical across the two age groups regardless of the accuracy of their judgments. Nevertheless, incorrect judgments were made as often and sometimes even more often than correct judgments by applying the same assumptions. The effect of age was evidenced in that the university students were able to use a larger number of NVBs for correct judgments, and better distinguish questions and statements without linguistic information than the elementary school pupils. The data suggest that it is the learners’ (L2) classroom experience that seems to be playing the major role in yielding this difference. The study indicates that adult L2 learners are better able than children to incorporate and interpret NVBs of teachers as well as other students quantitatively and qualitatively.


2018 ◽  
Author(s):  
Hilmar Brohmer ◽  
Katja Corcoran ◽  
Gayannee Kedia ◽  
Lisa V. Eckerstorfer ◽  
Andreas Fauler ◽  
...  

Helping often occurs in a broader social context. Every day, people observe others who require help, but also others who provide help. Research on goal contagion (Aarts, Gollwitzer & Hassin, 2004) suggests that observing other people’s goal-directed behavior (like helping) activates the same goal in the observer. Thus, merely observing a prosocial act could inspire people to act on the same goal. This effect should be even stronger, the more the observer’s disposition makes him or her value the goal. In the case of prosocial goals, we looked at the observer’s Social Value Orientation (SVO; van Lange et al., 1999) as a moderator of the process. In three studies (N = 126, N = 162 and N = 371), we tested the hypothesis that prosocial observations (vs. control) will trigger more subsequent prosocial behavior the more the observer is prosocially oriented. In line with the original research, we used texts as stimulus material in Study 1 and short video clips in Study 2 and 3. In Study 1 and 2, SVO was measured directly before the manipulation was induced and in Study 3 even a week prior to the actual experiment. Additionally, we included a second control condition video clip in Study 3, which did not depict human beings. Despite thoroughly developed stimulus material and methods, we found no support for an effect of the interaction, nor of the prosocial observation, but some support of SVO in Study 1 and 2. A mini meta-analysis revealed an effect equivalent to zero for goal contagion and a small, but robust SVO effect across studies. One implication for the theory of goal contagion is that prosocial goals might not be as contagious as other goals addressed in the literature. However, because SVO might not have been an optimal trait, other moderators for prosocial dispositions should be tested.


Sign in / Sign up

Export Citation Format

Share Document