scholarly journals Efficient inverse graphics in biological face processing

2020 ◽  
Vol 6 (10) ◽  
pp. eaax5979 ◽  
Author(s):  
Ilker Yildirim ◽  
Mario Belledonne ◽  
Winrich Freiwald ◽  
Josh Tenenbaum

Vision not only detects and recognizes objects, but performs rich inferences about the underlying scene structure that causes the patterns of light we see. Inverting generative models, or “analysis-by-synthesis”, presents a possible solution, but its mechanistic implementations have typically been too slow for online perception, and their mapping to neural circuits remains unclear. Here we present a neurally plausible efficient inverse graphics model and test it in the domain of face recognition. The model is based on a deep neural network that learns to invert a three-dimensional face graphics program in a single fast feedforward pass. It explains human behavior qualitatively and quantitatively, including the classic “hollow face” illusion, and it maps directly onto a specialized face-processing circuit in the primate brain. The model fits both behavioral and neural data better than state-of-the-art computer vision models, and suggests an interpretable reverse-engineering account of how the brain transforms images into percepts.

2018 ◽  
Author(s):  
Ilker Yildirim ◽  
Mario Belledonne ◽  
Winrich Freiwald ◽  
Joshua Tenenbaum

Vision must not only recognize and localize objects, but perform richer inferences about the underlying causes in the world that give rise to sensory data. How the brain performs these inferences remains unknown: Theoretical proposals based on inverting generative models (or “analysis-by-synthesis”) have a long history but their mechanistic implementations have typically been too slow to support online perception, and their mapping to neural circuits is unclear. Here we present a neurally plausible model for efficiently inverting generative models of images and test it as an account of one high-level visual capacity, the perception of faces. The model is based on a deep neural network that learns to invert a three-dimensional (3D) face graphics program in a single fast feedforward pass. It explains both human behavioral data and multiple levels of neural processing in non-human primates, as well as a classic illusion, the “hollow face” effect. The model fits qualitatively better than state-of-the-art computer vision models, and suggests an interpretable reverse-engineering account of how images are transformed into percepts in the ventral stream.


2020 ◽  
Vol 287 (1930) ◽  
pp. 20200807 ◽  
Author(s):  
G. Sansalone ◽  
K. Allen ◽  
J. A. Ledogar ◽  
S. Ledogar ◽  
D. R. Mitchell ◽  
...  

Large brains are a defining feature of primates, as is a clear allometric trend between body mass and brain size. However, important questions on the macroevolution of brain shape in primates remain unanswered. Here we address two: (i), does the relationship between the brain size and its shape follow allometric trends and (ii), is this relationship consistent over evolutionary time? We employ three-dimensional geometric morphometrics and phylogenetic comparative methods to answer these questions, based on a large sample representing 151 species and most primate families. We found two distinct trends regarding the relationship between brain shape and brain size. Hominoidea and Cercopithecinae showed significant evolutionary allometry, whereas no allometric trends were discernible for Strepsirrhini, Colobinae or Platyrrhini. Furthermore, we found that in the taxa characterized by significant allometry, brain shape evolution accelerated, whereas for taxa in which such allometry was absent, the evolution of brain shape decelerated. We conclude that although primates in general are typically described as large-brained, strong allometric effects on brain shape are largely confined to the order's representatives that display more complex behavioural repertoires.


2016 ◽  
Vol 371 (1697) ◽  
pp. 20150256 ◽  
Author(s):  
HyunGoo R. Kim ◽  
Dora E. Angelaki ◽  
Gregory C. DeAngelis

In addition to depth cues afforded by binocular vision, the brain processes relative motion signals to perceive depth. When an observer translates relative to their visual environment, the relative motion of objects at different distances (motion parallax) provides a powerful cue to three-dimensional scene structure. Although perception of depth based on motion parallax has been studied extensively in humans, relatively little is known regarding the neural basis of this visual capability. We review recent advances in elucidating the neural mechanisms for representing depth-sign (near versus far) from motion parallax. We examine a potential neural substrate in the middle temporal visual area for depth perception based on motion parallax, and we explore the nature of the signals that provide critical inputs for disambiguating depth-sign. This article is part of the themed issue ‘Vision in our three-dimensional world’.


2008 ◽  
Vol 67 (1) ◽  
pp. 51-60 ◽  
Author(s):  
Stefano Passini

The relation between authoritarianism and social dominance orientation was analyzed, with authoritarianism measured using a three-dimensional scale. The implicit multidimensional structure (authoritarian submission, conventionalism, authoritarian aggression) of Altemeyer’s (1981, 1988) conceptualization of authoritarianism is inconsistent with its one-dimensional methodological operationalization. The dimensionality of authoritarianism was investigated using confirmatory factor analysis in a sample of 713 university students. As hypothesized, the three-factor model fit the data significantly better than the one-factor model. Regression analyses revealed that only authoritarian aggression was related to social dominance orientation. That is, only intolerance of deviance was related to high social dominance, whereas submissiveness was not.


2020 ◽  
Author(s):  
Junxia Ren ◽  
Yaozu Liu ◽  
Xin Zhu ◽  
Yangyang Pan ◽  
Yujie Wang ◽  
...  

<p><a></a><a></a><a></a><a></a><a></a><a></a><a></a><a>The development of highly-sensitive recognition of </a><a></a><a></a><a></a><a></a><a>hazardous </a>chemicals, such as volatile organic compounds (VOCs) and polycyclic aromatic hydrocarbons (PAHs), is of significant importance because of their widespread social concerns related to environment and human health. Here, we report a three-dimensional (3D) covalent organic framework (COF, termed JUC-555) bearing tetraphenylethylene (TPE) side chains as an aggregation-induced emission (AIE) fluorescence probe for sensitive molecular recognition.<a></a><a> </a>Due to the rotational restriction of TPE rotors in highly interpenetrated framework after inclusion of dimethylformamide (DMF), JUC-555 shows impressive AIE-based strong fluorescence. Meanwhile, owing to the large pore size (11.4 Å) and suitable intermolecular distance of aligned TPE (7.2 Å) in JUC-555, the obtained material demonstrates an excellent performance in the molecular recognition of hazardous chemicals, e.g., nitroaromatic explosives, PAHs, and even thiophene compounds, via a fluorescent quenching mechanism. The quenching constant (<i>K</i><sub>SV</sub>) is two orders of magnitude better than those of other fluorescence-based porous materials reported to date. This research thus opens 3D functionalized COFs as a promising identification tool for environmentally hazardous substances.</p>


Author(s):  
Leonardo Baglioni ◽  
Federico Fallavollita

AbstractThe present essay investigates the potential of generative representation applied to the study of relief perspective architectures realized in Italy between the sixteenth and seventeenth centuries. In arts, and architecture in particular, relief perspective is a three-dimensional structure able to create the illusion of great depths in small spaces. A method of investigation applied to the case study of the Avila Chapel in Santa Maria in Trastevere in Rome (Antonio Gherardi 1678) is proposed. The research methodology can be extended to other cases and is based on the use of a Relief Perspective Camera, which can create both a linear perspective and a relief perspective. Experimenting mechanically and automatically the perspective transformations from the affine space to the illusory space and vice versa has allowed us to see the case study in a different light.


2021 ◽  
Vol 7 (3) ◽  
pp. 209-219
Author(s):  
Iris J Holzleitner ◽  
Alex L Jones ◽  
Kieran J O’Shea ◽  
Rachel Cassar ◽  
Vanessa Fasolt ◽  
...  

Abstract Objectives A large literature exists investigating the extent to which physical characteristics (e.g., strength, weight, and height) can be accurately assessed from face images. While most of these studies have employed two-dimensional (2D) face images as stimuli, some recent studies have used three-dimensional (3D) face images because they may contain cues not visible in 2D face images. As equipment required for 3D face images is considerably more expensive than that required for 2D face images, we here investigated how perceptual ratings of physical characteristics from 2D and 3D face images compare. Methods We tested whether 3D face images capture cues of strength, weight, and height better than 2D face images do by directly comparing the accuracy of strength, weight, and height ratings of 182 2D and 3D face images taken simultaneously. Strength, height and weight were rated by 66, 59 and 52 raters respectively, who viewed both 2D and 3D images. Results In line with previous studies, we found that weight and height can be judged somewhat accurately from faces; contrary to previous research, we found that people were relatively inaccurate at assessing strength. We found no evidence that physical characteristics could be judged more accurately from 3D than 2D images. Conclusion Our results suggest physical characteristics are perceived with similar accuracy from 2D and 3D face images. They also suggest that the substantial costs associated with collecting 3D face scans may not be justified for research on the accuracy of facial judgments of physical characteristics.


e-Polymers ◽  
2021 ◽  
Vol 21 (1) ◽  
pp. 346-354
Author(s):  
Guoquan Qi ◽  
Hongxia Yan ◽  
Dongtao Qi ◽  
Houbu Li ◽  
Lushi Kong ◽  
...  

Abstract The chapter deals with the performance evaluation of the polyethylene of raised temperature resistance (PE-RT) and polyethylene (PE) using autoclave test under sour oil and gas medium conditions. The analyses of performance changes showed that PE-RT has good media resistance at 60°C. As the temperature increases, its mechanical properties decrease, accompanied by an increase in weight. Comparative analyses showed that no matter what temperature conditions are, PE-RT media resistance is better than PE80. The better media resistance of PE-RT depends on its higher degree of branching. Short branches are distributed between the crystals to form a connection between the crystals, thereby improving its heat resistance and stress under high-temperature conditions. PE-RT forms an excellent three-dimensional network structure through copolymerization, ensuring that it has better media resistance than PE80. However, the mechanical performance will be attenuated due to the high service temperature.


Sign in / Sign up

Export Citation Format

Share Document