Acoustic-Perceptual Factors Both Maintain and Account for the Rarity of the Czech Trill-Fricative

Czech has a sibilant inventory that contrasts at three places of articulation: Alveolar, a pre-post-alveolar, and palato-alveolar. The specific aim of this study is to examine the perception of the typologically rare Czech sibilant inventory and to determine whether acoustic-perceptual characteristics play a role in the maintenance of the Czech trill-fricative. These results are compared to a more common three-way sibilant inventory, Polish. Native Czech listeners performed an auditory AX discrimination task in two blocks: A Czech block and a Polish block. Stimuli were embedded in varying levels of noise to increase task difficulty. Signal-to-noise ratio differences affected the perception of the Czech sibilants more than Polish sibilants. Moreover, a multidimensional scaling analysis revealed less perceptual dispersion for the Czech inventory than the Polish inventory. These results suggest that there is greater difficulty maintaining the Czech inventory considering the signal-to-noise comparisons and that this a factor that contributes to its rarity; however, similarities in perceptual dispersion indicate that maintenance across several acoustic-perceptual cues is possible, and Czech shows few signs of losing this typologically rare contrast.

Consonance perception in congenital amusia: behavioral and brain responses to harmonicity and beating cues

Congenital amusia is a neurodevelopmental disorder characterized by difficulties in the perception and production of music, including the perception of consonance and dissonance, or the judgment of certain combinations of pitches as more pleasant than others. Two perceptual cues for dissonance are inharmonicity (the lack of a common fundamental frequency between components) and beating (amplitude fluctuations produced by close, interacting frequency components). In the presence of inharmonicities or beats, amusics have previously been reported to be insensitive to inharmonicity, but to exhibit normal sensitivity to beats. In the present study, we measured adaptive discrimination thresholds in amusic participants and found elevated thresholds for both cues. We recorded EEG and measured the mismatch negativity (MMN) in evoked potentials to consonance and dissonance deviants in an oddball paradigm. The amplitude of the MMN response was similar overall for amusics and controls, but while control participants showed a stronger MMN to harmonicity cues than to beating cues, amusic participants showed a stronger MMN to beating cues than to harmonicity cues. These findings suggest that initial encoding of consonance cues may be intact in amusia despite impaired behavioral performance, but that the relative weight of non-spectral cues may be increased for amusic individuals.

Materials In Paintings (MIP): An interdisciplinary dataset for perception, art history, and computer vision

In this paper, we capture and explore the painterly depictions of materials to enable the study of depiction and perception of materials through the artists’ eye. We annotated a dataset of 19k paintings with 200k+ bounding boxes from which polygon segments were automatically extracted. Each bounding box was assigned a coarse material label (e.g., fabric) and half was also assigned a fine-grained label (e.g., velvety, silky). The dataset in its entirety is available for browsing and downloading at materialsinpaintings.tudelft.nl. We demonstrate the cross-disciplinary utility of our dataset by presenting novel findings across human perception, art history and, computer vision. Our experiments include a demonstration of how painters create convincing depictions using a stylized approach. We further provide an analysis of the spatial and probabilistic distributions of materials depicted in paintings, in which we for example show that strong patterns exists for material presence and location. Furthermore, we demonstrate how paintings could be used to build more robust computer vision classifiers by learning a more perceptually relevant feature representation. Additionally, we demonstrate that training classifiers on paintings could be used to uncover hidden perceptual cues by visualizing the features used by the classifiers. We conclude that our dataset of painterly material depictions is a rich source for gaining insights into the depiction and perception of materials across multiple disciplines and hope that the release of this dataset will drive multidisciplinary research.

An action-oriented perspective on space and affordances

Architects design spaces that offer perceptual cues, affordances, for our various effectivities. Lina Bo Bardi’s São Paulo Museum demonstrates how praxic and contemplative actions are interleaved—space is effective and affective. Navigation often extends beyond wayfinding to support ongoing behavior. Scripts set out the general rules for a particular kind of behavior, and may suggest places that a building must provide. Cognitive maps support wayfinding. Other maps in the brain represent sensory or motor patterns of activity. Juhani Pallasmaa’s reflections on The Thinking Hand lead into a view of how the brain mediates that thinking, modeling hand–eye coordination at two levels. The first coordinates perceptual and motor schemas. The body schema is an adaptable collage of perceptual and motor skills. The second coordinates the ventral “what” pathway that can support planning of actions, and the dorsal “how” pathway that links affordance-related details to motor control. A complementary challenge is understanding how schemas in the head relate to social schemas. Finally, the chapter compares the cognitive challenges in designing a building and in developing a computational brain model of cognitive processes.

On segmental representations in second language phonology: A perceptual account

The extent to which exposure to new phonemic contrasts (i.e. contrasts that are present in the L2 but not in the L1) will lead to the creation of a new phonemic category in L2 speakers, as well as the phonological nature of these categories, remains an open question insofar as there is no consensus on whether acquiring a new contrast would result in abstract, phoneme-like categories, or if they belong to a less abstract level of representation. This work explores the perception of the /ɑ/–/ʌ/ contrast ( cop – cup) in American English by Spanish speakers of L2 English through a discrimination task. The results show that while the interlanguage state of less experienced learners is best described as a case of single-category assimilation, the interlanguage state achieved by advanced learners is not a full phonemic split, despite the increased sensitivity to otherwise within-category perceptual cues; rather, it seems that while the ability to perceive differences is not affected, the ability to create a new phonemic representation is impaired.

A cooperative culture may affect trustworthiness assessments derived from the human face

Trust is crucial for successful social interactions and personal well-being. Among the many mechanisms potentially favoring the evolution of trust, spillovers of social institutions on subsequent behavior have received little attention within evolutionary psychology. Although a plethora of research has investigated pro-social spillovers in economic experiments, research has thus far largely overlooked the impact of spillovers on person perception. Additionally, given that most studies on such spillovers use one-off measurement of the subsequent behavior, the stability of pro-social spillovers over time has not been investigated so far. In a three-stage laboratory experiment (n = 208), we provide evidence that pro-social spillovers occur even when perceptual cues provide an additional source of information to base decisions on. In Stage 1, participants played a series of trust games against unknown, videotaped targets to assess their baseline trust behavior against strangers, taking into account their trust perception. Subsequently, we randomly exposed them to a repeated prisoner’s dilemma in which cooperation is either favored (“C-culture”) or discouraged (“D-culture”). In the final stage – another series of 30 trust decisions against different targets – participants from the “C-culture” initially respond with higher levels of trust. This spillover effect, however, is short-lived and behavior converges back to the pre-intervention levels. Thus, our findings confirm pro-social spillovers even when participants behavior may also be influenced by perceptual cues but raise the question about their temporal stability. We complemented the experiment with an independent survey (n = 132) on the trustworthiness of the targets. Results show that these perception affects quickly gain predictive quality, suggesting the intervention effect only temporarily crowds out the trustworthiness perception as a key driver of trust behavior.

Visuo-Locomotive Update in the Wild. The Role of (Un)Familiarity in Choice of Navigation Strategy, and its Application in Computational Spatial Design

We study active human visuo-locomotive experience in everyday navigation from the viewpoints of environmental familiarity, embodied reorientation, and (sensorimotor) spatial update. Following a naturalistic, in situ, embodied multimodal behaviour analysis method, we conclude that familiar users rely on environmental cues as a navigation-aid and exhibit proactive decision-making, whereas unfamiliar users rely on manifest cues, are late in decision-making, and show no sign of sensorimotor spatial update. Qualitative analysis reveals that both groups are able to sketch-map their route and consider path integration: i.e., conscious spatial representation updating was possible but not preferred during active navigation. Overall, the experimental task did not trigger automatic or reflexlike spatial updating, as subjects preferred strategies involving memory of perceptual cues and available manifest cues instead of relying on motor simulation and continuous spatial update. Rooted in the behavioural outcomes, we also position applications in computational modelling of navigation within cognitive technologies for architectural design synthesis.

An elasticity-curvature illusion decouples cutaneous and proprioceptive cues in active exploration of soft objects

Our sense of touch helps us encounter the richness of our natural world. Across a myriad of contexts and repetitions, we have learned to deploy certain exploratory movements in order to elicit perceptual cues that are salient and efficient. The task of identifying optimal exploration strategies and somatosensory cues that underlie our softness perception remains relevant and incomplete. Leveraging psychophysical evaluations combined with computational finite element modeling of skin contact mechanics, we investigate an illusion phenomenon in exploring softness; where small-compliant and large-stiff spheres are indiscriminable. By modulating contact interactions at the finger pad, we find this elasticity-curvature illusion is observable in passive touch, when the finger is constrained to be stationary and only cutaneous responses from mechanosensitive afferents are perceptible. However, these spheres become readily discriminable when explored volitionally with musculoskeletal proprioception available. We subsequently exploit this phenomenon to dissociate relative contributions from cutaneous and proprioceptive signals in encoding our percept of material softness. Our findings shed light on how we volitionally explore soft objects, i.e., by controlling surface contact force to optimally elicit and integrate proprioceptive inputs amidst indiscriminable cutaneous contact cues. Moreover, in passive touch, e.g., for touch-enabled displays grounded to the finger, we find those spheres are discriminable when rates of change in cutaneous contact are varied between the stimuli, to supplant proprioceptive feedback.