The developmental path of multisensory perception of emotion and phoneme in Japanese speakers

2017 ◽  
Author(s):  
Hisako W. Yamamoto ◽  
Misako Kawahara ◽  
Akihiro Tanaka
2018 ◽  
Vol 77 (4) ◽  
pp. 173-184
Author(s):  
Wenxing Yang ◽  
Ying Sun

Abstract. The causal role of a unidirectional orthography in shaping speakers’ mental representations of time seems to be well established by many psychological experiments. However, the question of whether bidirectional writing systems in some languages can also produce such an impact on temporal cognition remains unresolved. To address this issue, the present study focused on Japanese and Taiwanese, both of which have a similar mix of texts written horizontally from left to right (HLR) and vertically from top to bottom (VTB). Two experiments were performed which recruited Japanese and Taiwanese speakers as participants. Experiment 1 used an explicit temporal arrangement design, and Experiment 2 measured implicit space-time associations in participants along the horizontal (left/right) and the vertical (up/down) axis. Converging evidence gathered from the two experiments demonstrate that neither Japanese speakers nor Taiwanese speakers aligned their vertical representations of time with the VTB writing orientation. Along the horizontal axis, only Japanese speakers encoded elapsing time into a left-to-right linear layout, which was commensurate with the HLR writing direction. Therefore, two distinct writing orientations of a language could not bring about two coexisting mental time lines. Possible theoretical implications underlying the findings are discussed.


Author(s):  
Bruno and

Multisensory interactions in perception are pervasive and fundamental, as we have documented throughout this book. In this final chapter, we propose that contemporary work on multisensory processing is a paradigm shift in perception science, calling for a radical reconsideration of empirical and theoretical questions within an entirely new perspective. In making our case, we emphasize that multisensory perception is the norm, not the exception, and we remark that multisensory interactions can occur early in sensory processing. We reiterate the key notions that multisensory interactions come in different kinds and that principles of multisensory processing must be considered when tackling multisensory daily-life problems. We discuss the role of unisensory processing in a multisensory world, and we conclude by suggesting future directions for the multisensory field.


Author(s):  
Bruno and

Synaesthesia is a curious anomaly of multisensory perception. When presented with stimulation in one sensory channel, in addition to the percept usually associated with that channel (inducer) a true synaesthetic experiences a second percept in another perceptual modality (concurrent). Although synaesthesia is not pathological, true synaesthetes are relatively rare and their synaesthetic associations tend to be quite idiosyncratic. For this reason, studying synaesthesia is difficult, but exciting new experimental results are beginning to clarify what makes the brain of synaesthetes special and the mechanisms that may produce the condition. Even more importantly, the related phenomenon known as ‘natural’ crossmodal associations is instead experienced by everyone, providing another useful domain for studying multisensory interactions with important implications for understanding our preferences for products in terms of spontaneously evoked associations, as well as for choosing appropriate names, labels, and packaging in marketing applications.


Author(s):  
Berit Brogaard

Despite the recent surge in research on, and interest in, synesthesia, the mechanism underlying this condition is still unknown. Feedforward mechanisms involving overlapping receptive fields of sensory neurons as well as feedback mechanisms involving a lack of signal disinhibition have been proposed. Here I show that a broad range of studies of developmental synesthesia indicate that the mechanism underlying the phenomenon may in some cases involve the reinstatement of brain activity in sensory or cognitive streams in a way that is similar to what happens during memory retrieval of semantically associated items. In the chapter’s final sections I look at the relevance of synesthesia research, given the memory model, to our understanding of multisensory perception and common mapping patterns.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Elise Payzan-LeNestour ◽  
Lionnel Pradier ◽  
James Doran ◽  
Gideon Nave ◽  
Bernard Balleine

AbstractResearch in the field of multisensory perception shows that what we hear can influence what we see in a wide range of perceptual tasks. It is however unknown whether this extends to the visual perception of risk, despite the importance of the question in many applied domains where properly assessing risk is crucial, starting with financial trading. To fill this knowledge gap, we ran interviews with professional traders and conducted three laboratory studies using judgments of financial asset risk as a testbed. We provide evidence that the presence of ambient sound impacts risk perception, possibly due to the combination of facilitatory and synesthetic effects of general relevance to the perception of risk in many species as well as humans. We discuss the implications of our findings for various applied domains (e.g., financial, medical, and military decision-making), and raise new questions for future research.


2020 ◽  
Vol 6 (1) ◽  
pp. 386-400 ◽  
Author(s):  
Shigeto Kawahara ◽  
Mahayana C. Godoy ◽  
Gakuji Kumagai

AbstractAncient writers, including Socrates and the Upanishads, argued that sibilants are associated with the notions of wind, air and sky. From modern perspectives, these statements can be understood as an assertion about sound symbolism, i.e., systematic connections between sounds and meanings. Inspired by these writers, this article reports on an experiment that tests a sound symbolic value of sibilants. The experiment is a case study situated within the Pokémonastics research paradigm, in which the researchers explore the sound symbolic patterns in natural languages using Pokémon names. The current experiment shows that when presented with pairs of a flying-type Pokémon character and a normal-type Pokémon character, Japanese speakers are more likely to associate the flying-type Pokémons with names that contain sibilants than those names that do not contain sibilants. As was pointed out by Socrates, the sound symbolic connection identified in the experiment is likely to be grounded in the articulatory properties of sibilants – the large amount of oral airflow that accompanies the production of sibilants. Various implications of the current experiment for the sound symbolism research are discussed throughout the article.


2021 ◽  
Vol 11 (10) ◽  
pp. 4488
Author(s):  
Raffaele Campo ◽  
Felipe Reinoso-Carvalho ◽  
Pierfelice Rosato

The existing multisensory literature suggests that the combination of the different human senses in a controlled fashion during food/drink experiences can provide more enjoyment to consumers. The present research reviews recent literature relating multisensory perception with wine experiences, focusing on the interaction of the five basic senses (taste, smell, vision, touch, and sound). This is mostly being assessed from a perceptual and behavioral consumer perspective. Here, the authors report different ways in which such interactions across these senses can affect the way a wine is experienced, prior to, during, and even after tasting. The authors finish this literature review by providing some insights in the context of wine and food pairing, while also generally reflecting on potential future work. These insights may be inspirational for a diverse group of organizations working with wine. Based on such multisensory approaches, it may be possible to bring unforeseen sensations to the different wine experiences, while at the same time stressing particular sensory and/or emotional attributes.


Sign in / Sign up

Export Citation Format

Share Document