scholarly journals Feel the music : crossmodal integration in music perception

2021 ◽  
Author(s):  
Michael Maksimowski
Keyword(s):  
Visual Information ◽  
Strong Influence ◽  
Music Perception ◽  
Auditory Information ◽  
N Addition ◽  
Crossmodal Integration ◽  
Ideal Domain ◽  
Interval Size ◽  
Empirical Information

n addition to auditory information, music perception often involves visual and vibrotactile information, making it an ideal domain through which to study cross-modal integration. Recent research has demonstrated a strong influence of visual information on auditory judgments concerning music. However, we have very little empirical information regarding integration of vibrotactile information in music. In Experiment 1, participants made judgments of interval size for unimodal presentations of melodic intervals in auditory, visual, and vibrotactile conditions. In Experiment 2, participants made judgments of interval size for cross-modal presentations of intervals comprised of stimuli presented in the three unimodal conditions of Experiment 1. In Experiment 3, participants were trained with vibrotactile stimuli to assess if learning benefits audio-vibrotactile integration in music perception. The results are discussed in light of differences in the extent of visual and vibrotactile influence on auditory judgments and the role of learning in cross-modal integration in music.

scholarly journals Feel the music : crossmodal integration in music perception

2021 ◽  
Author(s):  
Michael Maksimowski
Keyword(s):  
Visual Information ◽  
Strong Influence ◽  
Music Perception ◽  
Auditory Information ◽  
N Addition ◽  
Crossmodal Integration ◽  
Ideal Domain ◽  
Interval Size ◽  
Empirical Information

n addition to auditory information, music perception often involves visual and vibrotactile information, making it an ideal domain through which to study cross-modal integration. Recent research has demonstrated a strong influence of visual information on auditory judgments concerning music. However, we have very little empirical information regarding integration of vibrotactile information in music. In Experiment 1, participants made judgments of interval size for unimodal presentations of melodic intervals in auditory, visual, and vibrotactile conditions. In Experiment 2, participants made judgments of interval size for cross-modal presentations of intervals comprised of stimuli presented in the three unimodal conditions of Experiment 1. In Experiment 3, participants were trained with vibrotactile stimuli to assess if learning benefits audio-vibrotactile integration in music perception. The results are discussed in light of differences in the extent of visual and vibrotactile influence on auditory judgments and the role of learning in cross-modal integration in music.

scholarly journals The Role of the Auditory and Visual Modalities in the Perceptual Identification of Brazilian Portuguese Statements and Echo Questions

2020 ◽  
pp. 002383091989888
Author(s):  
Luma Miranda ◽  
Marc Swerts ◽  
João Moraes ◽  
Albert Rilliard
Keyword(s):  
Visual Information ◽  
Brazilian Portuguese ◽  
Perceptual Identification ◽  
Auditory Information ◽  
Visual Channel ◽  
Prosodic Cues ◽  
The Face ◽  
Set Up ◽  
Echo Questions

This paper presents the results of three perceptual experiments investigating the role of auditory and visual channels for the identification of statements and echo questions in Brazilian Portuguese. Ten Brazilian speakers (five male) were video-recorded (frontal view of the face) while they produced a sentence (“ Como você sabe”), either as a statement (meaning “ As you know.”) or as an echo question (meaning “ As you know?”). Experiments were set up including the two different intonation contours. Stimuli were presented in conditions with clear and degraded audio as well as congruent and incongruent information from both channels. Results show that Brazilian listeners were able to distinguish statements and questions prosodically and visually, with auditory cues being dominant over visual ones. In noisy conditions, the visual channel improved the interpretation of prosodic cues robustly, while it degraded them in conditions where the visual information was incongruent with the auditory information. This study shows that auditory and visual information are integrated during speech perception, also when applied to prosodic patterns.

Seeing the Way: the Role of Vision in Conversation Turn Exchange Perception

2017 ◽  
Vol 30 (7-8) ◽  
pp. 653-679 ◽  
Author(s):  
Nida Latif ◽  
Agnès Alsius ◽  
K. G. Munhall
Keyword(s):  
Visual Information ◽  
Visual Cues ◽  
Social Cues ◽  
The Other ◽  
Auditory Information ◽  
Face To Face ◽  
Turn Taking ◽  
Overall Efficiency ◽  
Natural Conversation

During conversations, we engage in turn-taking behaviour that proceeds back and forth effortlessly as we communicate. In any given day, we participate in numerous face-to-face interactions that contain social cues from our partner and we interpret these cues to rapidly identify whether it is appropriate to speak. Although the benefit provided by visual cues has been well established in several areas of communication, the use of visual information to make turn-taking decisions during conversation is unclear. Here we conducted two experiments to investigate the role of visual information in identifying conversational turn exchanges. We presented clips containing single utterances spoken by single individuals engaged in a natural conversation with another. These utterances were from either right before a turn exchange (i.e., when the current talker would finish and the other would begin) or were utterances where the same talker would continue speaking. In Experiment 1, participants were presented audiovisual, auditory-only and visual-only versions of our stimuli and identified whether a turn exchange would occur or not. We demonstrated that although participants could identify turn exchanges with unimodal information alone, they performed best in the audiovisual modality. In Experiment 2, we presented participants audiovisual turn exchanges where the talker, the listener or both were visible. We showed that participants suffered a cost at identifying turns exchanges when visual cues from the listener were not available. Overall, we demonstrate that although auditory information is sufficient for successful conversation, visual information plays an important role in the overall efficiency of communication.

Hearing and Seeing Musical Expression

2018 ◽  
Author(s):  
Dominic McIver Lopes
Keyword(s):  
Visual Information ◽  
Music Perception ◽  
Auditory Information ◽  
Musical Expression ◽  
Musical Performances ◽  
Psychology Of Music

Everybody assumes (1) that musical performances are sonic events and (2) that their expressive properties are sonic properties. This paper discusses recent findings in the psychology of music perception that show that visual information combines with auditory information in the perception of musical expression. The findings show at the very least that arguments are needed for (1) and (2). If music expresses what we think it does, then its expressive properties may be visual as well as sonic; and if its expressive properties are purely sonic, then music expresses less than we think it does. And if the expressive properties of music are visual as well as sonic, then music is not what we think it is—it is not purely sonic.

scholarly journals The Foreground Bias: Initial Scene Representations across the Depth Plane

2019 ◽  
Author(s):  
Suzette Fernandes ◽  
Monica Castelhano
Keyword(s):  
Depth Perception ◽  
Visual Information ◽  
Strong Influence ◽  
Depth Plane ◽  
Fixation Position ◽  
Initial Fixation ◽  
Scene Gist ◽  
Scene Information ◽  
Initial Processing

When you walk into a large room, you perceive visual information that is both close to you in depth and farther in the background. Here, we investigated how initial scene representations are affected by information across depth. We examined the role of background and foreground information on scene gist by using Chimera scenes (images with foreground and background from different scene categories). Across three experiments, we found a Foreground Bias in which foreground information initially had a strong influence on the interpretation of the scene. This bias persisted when the initial fixation position was on the scene background and when the task was changed to emphasize scene information. We conclude that the Foreground Bias arises from initial processing of scenes for understanding and suggests that scene information closer to the observer is initially prioritized. We discuss the implications for theories of scene and depth perception.

scholarly journals The Foreground Bias: Initial Scene Representations Across the Depth Plane

2021 ◽  
pp. 095679762098446
Author(s):  
Suzette Fernandes ◽  
Monica S. Castelhano
Keyword(s):  
Depth Perception ◽  
Visual Information ◽  
Strong Influence ◽  
Depth Plane ◽  
Fixation Position ◽  
Initial Fixation ◽  
Scene Gist ◽  
Scene Information ◽  
Initial Processing

When you walk into a large room, you perceive visual information that is both close to you in depth and farther in the background. Here, we investigated how initial scene representations are affected by information across depth. We examined the role of background and foreground information on scene gist by using chimera scenes (images with a foreground and background from different scene categories). Across three experiments, we found a foreground bias: Information in the foreground initially had a strong influence on the interpretation of the scene. This bias persisted when the initial fixation position was on the scene background and when the task was changed to emphasize scene information. We concluded that the foreground bias arises from initial processing of scenes for understanding and suggests that scene information closer to the observer is initially prioritized. We discuss the implications for theories of scene and depth perception.

scholarly journals Inclusive digital finance: the industry of equity crowdfunding

2021 ◽  
Author(s):  
Vincenzo Butticè ◽  
Silvio Vismara
Keyword(s):  
Visual Information ◽  
Entrepreneurial Finance ◽  
Industrial Dynamics ◽  
Relevant Research ◽  
Research Directions ◽  
Entrepreneurial Ventures ◽  
Equity Crowdfunding ◽  
Recent Developments

AbstractNowadays equity crowdfunding plays an important role in the entrepreneurial finance markets. To better understand the functioning of the industry, it is important to consider the entire equity crowdfunding process and all the actors involved. Equity crowdfunding platforms match indeed the demand of capital from entrepreneurial ventures with the supply of capital by investors. This manuscript is a first step in this direction, by (1) comparing equity crowdfunding with traditional sources of entrepreneurial finance; (2) discussing the potential and the perils of equity crowdfunding for inclusivity and democratization; (3) highlighting the role of visual information in digital finance; and (4) providing first insights on the industrial dynamics in equity crowdfunding. The paper gives researchers and practitioners orientation about recent developments in equity crowdfunding literature and provides relevant research directions.

scholarly journals Interphotoreceptor coupling: an evolutionary perspective

2021 ◽  
Author(s):  
Lorenzo Cangiano ◽  
Sabrina Asteriti
Keyword(s):  
Visual Information ◽  
Signal To Noise Ratio ◽  
Electrical Coupling ◽  
Physiological Role ◽  
Cellular Processes ◽  
Contact Points ◽  
Highly Sensitive ◽  
The Many ◽  
The Impact

AbstractIn the vertebrate retina, signals generated by cones of different spectral preference and by highly sensitive rod photoreceptors interact at various levels to extract salient visual information. The first opportunity for such interaction is offered by electrical coupling of the photoreceptors themselves, which is mediated by gap junctions located at the contact points of specialised cellular processes: synaptic terminals, telodendria and radial fins. Here, we examine the evolutionary pressures for and against interphotoreceptor coupling, which are likely to have shaped how coupling is deployed in different species. The impact of coupling on signal to noise ratio, spatial acuity, contrast sensitivity, absolute and increment threshold, retinal signal flow and colour discrimination is discussed while emphasising available data from a variety of vertebrate models spanning from lampreys to primates. We highlight the many gaps in our knowledge, persisting discrepancies in the literature, as well as some major unanswered questions on the actual extent and physiological role of cone-cone, rod-cone and rod-rod communication. Lastly, we point toward limited but intriguing evidence suggestive of the ancestral form of coupling among ciliary photoreceptors.

Topography of the Free Energy Landscape on the Claisen-Schmidt Condensation: Solvent and Temperature Effect in the Rate-Controlling Step

2021 ◽  
Author(s):  
Nayara Dantas Coutinho ◽  
Hugo Gontijo Machado ◽  
Valter Henrique Carvalho-Silva ◽  
Wender A. Silva
Keyword(s):  
Free Energy ◽  
Temperature Effect ◽  
Strong Influence ◽  
Aldol Condensation ◽  
Energy Landscape ◽  
Bond Formation ◽  
Free Energy Landscape ◽  
Rate Controlling Step ◽  
Formation Step

Recent studies have assigned hydroxide elimination and C=C bond formation step in base-promoted aldol condensation the role of having a strong influence in the overall rate reaction, in contrast to...

Sign in / Sign up

Export Citation Format

Share Document