The McGurk Effect in Qatari Arabic: Influences of Lexicality and Consonant Position

2020 ◽  
Author(s):  
Noora Essa AlAnsari ◽  
Ali Idrissi ◽  
Michael Grosvald
Keyword(s):  
Female Students ◽  
Mcgurk Effect ◽  
Decision Task ◽  
Visual Capture ◽  
Third Sound ◽  
Video Recordings ◽  
Minimal Pairs ◽  
Audio Recordings ◽  
Sound Discrimination ◽  
Visual Element

The McGurk effect is a psycholinguistic phenomenon where an illusion is made by dubbing an auditory element of one sound on a visual element of another sound, which leads to hearing a third sound. The phenomenon demonstrates how the perception of speech does not depend on audio inputs only. Rather, it shows how seeing the shape of the mouth while producing a certain sound can influence what we hear. Thus, it proves the interaction of both vision and auditory parameters in understanding language. In addition, what is known as “lexicality – the property of a word being real or not” influences speech perception. People, unconsciously, tend to alter nonwords to real words. For example, if one said “shtrength” instead of “strength”, a listener would alter and understand it as “strength”. For the purpose of the research, these two phenomena were combined. In this study, we test how effective is the McGurk effect on the Qatari Arabic dialect, which has not been investigated before. The data used were 24 minimal pairs of real and fake words with the substitution of the phonemes: /b/ and /g/ at three different positions: first, middle, final. Videos were made by dubbing audio recordings of the sound /b/ into video recordings of the sound /g/ in order to test if this creates an illusion of the sound /d/. We ran the experiment on 25 native Qatari female students, they had to sit on a computer with headphones on, watch and hear clearly what the person on the video is saying, and then they had to preform two tasks: first, lexical decision task: decide if the word is real or fake. Second, sound discrimination task: choose what sound did they hear. In general, the participants captured audio (which means they heard /b/) were only 16% of target trials, while visual capture occurred (which means they heard /g/) 45%, and the McGurk fusion (which means they heard /d/) happened on 39%. Interestingly, perceiving McGurk fusion was gradually less common at later consonants positions. A significant effect of lexicality was also found, as fusion was more likely to occur if the results of the fusion was a real word.

scholarly journals Vocal and Tactile Input to Children Who Are Deaf or Hard of Hearing

2019 ◽  
Vol 62 (7) ◽  
pp. 2372-2385 ◽  
Author(s):  
Rana Abu-Zhaya ◽  
Maria V. Kondaurova ◽  
Derek Houston ◽  
Amanda Seidl
Keyword(s):  
Hard Of Hearing ◽  
Total Duration ◽  
Normal Hearing ◽  
Free Play ◽  
Temporal Alignment ◽  
Video Recordings ◽  
Tactile Input ◽  
Play Interactions ◽  
Audio Recordings ◽  
Maternal Speech

Purpose Caregivers may show greater use of nonauditory signals in interactions with children who are deaf or hard of hearing (DHH). This study explored the frequency of maternal touch and the temporal alignment of touch with speech in the input to children who are DHH and age-matched peers with normal hearing. Method We gathered audio and video recordings of mother–child free-play interactions. Maternal speech units were annotated from audio recordings, and touch events were annotated from video recordings. Analyses explored the frequency and duration of touch events and the temporal alignment of touch with speech. Results Greater variance was observed in the frequency of touch and its total duration in the input to children who are DHH. Furthermore, touches produced by mothers of children who are DHH were significantly more likely to be aligned with speech than touches produced by mothers of children with normal hearing. Conclusion Caregivers' modifications in the input to children who are DHH are observed in the combination of speech with touch. The implications for such patterns and how they may impact children's attention and access to the speech signal are discussed.

scholarly journals The McGurk Effect In Relation to Musicians' Abilities

2021 ◽  
Vol 10 (2) ◽  
Author(s):  
Claire Luo ◽  
Olivia Yeroushalmi ◽  
Alan Schorn
Keyword(s):  
Original Study ◽  
Mcgurk Effect ◽  
Visual Signals ◽  
P Value ◽  
Sound Waves ◽  
Chi Square ◽  
Third Sound ◽  
Audiovisual Stimuli ◽  
The Brain ◽  
Perceptual Phenomenon

The original study of the McGurk Effect, a perceptual phenomenon caused by contradictory audiovisual stimuli fusing together to create the illusion of a third sound, was carried out by psychologists McGurk and MacDonald in 1976. The results of early experiments displayed that observers used both auditory and visual signals while being spoken to, auditory signals being the sound waves entering their ears, and visual signals being how the speaker moved his face while pronouncing a word. When conflicting signals are given, a third sound is perceived, as the brain is disoriented from the different signals. The idea that musicians have superior audiovisual cortexes have led some to speculate if musicians are as susceptible to the McGurk Effect as non-musicians. To research the susceptibility of musicians to the McGurk Effect, the experiment conducted included a total of 40 subjects, 20 musicians and 20 non-musicians. The subjects were played a control video of a speaker saying “ga” and were then presented with four audiovisually incongruent videos, all containing a speaker mouthing the word “ga” with the audio recording of the speaker saying “ba” dubbed on. Two main 2x2 Chi Square tests and fifteen secondary 2x2 Chi Squares tests were run in total. The two main tests, which compared the amount of McGurk interpretations to either audio or visual interpretations, both produced a p-value of <.0005. Upon further research, 25.7% of musicians reported a McGurk interpretation, as opposed to 52.2% of non-musicians, which implied that musicians are less susceptible to the McGurk effect.

The Internet Community as a Phenomenon of Modern Network Culture (on the example of the KVN community in the social network VKontakte)

Communicology ◽  
2020 ◽  
Vol 8 (2) ◽  
pp. 146-154
Author(s):  
D.A. Ryazanov
Keyword(s):  
Social Network ◽  
Rapid Development ◽  
Educational Institutions ◽  
The Internet ◽  
Virtual Tools ◽  
Video Recordings ◽  
The Social ◽  
Audio Recordings ◽  
History Of ◽  
Internet Community

This paper discusses the characteristics and specific features of the Internet community ‘I love KVN’, whereas identifying user tokens in a network group are shown during their adaptation in the community. The author considers users’ techniques and virtual tools (audio recordings, video recordings, text publications, images, animated images, posters, polls, etc.). The Internet, as unique in terms of the its conditions and possibilities, makes it possible to study sociological phenomena that were not actualized or so accessible to empirical study in different environment of activity and interaction. This is relevant in the light of the rapid development of thematic communities on the VKontakte social network. According to the Levada Center analytical center, today about 72% of the population of the Russia use the Internet “daily or almost daily” and “several times a week”. At the same time, about 45% of citizens go online “several times a day”; these are, first of all, the youngest Russians under the age of 25 (87%). The focus of our consideration is the group on VKontakte “I love KVN”. KVN (The Club of Cheerful and Inventive) is one of the first projects that appeared on domestic television in the format of a humorous game, in which teams (educational institutions, universities, enterprises, cities and so on) compete in humorous answers to questions asked, improvisations on given topics, playing pre-prepared scenes. In the narrow sense, KVN is a competition in one’s own wit. The long-term history of the project (since 1961) and the relentless attention to the game from the mass audience determined in many respects the appearance of communities of lovers of intellectual humorous competitions on various types of venues. With the advent of social networks on the Internet, many KVN fans have joined together in a community that currently numbers approximately 670 thousand people.

scholarly journals Impact of Watching Cartoons on Pronunciation of a Child in an EFL Setting: A Comparative Study with Problematic Sounds of EFL Learners

2020 ◽  
Author(s):  
Ali S. Alghonaim
Keyword(s):  
English Learners ◽  
Longitudinal Research ◽  
Native Speakers ◽  
Longitudinal Case Study ◽  
Video Recordings ◽  
Minimal Pairs ◽  
Native Speakers Of English ◽  
Authentic Language ◽  
Watching Tv

The purpose of this study is to describe a longitudinal case study of pronunciation acquisition for an Arabic child who watched English TV cartoons in an English as a foreign language (EFL) setting, basically in Buraidah, Saudi Arabia. The child, whose name is Anmar, was raised in a typical Arabic environment where Arabic was the only means of communication he experienced. He watched selected English TV cartoons since he was three years old and until he was ten years old. This research study focused on Anamr's acquisition of pronunciation, although the chances to use the language were very limited due to his EFL environment. Additionally, the study aims at comparing Anmar's pronunciation of problematic sounds to Arab learners of English, as stated in previous studies. The research adopted a longitudinal research methodology aiming to find if watching English TV cartoons without even minimum use of language could impact the child's pronunciation compared to his counterparts of Arab learners of English. Therefore, this research utilized some methods, including rating some audio and video recordings of conversations with his father and storytelling. Two native speakers of English rated his performance. A mispronunciation recognition test was carried out to evaluate Anmar's recognition of mispronunciation. The study found out that Anmar's pronunciation was native-like. He far outperformed the Arab learners of English concerning the problematic sounds to Arab learners. He easily differentiates between, for instance, minimal pairs, diphthongs, consonant clusters, vowels, and intonation. The study concluded that children might acquire English pronunciation by watching TV cartoons to be able to overcome the pronunciation problems that many Arab speakers experience. Additionally, English learners in elementary schools may watch such programs to train them to listen to authentic language in media.

scholarly journals Becoming Reflective Practitioners: A Case Study of Four Beginning Pre-service EFL Teachers in Turkey

2019 ◽  
Vol 12 (4) ◽  
pp. 127 ◽  
Author(s):  
Özkan Kırmızı ◽  
Irfan Tosuncuoglu
Keyword(s):  
Classroom Management ◽  
Data Use ◽  
Video Recordings ◽  
Critical Areas ◽  
Audio Recordings ◽  
Efl Teachers ◽  
Data Content ◽  
Reflective Practitioners ◽  
Pre Service Teacher

The present study was designed to investigate the emerging reflective practices of four pre-service English teachers during their practicum experience. The teachers were selected on the basis of convenience. Qualitative paradigm was adopted in the study. Observations, video recordings, and audio recordings were used as data collection tools. Each participant was observed four times and all the lessons were video-recorded. After each lesson, reflection sessions were conducted with the researcher, the pre-service teacher, and the mentor. These sessions were audio-recorded. As for the analysis of the data, content analysis was employed. As a result of the analysis of the data, use of L1, material use and planning, the pace and mood of the lesson, error correction, content and grading, and classroom management emerged as critical areas of reflection on the part of the participants.

Direct mapping of acoustics to phonology: On the lexical encoding of front rounded vowels in L1 English– L2 French acquisition

2012 ◽  
Vol 28 (1) ◽  
pp. 5-40 ◽  
Author(s):  
Isabelle Darcy ◽  
Laurent Dekydtspotter ◽  
Rex A Sprouse ◽  
Justin Glover ◽  
Christiane Kaden ◽  
...  
Keyword(s):  
Native Speakers ◽  
Decision Task ◽  
Phonological Representations ◽  
Advanced Learners ◽  
Categorization Task ◽  
Lexical Representations ◽  
Minimal Pairs ◽  
Direct Mapping ◽  
Intermediate Learners ◽  
Phonetic Categorization

It is well known that adult US-English-speaking learners of French experience difficulties acquiring high /y/–/u/ and mid /œ/–/ɔ/ front vs. back rounded vowel contrasts in French. This study examines the acquisition of these French vowel contrasts at two levels: phonetic categorization and lexical representations. An ABX categorization task (for details, see Section IV) revealed that both advanced and intermediate learners categorized /œ/ vs. /ɔ/ and /y/ vs. /u/ differently from native speakers of French, although performance on the /y/–/u/ contrast was more accurate than on the /œ/–/ɔ/ contrast in all contexts. On a lexical decision task with repetition priming, advanced learners and native speakers produced no (spurious) response time (RT) facilitations for /y/–/u/ and /œ/–/ɔ/ minimal pairs; however, in intermediate learners, the decision for a word containing /y/ was speeded by hearing an otherwise identical word containing /u/ (and vice versa), suggesting that /u/ and /y/ are not distinguished in lexical representations. Thus, while it appears that advanced learners encoded the /y/–/u/ and /œ/–/ɔ/ contrasts in the phonological representations of lexical items, they gained no significant benefit on the categorization task. This dissociation between phonological representations and phonetic categorization challenges common assumptions about their relationship and supports a novel approach we label ‘direct mapping from acoustics to phonology’ (DMAP).

scholarly journals Some Aspects Related To The Procedural Order Of Fixing Evidence-Based Information In Digital Media

2020 ◽  
Vol 02 (11) ◽  
pp. 139-142
Author(s):  
Muzaffar Muminov ◽  
Keyword(s):  
Digital Media ◽  
Digital Photography ◽  
Evidence Based ◽  
Video Recordings ◽  
Audio Recordings

The article analyzes some issues related to the procedural order of collecting, fixing, and consolidating evidence information obtained using digital photography, video recordings and audio recordings.

scholarly journals Harmoni eller konflikt? – en fallstudie av meningsinnehållet i utbildning för hållbar utveckling. "Harmony or conflict? – A case study of the conceptual meaning of education for sustainable development"

2012 ◽  
Vol 8 (1) ◽  
pp. 59-72 ◽  
Author(s):  
Marie Öhman ◽  
Johan Öhman
Keyword(s):  
Sustainable Development ◽  
Secondary Students ◽  
Teaching And Learning ◽  
Current Debate ◽  
Video Recordings ◽  
Upper Secondary ◽  
Audio Recordings ◽  
Field Notes ◽  
Conceptual Meaning

Conflict or harmony between economic, ecologic and social sustainability are two opposing perspectives that have appeared in the current debate about sustainable development. The aim of this studyis to investigate how the relations between these sustainability aspects are established in a concrete school practice. The present study is a case study and investigates two classes of Swedish upper secondary students presenting a three-weeks thematic assignment concerning sustainable urban planning.The empirical material consists of field notes, audio-recordings, video-recordings and students’texts. In order to analyse the students’ meanings about sustainable development a method inspired from pragmatic discourse analysis is used. The findings show how the students in their language usage constitute a harmony perspective on sustainable development. The results and implications for teaching and learning are finally discussed.

Visual Processing Affects the Neural Basis of Auditory Discrimination

2008 ◽  
Vol 20 (12) ◽  
pp. 2175-2184 ◽  
Author(s):  
Daniel S. Kislyuk ◽  
Riikka Möttönen ◽  
Mikko Sams
Keyword(s):  
Auditory Cortex ◽  
Visual Processing ◽  
Acoustic Stimulus ◽  
Mcgurk Effect ◽  
Visual Speech ◽  
Acoustic Features ◽  
Neural Basis ◽  
Visual Stream ◽  
Acoustic Stimuli ◽  
Sound Discrimination

The interaction between auditory and visual speech streams is a seamless and surprisingly effective process. An intriguing example is the “McGurk effect”: The acoustic syllable /ba/ presented simultaneously with a mouth articulating /ga/ is typically heard as /da/ [McGurk, H., & MacDonald, J. Hearing lips and seeing voices. Nature, 264, 746–748, 1976]. Previous studies have demonstrated the interaction of auditory and visual streams at the auditory cortex level, but the importance of these interactions for the qualitative perception change remained unclear because the change could result from interactions at higher processing levels as well. In our electroencephalogram experiment, we combined the McGurk effect with mismatch negativity (MMN), a response that is elicited in the auditory cortex at a latency of 100–250 msec by any above-threshold change in a sequence of repetitive sounds. An “odd-ball” sequence of acoustic stimuli consisting of frequent /va/ syllables (standards) and infrequent /ba/ syllables (deviants) was presented to 11 participants. Deviant stimuli in the unisensory acoustic stimulus sequence elicited a typical MMN, reflecting discrimination of acoustic features in the auditory cortex. When the acoustic stimuli were dubbed onto a video of a mouth constantly articulating /va/, the deviant acoustic /ba/ was heard as /va/ due to the McGurk effect and was indistinguishable from the standards. Importantly, such deviants did not elicit MMN, indicating that the auditory cortex failed to discriminate between the acoustic stimuli. Our findings show that visual stream can qualitatively change the auditory percept at the auditory cortex level, profoundly influencing the auditory cortex mechanisms underlying early sound discrimination.

Sign in / Sign up

Export Citation Format

Share Document