The application of extension neuro-network on computer-assisted lip-reading recognition for hearing impaired

2008 ◽  
Vol 34 (2) ◽  
pp. 1465-1473 ◽  
Author(s):  
Y LAY ◽  
C TSAI ◽  
H YANG ◽  
C LIN ◽  
C LAI
1984 ◽  
Vol 63 (3) ◽  
pp. 162-167 ◽  
Author(s):  
BARBARA GELESKO McKEE ◽  
KATHLEEN SCHROEDL CHIAVAROLI

QJM ◽  
2020 ◽  
Vol 113 (Supplement_1) ◽  
Author(s):  
A M Saad ◽  
M A Hegazi ◽  
M S Khodeir

Abstract Background Lip-reading is considered an important skill which varies considerably among normal hearing and hearing impaired (HI) children. It helps HI children to perceive speech, acquire spoken language and acquire phonological awareness. Speech perception is considered to be a multisensory process that involves attention to auditory signals as well as visual articulatory movements. Integration of auditory and visual signals occurs naturally and automatically in normal individuals across all ages. Many researches suggested that normal hearing children use audition as the primary sensory modality for speech perception, whereas HI children use lip-reading cues as the primary sensory modality for speech perception. Aim of the Work The aim of this study is to compare the lip-reading ability between normal and HI children. Participants and methods This is a comparative descriptive case control study. It was applied on 60 hearing impaired children (cases) and 60 normal hearing children (controls) of the same age and gender. The age range was (3-8 years). The Egyptian Arabic Lip-reading Test was applied to all children. Results There was statistically significant difference between the total mean scores of the EALRT between normal and HI children. Conclusion The results of the study proved that normal children are better lip-readers than HI children of the matched age range.


Author(s):  
D. Ivanko ◽  
D. Ryumin ◽  
A. Karpov

<p><strong>Abstract.</strong> Inability to use speech interfaces greatly limits the deaf and hearing impaired people in the possibility of human-machine interaction. To solve this problem and to increase the accuracy and reliability of the automatic Russian sign language recognition system it is proposed to use lip-reading in addition to hand gestures recognition. Deaf and hearing impaired people use sign language as the main way of communication in everyday life. Sign language is a structured form of hand gestures and lips movements involving visual motions and signs, which is used as a communication system. Since sign language includes not only hand gestures, but also lip movements that mimic vocalized pronunciation, it is of interest to investigate how accurately such a visual speech can be recognized by a lip-reading system, especially considering the fact that the visual speech of hearing impaired people is often characterized with hyper-articulation, which should potentially facilitate its recognition. For this purpose, thesaurus of Russian sign language (TheRusLan) collected in SPIIRAS in 2018–19 was used. The database consists of color optical FullHD video recordings of 13 native Russian sign language signers (11 females and 2 males) from “Pavlovsk boarding school for the hearing impaired”. Each of the signers demonstrated 164 phrases for 5 times. This work covers the initial stages of this research, including data collection, data labeling, region-of-interest detection and methods for informative features extraction. The results of this study can later be used to create assistive technologies for deaf or hearing impaired people.</p>


2021 ◽  
Vol 17 (2) ◽  
pp. 65-84
Author(s):  
Mohammad - Halili ◽  
Mahbub Arham Arrozy

This study aims to discuss the use of Total Communication (TC, henceforth), the combinations of communication modes, and the reasons for using TC for hearing-impaired (HI) students of English class at SLB PGRI Kamal. Teaching English to them is believed to require more strategic approaches especially when compared to students who do not have any hearing issues. The data are from four HI students at SLB PGRI Kamal and their English teacher. In collecting the data, observation, note taking and recording were used as the instruments in which during taking note and observation, the researchers used phone recorder and phone camera to anticipate the data from lost and for further analysis. The results show that there are seven communication modes that were used. Those are lip-reading, sign language, images, writing, Indonesian Alphabetic Symbol System (IAS), finger spelling, and speech. Those modes are combined depending on the needs of the users (both English teacher and HI students). Therefore, the researcher found six combinations of modes in TC. Moreover, the researchers found five reasons for using TC for HI students in the English classroom at SLB PGRI Kamal. It is because of its flexibility and effectiveness in communication. Futhermore, TC gives chances to HI students to learn to speak, write and read in English, and allow the HI students to make English sounds and identify them


Author(s):  
Mohammed Abid Abrar ◽  
A. N. M. Nafiul Islam ◽  
Mohammad Muntasir Hassan ◽  
Mohammad Tariqul Islam ◽  
Celia Shahnaz ◽  
...  

1979 ◽  
Vol 3 (1) ◽  
pp. 15-21 ◽  
Author(s):  
Raymond G. Fox

A programmable micro-processor controlled interactive media based instruction delivery system using super-8 film cassettes and addressable audio tape messages has been developed in order to make available to deaf and hearing impaired learners delivery of a wide range of validated media-based instructional materials. This paper describes the prototype system, unique instructional materials authoring methods, makes comparisons with conventional computer assisted instruction (CAI) and computer managed instruction (CMI), and discusses the system use not only in instruction delivery, but in instructional materials development and validation for use in creating videodisc masters. It outlines current plans for implementing this technology in the near future.


2011 ◽  
Vol 38 (4) ◽  
pp. 4477-4481 ◽  
Author(s):  
N. Puviarasan ◽  
S. Palanivel
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document