scholarly journals Digital Sign Language App for Deaf Children

Author(s):  
Akib Khan ◽  
Rohan Bagde ◽  
Arish Sheikh ◽  
Asrar Ahmed ◽  
Rahib Khan ◽  
...  

India has the highest population of hearing-impaired people in the world, numbering 18 million. Only 0.25 per cent of these numbers presently have access to bilingual education where knowledge of sign language is primary and that of a local language. Providing a platform that will help the entire hearing impaired community, their interpreters, families, and educators to understand sign language, will go a long way to facilitate easier conversations and exchange of ideas, thereby enabling a more inclusive society.

Sign language is a visual language that uses body postures and facial expressions. It is generally used by hearing-impaired people as a source of communication. According to the World Health Organization (WHO), around 466 million people (5% of the world population) are with hearing and speech impairment. Normal people generally do not understand this sign language and hence there is a communication gap between hearing-impaired and other people. Different phonemic scripts were developed such as HamNoSys notation that describes sign language using symbols. With the development in the field of artificial intelligence, we are now able to overcome the limitations of communication with people using different languages. Sign language translating system is the one that converts sign to text or speech whereas sign language generating system is the one that converts speech or text to sign language. Sign language generating systems were developed so that normal people can use this system to display signs to hearing-impaired people. This survey consists of a comparative study of approaches and techniques that are used to generate sign language. We have discussed general architecture and applications of the sign language generating system.


2021 ◽  
Vol 11 (8) ◽  
pp. 3439
Author(s):  
Debashis Das Chakladar ◽  
Pradeep Kumar ◽  
Shubham Mandal ◽  
Partha Pratim Roy ◽  
Masakazu Iwamura ◽  
...  

Sign language is a visual language for communication used by hearing-impaired people with the help of hand and finger movements. Indian Sign Language (ISL) is a well-developed and standard way of communication for hearing-impaired people living in India. However, other people who use spoken language always face difficulty while communicating with a hearing-impaired person due to lack of sign language knowledge. In this study, we have developed a 3D avatar-based sign language learning system that converts the input speech/text into corresponding sign movements for ISL. The system consists of three modules. Initially, the input speech is converted into an English sentence. Then, that English sentence is converted into the corresponding ISL sentence using the Natural Language Processing (NLP) technique. Finally, the motion of the 3D avatar is defined based on the ISL sentence. The translation module achieves a 10.50 SER (Sign Error Rate) score.


2019 ◽  
Vol 45 (4) ◽  
pp. 416-427 ◽  
Author(s):  
Alys Young ◽  
Lorenzo Ferrarini ◽  
Andrew Irving ◽  
Claudine Storbeck ◽  
Robyn Swannack ◽  
...  

This article concerns deaf children and young people living in South Africa who are South African Sign Language users and who participated in an interdisciplinary research project using the medium of teaching film and photography with the goal of enhancing resilience. Specifically, this paper explores three questions that emerged from the deaf young people’s experience and involvement with the project: (i) What is disclosed about deaf young people’s worldmaking through the filmic and photographic modality? (ii) What specific impacts do deaf young people’s ontologically visual habitations of the world have on the production of their film/photographic works? (iii) How does deaf young people’s visual, embodied praxis through film and photography enable resilience? The presentation of findings and related theoretical discussion is organised around three key themes: (i) ‘writing’ into reality through photographic practice, (ii) filmmaking as embodied emotional praxis and (iii) enhancing resilience through visual methodologies. The discussion is interspersed with examples of the young people’s own work.


Author(s):  
Franc Solina ◽  
Slavko Krapez ◽  
Ales Jaklic ◽  
Vito Komac

Deaf people, as a marginal community, may have severe problems in communicating with hearing people. Usually, they have a lot of problems even with such—for hearing people—simple tasks as understanding the written language. However, deaf people are very skilled in using a sign language, which is their native language. A sign language is a set of signs or hand gestures. A gesture in a sign language equals a word in a written language. Similarly, a sentence in a written language equals a sequence of gestures in a sign language. In the distant past deaf people were discriminated and believed to be incapable of learning and thinking independently. Only after the year 1500 were the first attempts made to educate deaf children. An important breakthrough was the realization that hearing is not a prerequisite for understanding ideas. One of the most important early educators of the deaf and the first promoter of sign language was Charles Michel De L’Epée (1712-1789) in France. He founded the fist public school for deaf people. His teachings about sign language quickly spread all over the world. Like spoken languages, different sign languages and dialects evolved around the world. According to the National Association of the Deaf, the American Sign Language (ASL) is the third most frequently used language in the United States, after English and Spanish. ASL has more than 4,400 distinct signs. The Slovenian sign language (SSL), which is used in Slovenia and also serves as a case study sign language in this chapter, contains approximately 4,000 different gestures for common words. Signs require one or both hands for signing. Facial expressions which accompany signing are also important since they can modify the basic meaning of a hand gesture. To communicate proper nouns and obscure words, sign languages employ finger spelling. Since the majority of signing is with full words, signed conversation can proceed with the same pace as spoken conversation.


2014 ◽  
Vol 4 (1) ◽  
pp. 61-88 ◽  
Author(s):  
Krister Schönström

This article examines the Swedish L2 development of deaf children by testing the validity of Processability Theory on deaf learners of Swedish as an L2. The study is cross-sectional and includes written data from 38 pupils (grades 5 and 10) from a school for deaf and hearing-impaired pupils in Sweden. The primary language used by the pupils is Swedish Sign Language with Swedish being considered their L2. The Swedish data have been analyzed through the lens of Processability Theory (PT). The results show that the grammatical development of deaf learners is similar to hearing learners of Swedish as an L2. The results therefore suggest that PT is applicable even for deaf learners of L2 Swedish.


2021 ◽  
Author(s):  
Ishika Godage ◽  
Ruvan Weerasignhe ◽  
Damitha Sandaruwan

It is no doubt that communication plays a vital role in human life. There is, however, a significant population of hearing-impaired people who use non-verbal techniques for communication, which a majority of the people cannot understand. The predominant of these techniques is based on sign language, the main communication protocol among hearing impaired people. In this research, we propose a method to bridge the communication gap between hearing impaired people and others, which translates signed gestures into text. Most existing solutions, based on technologies such as Kinect, Leap Motion, Computer vision, EMG and IMU try to recognize and translate individual signs of hearing impaired people. The few approaches to sentence-level sign language recognition suffer from not being user-friendly or even practical owing to the devices they use. The proposed system is designed to provide full freedom to the user to sign an uninterrupted full sentence at a time. For this purpose, we employ two Myo armbands for gesture-capturing. Using signal processing and supervised learning based on a vocabulary of 49 words and 346 sentences for training with a single signer, we were able to achieve 75-80% word-level accuracy and 45-50% sentence level accuracy using gestural (EMG) and spatial (IMU) features for our signer-dependent experiment.


Author(s):  
Clélia Nogueira ◽  
Edna Machado

Tem como propósito analisar os resultados de pesquisas realizadas com crianças surdas acerca do desenvolvimento cognitivo, com base na teoria psicogenética de Jean Piaget. A primeira teve como objetivo investigar o desenvolvimento das estruturas de classificação, seriação e conservação do número em crianças surdas em idade pré-escolar. A segunda avaliou o desenvolvimento de crianças surdas com idade variando entre 12 e 14 anos, ou seja, as estruturas referentes aos períodos operatório-concreto e operatório-formal, segundo a teoria psicogenética. Uma terceira pesquisa, desenvolvida sob a orientação de uma das pesquisadoras, tinha como objetivo verificar se as crianças surdas educadas sob a concepção bilíngüe apresentavam diferenças no desenvolvimento cognitivo em relação àquelas examinadas nas duas anteriores. Todas as três pesquisas foram desenvolvidas a partir do método clínico tal como idealizado por Piaget. A análise dos resultados nos permite afirmar que a tese piagetiana da insuficiência da linguagem para a construção das estruturas cognitivas está confirmada em nossos estudos, mas, por outro lado, podemos dizer que os resultados nos apontam para a existência de outros fatores que precisam ser compreendidos no desenvolvimento cognitivo do surdo. A adoção da língua de sinais é um avanço na concepção da surdez e, com certeza, permite ao surdo ampliar seu universo de relações afetivas e sociais com seus pares, mas entendemos que a adoção da abordagem bilíngüe não é a solução definitiva para a educação dos surdos. Apesar de ser imprescindível que os surdos aprendam, o mais cedo possível, uma língua de sinais, a sua educação, nos parece, necessita ainda de um cuidado especial. Palavras-chave: surdez; desenvolvimento cognitivo dos surdos; bilingüismo. Abstract Results from research with deaf children and their cognitive development are analyzed by Piaget's psychogenetic theory. Whereas the first research investigated the development of classification, series listing and number conservation in pre-school deaf children, the second evaluated the development of 12-14-year-old deaf children, or rather, the structures comprising the concrete operatory and formal operatory periods of the psychogenetic theory. A third research, undertaken by one of the authors, verified whether deaf children who received bilingual education showed any differences in cognitive development in contrast to those in the former two researches. The three researches have been developed according to Piaget's clinical method. Results show that our analysis confirmed Piaget's thesis of language insufficiency for the construction of cognitive structures. On the other hand, results also indicate other factors that must be understood with regard to deaf people's cognitive development. The use of the natural language for the deaf, or sign language, is a landmark in the knowledge on deafness and will help deaf people to broaden their affective and social relationships with their peers. The adoption of the bilingual approach will not be the definite solution for the education of deaf people. Although deaf people must learn sign language as early as possible, special care should be dispensed in the course of their educational formation. Keywords: deafness; cognitive development of deaf people; bilingualism.


Sign in / Sign up

Export Citation Format

Share Document