EVALUATE THE PERFORMANCE OF AN SIGN LANGUAGE TRANSLATOR MOBILE APPLICATION

Augmented reality AR has been used for many years in different fields of education. It has provided advantages in learning, However, no applications focused on the initial learning of Ecuadorian sign language for children with hearing impairments in their primary school years have been found. In this paper we present the development of a mobile application based on augmented reality, the Unity tool was used as a platform for mobile devices and the Vuforia SDK complement for augmented reality. With this application, the child can see the gesticulation of words in sign language through the use of printed templates. It also has an option to perform a quiz that will allow it to evaluate the knowledge the children acquired from the learning module. The mobile application called ARSchool based on augmented reality which is designed and adapted for people with hearing impairment, mainly for school-age children, as support for the initial learning of sign language in Ecuador. Once the application was developed, it was tested both at school and at home, in which teachers and parents made children with hearing impairments interact

Download Full-text

Aplicación móvil para Aprender Lengua de Señas Mexicana

Revista de Tecnologías de la Información y Comunicaciones ◽

10.35429/jitc.2019.8.3.8.17 ◽

2019 ◽

pp. 8-17

Author(s):

Keyla Arisbeth Rojas-Chávez ◽

Ricardo Quini-Villegas

Keyword(s):

Sign Language ◽

Mobile Application ◽

Ad Hoc ◽

Eastern Region ◽

Learning Support ◽

Sign Language Interpreters ◽

Support Tool ◽

Learning And Teaching ◽

Human Thinking ◽

Education Support

This article presents the model of a mobile application, as a learning support tool, for children and adults who have a hearing disability or not, learning the Mexican Sign Language. This is to be achieved by means of animated images, a game and a translator who spells the words by means of the dactylographic alphabet. Supported by the Regular Education Support Services Unit (USAER), which is incorporated into the SEP, located in Morelia, Michoacán. Also like the Civil Association "My hands speak to help", which is located in Zitácuaro, Michoacán. Facilitating learning with this mobile application that is designed ad hoc to the eastern region of Michoacán, supported by sign language interpreters. The use of mobile technology allows more people to have access to this type of tools, facilitating learning and teaching. This is intended to human thinking to evolve so that people who have this condition can then contribute their ideas and knowledge in the future.

Download Full-text

A Mobile Application That Allows People Who Do Not Know Sign Language to Teach Hearing-Impaired People by Using Speech-to-Text Procedures

International Journal of Applied Mathematics Electronics and Computers ◽

10.18100/ijamec.682806 ◽

2020 ◽

pp. 27-33

Author(s):

Emre BİÇEK ◽

M. Nuri ALMALI

Keyword(s):

Sign Language ◽

Mobile Application ◽

Hearing Impaired ◽

Impaired People

Download Full-text

A Proposed Pedagogical Mobile Application for Learning Sign Language

International Journal of Interactive Mobile Technologies (iJIM) ◽

10.3991/ijim.v7i1.2387 ◽

2013 ◽

Vol 7 (1) ◽

Cited By ~ 2

Author(s):

Samir Abou El-Seoud ◽

Islam Taj-Eddin ◽

Ann Nosseir ◽

Hosam El-Sofany ◽

Nadine Abu Rumman

Keyword(s):

Sign Language ◽

Mobile Application

Download Full-text

About Sign Language Translator Application

Armenian Journal of Special Education ◽

10.24234/se.2021.3.1.267 ◽

2021 ◽

Vol 3 (1) ◽

pp. 25-38

Author(s):

Armine Navasardyan ◽

Gohar Knkoyan

Keyword(s):

Sign Language ◽

Operating Systems ◽

Mobile Application ◽

Mobile App ◽

New Words ◽

The People ◽

Audio Information ◽

Hearing Problems

The Sign language translator is a trilingual mobile app for translating speech into international sign language. The developed mobile application is designed for the people who have hearing problems and use sign language. It converts imported audio information into texts and simultaneously translates it into the international sign language. The application works for Armenian, Russian and English languages. It has an admin module that allows you to add new words, edit or remove them. It has simple three-language operating interfaces. The application works on both Windows and Android operating systems. It does not require additional resources or investments. It can be useful for inclusive societies and education.

Download Full-text

A Novel Technique for Speech Recognition and Visualization Based Mobile Application to Support Two-Way Communication between Deaf-Mute and Normal Peoples

Wireless Communications and Mobile Computing ◽

10.1155/2018/1013234 ◽

2018 ◽

Vol 2018 ◽

pp. 1-12 ◽

Cited By ~ 5

Author(s):

Kanwal Yousaf ◽

Zahid Mehmood ◽

Tanzila Saba ◽

Amjad Rehman ◽

Muhammad Rashid ◽

...

Keyword(s):

Speech Recognition ◽

Sign Language ◽

Mobile Technology ◽

Mobile Application ◽

Technology Development ◽

Normal Person ◽

Mel Frequency Cepstral Coefficients ◽

Face To Face ◽

Analysis Of Results ◽

Mobile Market

Mobile technology is very fast growing and incredible, yet there are not much technology development and improvement for Deaf-mute peoples. Existing mobile applications use sign language as the only option for communication with them. Before our article, no such application (app) that uses the disrupted speech of Deaf-mutes for the purpose of social connectivity exists in the mobile market. The proposed application, named as vocalizer to mute (V2M), uses automatic speech recognition (ASR) methodology to recognize the speech of Deaf-mute and convert it into a recognizable form of speech for a normal person. In this work mel frequency cepstral coefficients (MFCC) based features are extracted for each training and testing sample of Deaf-mute speech. The hidden Markov model toolkit (HTK) is used for the process of speech recognition. The application is also integrated with a 3D avatar for providing visualization support. The avatar is responsible for performing the sign language on behalf of a person with no awareness of Deaf-mute culture. The prototype application was piloted in social welfare institute for Deaf-mute children. Participants were 15 children aged between 7 and 13 years. The experimental results show the accuracy of the proposed application as 97.9%. The quantitative and qualitative analysis of results also revealed that face-to-face socialization of Deaf-mute is improved by the intervention of mobile technology. The participants also suggested that the proposed mobile application can act as a voice for them and they can socialize with friends and family by using this app.

Download Full-text

Measuring Effectiveness of Mobile Application in Learning Basic Mathematical Concepts Using Sign Language

Sustainability ◽

10.3390/su11113064 ◽

2019 ◽

Vol 11 (11) ◽

pp. 3064 ◽

Cited By ~ 2

Author(s):

Komal Parvez ◽

Muzafar Khan ◽

Javed Iqbal ◽

Muhammad Tahir ◽

Ahmed Alghamdi ◽

...

Keyword(s):

Sign Language ◽

Mobile Application ◽

Control Group ◽

Mathematical Concepts ◽

Special Child ◽

Significant Difference ◽

The Difference ◽

Gender Based ◽

Better Than ◽

Quiz Scores

Technology plays an important role in our society, especially in the field of education. It is quite regrettable that people, particularly the deaf, still face a lot of challenges in acquiring an education. Their learning methods are different as compared to hearing people. They use Sign Language (SL) rather than natural language to communicate and learn. They are required to put a lot of effort into learning different concepts using conventional pedagogies. Therefore, there is a dire need for some assistive technology to improve their learn-ability and understandability. In the present study, 192 deaf participants aged 5–10 years were sampled from two special child institutes. The objective of the present study was to determine the effectiveness of a mobile interface through a developed mobile application for learning basic mathematical concepts using Pakistan Sign Language (PSL). The present study bridges the gap between the technology-based method and conventional teaching methods, which are used for teaching mathematical concepts using PSL. The participants were divided into two groups, that is, one group learned through conventional methods (flash cards and board) and the other group through the developed mobile application. The difference in the performance of both the groups was evaluated by conducting quizzes. The quiz results were analyzed by the Z-test and ANOVA. The findings revealed that the Experimental Group (EG) participants, who were instructed by our mobile application showed higher proficiency in the quizzes as compared to the Control Group (CG). EG participants performed better than CG by 12% in the quizzes. A gender based difference was also observed for the quiz scores. Male participants in category C (word problem learning) performed 2.7% better than females in the EG and 2.5% better in the CG. Moreover, a significant difference was also observed in the time taken by participants in both groups to complete the quizzes. CG participants took 20 min longer than EG participants to complete the quizzes. The results of the ANOVA showed that the quiz scores were directly affected by the mode of teaching used for participants in both groups.

Download Full-text