Creating a Robot Brain with Object Recognition Using Vocal Control, Text-to-Speech Support and a Simple Webcam

The sixth sense is a multi-platform app for aiding the people in need that is people who are handicapped in the form of lack of speech (dumb), lack of hearing (deaf), lack of sight (blind), lack of judicial power to differentiate between objects (visual agnosia) and people suffering from autism (characterized by great difficulty in communicating and forming relationships with other people and in using language and abstract concepts). Our current implementation of the product is on two platforms, namely, mobile and a web app. The mobile app even works for object detection cases in offline mode. What we want to achieve using this is to make a better world for the people suffering from disabilities as well as an educational end for people with cognitive disabilities using our app. The current implementation deals with object recognition and text to speech and a speech to text converter. The speech to text converter and text to speech converter utilized the Web Speech API (Application Program Interface) for the website and text to speech and speech to text library for the mobile platform. The object recognition wouldn't fetch enough use out of a website. Hence, it has been implemented on the mobile app utilizing the Firebase ML toolkit and different pre-trained models, which are both available offline as well as online.

Download Full-text

A Review of 21 iPad Applications for Augmentative and Alternative Communication Purposes

Perspectives on Augmentative and Alternative Communication ◽

10.1044/aac21.2.60 ◽

2012 ◽

Vol 21 (2) ◽

pp. 60-71 ◽

Cited By ~ 24

Author(s):

Ashley Alliano ◽

Kimberly Herriger ◽

Anthony D. Koutsoftas ◽

Theresa E. Bartolotta

Keyword(s):

Augmentative And Alternative Communication ◽

Cost Effective ◽

Alternative Form ◽

Alternative Communication ◽

Text To Speech ◽

Reference Guide ◽

Expressive Communication ◽

Communication Needs ◽

User Friendly ◽

Ipad Applications

Abstract Using the iPad tablet for Augmentative and Alternative Communication (AAC) purposes can facilitate many communicative needs, is cost-effective, and is socially acceptable. Many individuals with communication difficulties can use iPad applications (apps) to augment communication, provide an alternative form of communication, or target receptive and expressive language goals. In this paper, we will review a collection of iPad apps that can be used to address a variety of receptive and expressive communication needs. Based on recommendations from Gosnell, Costello, and Shane (2011), we describe the features of 21 apps that can serve as a reference guide for speech-language pathologists. We systematically identified 21 apps that use symbols only, symbols and text-to-speech, and text-to-speech only. We provide descriptions of the purpose of each app, along with the following feature descriptions: speech settings, representation, display, feedback features, rate enhancement, access, motor competencies, and cost. In this review, we describe these apps and how individuals with complex communication needs can use them for a variety of communication purposes and to target a variety of treatment goals. We present information in a user-friendly table format that clinicians can use as a reference guide.

Download Full-text

Use It and Still Lose It?

GeroPsych ◽

10.1024/1662-9647/a000020 ◽

2010 ◽

Vol 23 (3) ◽

pp. 169-175 ◽

Cited By ~ 14

Author(s):

Adrian Schwaninger ◽

Diana Hardmeier ◽

Judith Riegelnig ◽

Mike Martin

Keyword(s):

Object Recognition ◽

Cognitive Development ◽

Recognition Test ◽

Cognitive Aging ◽

Recognition Task ◽

Airport Security ◽

Visual Object ◽

Long Term Effects ◽

Object Recognition Test ◽

X Ray

In recent years, research on cognitive aging increasingly has focused on the cognitive development across middle adulthood. However, little is still known about the long-term effects of intensive job-specific training of fluid intellectual abilities. In this study we examined the effects of age- and job-specific practice of cognitive abilities on detection performance in airport security x-ray screening. In Experiment 1 (N = 308; 24–65 years), we examined performance in the X-ray Object Recognition Test (ORT), a speeded visual object recognition task in which participants have to find dangerous items in x-ray images of passenger bags; and in Experiment 2 (N = 155; 20–61 years) in an on-the-job object recognition test frequently used in baggage screening. Results from both experiments show high performance in older adults and significant negative age correlations that cannot be overcome by more years of job-specific experience. We discuss the implications of our findings for theories of lifespan cognitive development and training concepts.

Download Full-text