scholarly journals Android-based object recognition application for visually impaired

2021 ◽  
Vol 40 ◽  
pp. 03001
Author(s):  
Akilesh Salunkhe ◽  
Manthan Raut ◽  
Shayantan Santra ◽  
Sumedha Bhagwat
Keyword(s):  
Object Recognition ◽  
Object Detection ◽  
Real Time ◽  
Visually Impaired ◽  
Surrounding Environment ◽  
Visually Impaired People ◽  
Recent Advancement ◽  
Android App ◽  
Offline Processing ◽  
Audio Output

Detecting objects in real-time and converting them into an audio output was a challenging task. Recent advancement in computer vision has allowed the development of various real-time object detection applications. This paper describes a simple android app that would help the visually impaired people in understanding their surroundings. The information about the surrounding environment was captured through a phone’s camera where real-time object recognition through tensorflow’s object detection API was done. The detected objects were then converted into an audio output by using android’s text-to-speech library. Tensorflow lite made the offline processing of complex algorithms simple. The overall accuracy of the proposed system was found to be approximately 90%.

scholarly journals Electronic Orientation Aid for Visually Impaired using Graphics Processing Unit (GPU)

2020 ◽  
Vol 32 ◽  
pp. 03054
Author(s):  
Akshata Parab ◽  
Rashmi Nagare ◽  
Omkar Kolambekar ◽  
Parag Patil
Keyword(s):  
Real Time ◽  
Visually Impaired ◽  
Graphics Processing Unit ◽  
Human Perception ◽  
Processing Unit ◽  
Surrounding Environment ◽  
Visually Impaired People ◽  
Impaired People ◽  
Definition Of ◽  
Graphics Processing

Vision is one of the very essential human senses and it plays a major role in human perception about surrounding environment. But for people with visual impairment their definition of vision is different. Visually impaired people are often unaware of dangers in front of them, even in familiar environment. This study proposes a real time guiding system for visually impaired people for solving their navigation problem and to travel without any difficulty. This system will help the visually impaired people by detecting the objects and giving necessary information about that object. This information may include what the object is, its location, its precision, distance from the visually impaired etc. All these information will be conveyed to the person through audio commands so that they can navigate freely anywhere anytime with no or minimal assistance. Object detection is done using You Only Look Once (YOLO) algorithm. As the process of capturing the video/images and sending it to the main module has to be carried at greater speed, Graphics Processing Unit (GPU) is used. This will help in enhancing the overall speed of the system and will help the visually Impaired to get the maximum necessary instructions as quickly as possible. The process starts from capturing the real time video, sending it for analysis and processing and get the calculated results. The results obtained from analysis are conveyed to user by means of hearing aid. As a result by this system the blind or the visually impaired people can visualize the surrounding environment and travel freely from source to destination on their own.

scholarly journals Efficient Multi-Object Detection and Smart Navigation Using Artificial Intelligence for Visually Impaired People

Entropy ◽  
2020 ◽  
Vol 22 (9) ◽  
pp. 941
Author(s):  
Rakesh Chandra Joshi ◽  
Saumya Yadav ◽  
Malay Kishore Dutta ◽  
Carlos M. Travieso-Gonzalez
Keyword(s):  
Artificial Intelligence ◽  
Object Detection ◽  
Real Time ◽  
Visually Impaired ◽  
Auditory Information ◽  
Visually Impaired People ◽  
Video Frames ◽  
Average Accuracy ◽  
Impaired People ◽  
Impaired Person

Visually impaired people face numerous difficulties in their daily life, and technological interventions may assist them to meet these challenges. This paper proposes an artificial intelligence-based fully automatic assistive technology to recognize different objects, and auditory inputs are provided to the user in real time, which gives better understanding to the visually impaired person about their surroundings. A deep-learning model is trained with multiple images of objects that are highly relevant to the visually impaired person. Training images are augmented and manually annotated to bring more robustness to the trained model. In addition to computer vision-based techniques for object recognition, a distance-measuring sensor is integrated to make the device more comprehensive by recognizing obstacles while navigating from one place to another. The auditory information that is conveyed to the user after scene segmentation and obstacle identification is optimized to obtain more information in less time for faster processing of video frames. The average accuracy of this proposed method is 95.19% and 99.69% for object detection and recognition, respectively. The time complexity is low, allowing a user to perceive the surrounding scene in real time.

scholarly journals Currency Detection for Visually Impaired Iraqi Banknote as a Study Case

2021 ◽  
Vol 12 (6) ◽  
pp. 2940-2948
Author(s):  
Raghad Raied Mahmood Et al.
Keyword(s):  
Object Detection ◽  
Real Time ◽  
Visually Impaired ◽  
Detection System ◽  
Detection Algorithm ◽  
Geometric Transformations ◽  
Visually Impaired People ◽  
Paper Currency ◽  
Impaired People ◽  
Detection And Recognition

It is relatively simple for a normal human to interpret and understand every banknote, but one of the major problems for visually impaired people are money recognition, especially for paper currency. Since money plays such an important role in our everyday lives and is required for every business transaction, real-time detection and recognition of banknotes become a necessity for blind or visually impaired people For that purpose, we propose a real-time object detection system to help visually impaired people in their daily business transactions. Dataset Images of the Iraqi banknote category are collected in different conditions initially and then, these images are augmented with different geometric transformations, to make the system strong. These augmented images are then annotated manually using the "LabelImg" program, from which training sets and validation image sets are prepared. We will use YOLOv3 real-time Object Detection algorithm trained on custom Iraqi banknote dataset for detection and recognition of banknotes. Then the label of the banknotes is identified and then converted into audio by using Google Text to Speech (gTTS), which will be the expected output. The performance of the trained model is evaluated on a test dataset and real-time live video. The test results demonstrate that the proposed method can detect and recognize Iraqi paper money with high mAP reaches 97.405% and a short time.

scholarly journals Real Time Object Recognition and Classification using Deep Learning

2019 ◽  
pp. 355-359
Author(s):  
Kiruthiga N ◽  
Divya E ◽  
Haripriya R ◽  
Haripriya V.
Keyword(s):  
Deep Learning ◽  
Object Recognition ◽  
Object Detection ◽  
Real Time ◽  
Visually Impaired ◽  
Detection Algorithm ◽  
Indoor Environments ◽  
Wide Range ◽  
Impaired Person ◽  
First Time

Navigation in indoor environments is highly challenging for visually impaired person, particularly in spaces visited for the first time. Various solutions have been proposed to deal with this challenge. In this project consider as the real time object Recognition and classification using deep learning algorithms. Object detection mainly deals with identification of real time objects such as people, animals, and objects. Object detection algorithm uses a wide range of image processing applications for extracting the object's desired portion. This enables one to identify the objects and calculate the accuracy of the object and deliver through voice. Using this information, the system determines the user's trajectory and can locate possible obstacles in that route.

scholarly journals CICERONE- A Real Time Object Detection for Visually Impaired People

2021 ◽  
Vol 1085 (1) ◽  
pp. 012006
Author(s):  
Therese Yamuna Mahesh ◽  
S S Parvathy ◽  
Shibin Thomas ◽  
Shilpa Rachel Thomas ◽  
Thomas Sebastian
Keyword(s):  
Object Detection ◽  
Real Time ◽  
Visually Impaired ◽  
Visually Impaired People ◽  
Impaired People

scholarly journals A Wearable Navigation Device for Visually Impaired People Based on the Real-Time Semantic Visual SLAM System

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1536
Author(s):  
Zhuo Chen ◽  
Xiaoming Liu ◽  
Masaru Kojima ◽  
Qiang Huang ◽  
Tatsuo Arai
Keyword(s):  
Real Time ◽  
Visually Impaired ◽  
Semantic Information ◽  
Visual Slam ◽  
Control Center ◽  
Computing Platform ◽  
Surrounding Environment ◽  
Visually Impaired People ◽  
Localization And Mapping ◽  
Impaired People

Wearable auxiliary devices for visually impaired people are highly attractive research topics. Although many proposed wearable navigation devices can assist visually impaired people in obstacle avoidance and navigation, these devices cannot feedback detailed information about the obstacles or help the visually impaired understand the environment. In this paper, we proposed a wearable navigation device for the visually impaired by integrating the semantic visual SLAM (Simultaneous Localization And Mapping) and the newly launched powerful mobile computing platform. This system uses an Image-Depth (RGB-D) camera based on structured light as the sensor, as the control center. We also focused on the technology that combines SLAM technology with the extraction of semantic information from the environment. It ensures that the computing platform understands the surrounding environment in real-time and can feed it back to the visually impaired in the form of voice broadcast. Finally, we tested the performance of the proposed semantic visual SLAM system on this device. The results indicate that the system can run in real-time on a wearable navigation device with sufficient accuracy.

Sign in / Sign up

Export Citation Format

Share Document