A Review of Intelligent Smartphone-Based Object Detection Techniques for Visually Impaired People

Visually impaired people face numerous difficulties in their daily life, and technological interventions may assist them to meet these challenges. This paper proposes an artificial intelligence-based fully automatic assistive technology to recognize different objects, and auditory inputs are provided to the user in real time, which gives better understanding to the visually impaired person about their surroundings. A deep-learning model is trained with multiple images of objects that are highly relevant to the visually impaired person. Training images are augmented and manually annotated to bring more robustness to the trained model. In addition to computer vision-based techniques for object recognition, a distance-measuring sensor is integrated to make the device more comprehensive by recognizing obstacles while navigating from one place to another. The auditory information that is conveyed to the user after scene segmentation and obstacle identification is optimized to obtain more information in less time for faster processing of video frames. The average accuracy of this proposed method is 95.19% and 99.69% for object detection and recognition, respectively. The time complexity is low, allowing a user to perceive the surrounding scene in real time.

Download Full-text

Interactive Sound Generation to Aid Visually Impaired People via Object Detection Using Touch Screen Sensor

Sensors and Materials ◽

10.18494/sam.2021.3528 ◽

2021 ◽

Vol 33 (11) ◽

pp. 4057

Author(s):

Tias Kurniati ◽

Chuan-Kai Yang ◽

Tzer-Shyong Chen ◽

Yu-Fang Chung ◽

Yu-Min Huang ◽

...

Keyword(s):

Object Detection ◽

Visually Impaired ◽

Touch Screen ◽

Sound Generation ◽

Visually Impaired People ◽

Impaired People

Download Full-text

Real-Time Object Detection using Deep Learning and Open CV

International Journal of Innovative Technology and Exploring Engineering - Special Issue ◽

10.35940/ijitee.l1103.10812s19 ◽

2019 ◽

Vol 8 (12S) ◽

pp. 411-414

Keyword(s):

Neural Network ◽

Object Detection ◽

Visually Impaired ◽

Deep Neural Network ◽

Raspberry Pi ◽

Detailed Review ◽

Real World Application ◽

Satisfactory Performance ◽

Visually Impaired People ◽

Impaired People

The object detection is used in almost every realworld application such as autonomous traversal, visual system, face detection and even more. This paper aims at applying object detection technique to assist visually impaired people. It helps visually impaired people to know about the objects around them to enable them to walk free. A prototype has been implemented on a Raspberry PI 3 using OpenCV libraries, and satisfactory performance is achieved. In this paper, detailed review has been carried out on object detection using region – conventionaal neural network (RCNN) based learning systems for a real-world application. This paper explores the various process of detecting objects using various object detections methods and walks through detection including a deep neural network for SSD implemented using Caffe model.

Download Full-text