Development of Haptic Communication Device for Disabled Persons

Author(s):  
Zoltán Szabó ◽  
Eniko T. Enikov

With the emergence of augmented and virtual-reality based information delivery technologies the gap between availability of communication devices for visually impaired people and sighted people is emerging. The current study describes a communication tool which provides a reading platform for visually impaired people by means of a haptic display. In this paper the development and human subject study based evaluation of an electromagnetic microactuator-array based virtual tactile display is presented. The actuator array is comprised of a 4 by 5 array of micro voice-coil actuators (tactors) providing vibrotactile stimulation on the user’s fingertip. The size and performance of the actuators is evaluated against the thresholds of human tactile perception. It is demonstrated that a 2.65 mm (diameter) × 4 mm (height) generic tactor is suitable for practical applications in dynamic tactile displays. The maximum force of the actuator was 30 mN generated at current levels of 200 mA. At a stroke of 4.5 mm, the force is reduced to 10 mN. The peak force was generated at a displacement of 1.5 mm. A total of 10 alpha-numeric symbols were displayed to the users via dynamically changing the location of the vibrating point in a predefined sequence, thus creating a tactile perception of continuous curve. Users were asked to sketch out the perceived symbols. Each subject carried out three experiments. The first experiment exposed all subjects to ten different characters. Data obtained from human subject tests suggest that users perceive most shapes accurately, however the existence of jump discontinuities in the flow of presentation of the curves lowers recognition efficiency most likely due to loss of sensation of solid reference point. Characters containing two or more discontinuous lines such as ‘X’ were more difficult to recognize in comparison to those described with a single line such as ‘P’, or ‘Z’. Analysis of the average character recognition rate from 10 volunteers concluded that any presented character was identified correctly in 7 out 10 tests. The second test included characters that were reused from the first experiment. Users had improved their character recognition performance as a consequence of repeated exposure and learning. A final set of experiments concluded that recognition of groups of characters, forming words, is the least efficient and requires further perfecting. Recommendations for improvements of the recognition rate are also included.

2019 ◽  
Vol 8 (2S8) ◽  
pp. 1033-1038

The number of visually impaired people appearing for various examination is increasing every year while on the other hand, there are several blind aspirants who are willing to enrich their knowledge through higher studies. Mathematics is one of the key language (subject) for those who are willing to pursue higher studies in science stream. There is a lot of advanced Braille techniques and OCR to speech conversion software's made available to help visual impaired community to pursue their education but still the number of visually impaired students getting admitted to higher education is less. This is not because most of the data is on paper in the form of books and documents. So, there is a great need to convert information from the physical domain into the digital domain which would help the visually impaired people to read the advanced mathematics text independently. Optical Character Recognition (OCR) systems for mathematics have received considerable attention in recent years due to the tremendous need for the digitization of printed documents. Existing literature reveals that, most of the works concentrated on recognizing handwritten mathematical symbols and some works revolve around complex algorithms. This paper proposes a simple, yet efficient approach to develop an OCR system for mathematics and its conversion to speech. For Mathematical symbol recognition, Skin and Bone algorithm is proposed, which proved its efficiency on a variety of data set. The proposed methodology has been tested on 50 equations comprising various symbols such as integral, differential, square, square root and currently achieving recognition rate of 92%.


Visual impairment persons are not able to do all works as normal persons especially during purchasing products in supermarket. To help the blind peoples recognise the objects a text reading method is proposed along with the help of camera. A motion detection method is used to detect the presence of the object. The audio instructions about all the objects and their location in supermarket are notified to the blind user that helps them to move freely inside the supermarket. The proposed system aims to make more convenient for the blind persons to purchase in a sophisticated environment. This system also provides easy shopping, consumers time is saved, etc. The implementation of proposed system is done using artificial intelligence and OCR technology. General Terms Visually impaired people, smart shopping, OCR.


2021 ◽  
Author(s):  
S. Anbarasi ◽  
S. Krishnaveni ◽  
R. Aruna ◽  
K. Karpagasaravanakumar

Visually impaired people fail to read the text with existing technology. The proposed project targeted to design a spectacle with a camera by which the blind visually impaired people can read whatever they want to read based on contemporary OCR (optical character recognition) technique and text-to-speech (TTS) engines. This proposed smart reader will read any kind of documents like books, magazines and mobiles. People can access this novel technology with blindness and limited vision. The earlier version of the proposed project was developed successfully with mobile reader which had certain drawbacks such as high cost due to the need of android mobile, not user friendly and improper focusing. To overcome these disadvantages, a spectacle type reader with camera is proposed in this project, which will be cost effective and more efficient.


Author(s):  
Tadahiro Sakai ◽  
◽  
Takuya Handa ◽  
Masatsugu Sakajiri ◽  
Toshihiro Shimizu ◽  
...  

We propose a new method of presenting two-dimensional information, such as figures and graphs, on a tactile display so that visually impaired people are able to perceive them quickly and accurately. The new presentation method is developed for a tactile-proprioceptive display, which can present information on not only conventional “concave–convex” tactile display, but also vibration presentation in arbitrary area on a tactile display and mechanical leading presentation by mechanically leading user’s fingers using haptic device. In this paper, we outline the abovementioned two presentation method and the developed tactile-prop display, and objectively evaluate the effects of the local area vibration presentation method as an integral part of the tactile-prop display in comparison with the conventional “concave–convex” presentation method. We conducted experiments to evaluate the effects of the proposed local area vibration presentation method using two typical content patterns. In Experiment 1, discreetly dispersed objects are searched, and in Experiment 2, the cross graphs of line segments are distinguished and perceived. The experiments have proved that the method is effective in reducing search and cognitive time as well as identifying the correct cognition of cross graphs, as compared to the “concave–convex” tactile presentation method.


2021 ◽  
Vol 33 (1) ◽  
pp. 97-107
Author(s):  
Kanon Fujino ◽  
◽  
Mihoko Niitsuma

Many studies have been conducted on walking support for visually impaired people. However, only a few studies have contributed to the wide understanding of their surrounding environment. In this study, the focus was on the flow of people in environmental information. The flow of people is formed by the presence of many pedestrians in the surroundings of the walking environment. If visually impaired people can independently make decisions by grasping the dynamic environment of people flow, they can walk with ease and peace of mind. A method is proposed that extracts people flow information and selects the information necessary for understanding the environment. The method utilizes vibrotactile stimulation. The effectiveness of the proposed method in determining the surrounding environment and the influence of vibration information on behavior decisions were verified.


Author(s):  
Mohamed Taha ◽  
Noha Abd-ElKareem ◽  
Mazen Selim

Visually impaired (VI) people suffer from many difficulties when accessing printed material using existing technologies. These problems may include text alignment, focus, accuracy, software processing speed, mobility, and efficiency. Current technologies such as flatbed scanners and OCR programs need to scan an entire page. Recently, VI people prefer mobile devices because of their handiness and accessibility, but they have problems with focusing the mobile camera on the printed material. In this paper, a real-time Arabic text-reading prototype for VI people is proposed. It is based on using a wearable device for a hand finger. It is designed as a wearable ring attached to a tiny webcam device. The attached camera captures the printed Arabic text and passes it to the Arabic OCR system. Finally, the recognized characters are translated into speech using the text-to-speech (TTS) technology. Experimental results demonstrate the feasibility of the proposed prototype. It achieved an accuracy of 95.86% for Arabic character recognition and 98.5% for English character recognition.


Sign in / Sign up

Export Citation Format

Share Document