scholarly journals ColorPoetry: Multi-Sensory Experience of Color with Poetry in Visual Arts Appreciation of Persons with Visual Impairment

Electronics ◽  
2021 ◽  
Vol 10 (9) ◽  
pp. 1064
Author(s):  
Jun-Dong Cho ◽  
Yong Lee

Visually impaired visitors experience many limitations when visiting museum exhibits, such as a lack of cognitive and sensory access to exhibits or replicas. Contemporary art is evolving in the direction of appreciation beyond simply looking at works, and the development of various sensory technologies has had a great influence on culture and art. Thus, opportunities for people with visual impairments to appreciate visual artworks through various senses such as hearing, touch, and smell are expanding. However, it is uncommon to provide a multi-sensory interactive interface for color recognition, such as integrating patterns, sounds, temperature, and scents. This paper attempts to convey a color cognition to the visually impaired, taking advantage of multisensory coding color. In our previous works, musical melodies with different combinations of pitch, timbre, velocity, and tempo were used to distinguish vivid (i.e., saturated), light, and dark colors. However, it was rather difficult to distinguish among warm/cool/light/dark colors with using sound cues only. Therefore, in this paper, we aim to build a multisensory color-coding system with combining sound and poem such that poem leads to represent more color dimensions, such as including warm and cool colors for red, orange, yellow, green, blue, and purple. To do this, we first performed an implicit association test to identify the most suitable poem among the candidate poems to represent colors in artwork by finding the common semantic directivity between the given candidate poem with voice modulation and the artwork in terms of light/dark/warm/color dimensions. Finally, we conducted a system usability test on the proposed color-coding system, confirming that poem will be an effective supplement for distinguishing between vivid, light, and dark colors with different color appearance dimensions, such as warm and cold colors. The user experience score of 15 college students was 75.1%, that was comparable with the color-music coding system that received a user experience rating of 74.1%. with proven usability.


Electronics ◽  
2021 ◽  
Vol 10 (4) ◽  
pp. 470
Author(s):  
Jun Dong Cho

Visually impaired visitors experience many limitations when visiting museum exhibits, such as a lack of cognitive and sensory access to exhibits or replicas. Contemporary art is evolving in the direction of appreciation beyond simply looking at works, and the development of various sensory technologies has had a great influence on culture and art. Thus, opportunities for people with visual impairments to appreciate visual artworks through various senses such as hearing, touch, and smell are expanding. However, it is uncommon to provide an interactive interface for color recognition, such as applying patterns, sounds, temperature, or scents. This review aims to convey the visual elements of the work to the visually impaired through various sensory elements. In addition, to open a new perspective on appreciation of the works, the technique of expressing the color coded by integrating patterns, temperature, scent, music, and vibration was explored, and future research topics were presented.





Electronics ◽  
2021 ◽  
Vol 10 (9) ◽  
pp. 1037
Author(s):  
Yong Lee ◽  
Chung-Heon Lee ◽  
Jun Dong Cho

Contemporary art is evolving beyond simply looking at works, and the development of various sensory technologies has had a great influence on culture and art. Accordingly, opportunities for the visually impaired to appreciate visual artworks through various senses such as auditory and tactile senses are expanding. However, insufficient sound expression and lack of portability make it less understandable and accessible. This paper attempts to convey a color and depth coding scheme to the visually impaired, based on alternative sensory modalities, such as hearing (by encoding the color and depth information with 3D sounds of audio description) and touch (to be used for interface-triggering information such as color and depth). The proposed color-coding scheme represents light, saturated, and dark colors for red, orange, yellow, yellow-green, green, blue-green, blue, and purple. The paper’s proposed system can be used for both mobile platforms and 2.5D (relief) models.





Electronics ◽  
2020 ◽  
Vol 9 (11) ◽  
pp. 1981
Author(s):  
Jun Dong Cho ◽  
Jaeho Jeong ◽  
Ji Hye Kim ◽  
Hoonsuk Lee

The recent development of color coding in tactile pictograms helps people with visual impairments (PVI) appreciate the visual arts. The auditory sense, in conjunction with (or possibly as an alternative to) the tactile sense, would allow PVI to perceive colors in a way that would be difficult to achieve with just a tactile stimulus. Sound coding colors (SCCs) can replicate three characteristics of colors, i.e., hue, chroma, and value, by matching them with three characteristics of sound, i.e., timbre, intensity, and pitch. This paper examines relationships between sound (melody) and color mediated by tactile pattern color coding and provides sound coding for hue, chroma, and value to help PVI deepen their relationship with visual art. Our two proposed SCC sets use melody to improve upon most SCC sets currently in use by adding more colors (18 colors in 6 hues). User experience and identification tests were conducted with 12 visually impaired and 8 sighted adults, and the results suggest that the SCC sets were helpful for the participants.



2013 ◽  
Vol 415 ◽  
pp. 155-160 ◽  
Author(s):  
M. Shafik

This paper presents an innovative tactile interactive interface graphical display for visually impaired people, information technology (IT) access application. The display consists of matrix of dots. Each dot is an electro rheological fluid micro actuator. The micro-actuator designed based on linear vertical movement principles. The actuator design and development process is presented in this paper. An advanced software tools and embedded system based on voltage matrix manipulation are developed to provide the display near real time control. Prototype size 124x4 dots, on a matrix form, of 2.54mm pitch, was manufactured. The experimental tests carried out into the prototype showed that each actuator of the matrix was able to provide a vertical holding force of 100 to 200 mN and vertical movement of 0.7 mm. The stroke and dynamic response tests showed the practicability of the developed micro actuation system, for tactile display IT access applications.



1981 ◽  
Vol 29 (12) ◽  
pp. 1849-1858 ◽  
Author(s):  
W. Schreiber ◽  
R. Buckley


1976 ◽  
Vol 21 (3) ◽  
pp. 10536J ◽  
Author(s):  
C. Fouweather ◽  
R. W. May ◽  
J. Porter


Sign in / Sign up

Export Citation Format

Share Document