scholarly journals 3D Sound Coding Color for the Visually Impaired

Electronics ◽  
2021 ◽  
Vol 10 (9) ◽  
pp. 1037
Author(s):  
Yong Lee ◽  
Chung-Heon Lee ◽  
Jun Dong Cho

Contemporary art is evolving beyond simply looking at works, and the development of various sensory technologies has had a great influence on culture and art. Accordingly, opportunities for the visually impaired to appreciate visual artworks through various senses such as auditory and tactile senses are expanding. However, insufficient sound expression and lack of portability make it less understandable and accessible. This paper attempts to convey a color and depth coding scheme to the visually impaired, based on alternative sensory modalities, such as hearing (by encoding the color and depth information with 3D sounds of audio description) and touch (to be used for interface-triggering information such as color and depth). The proposed color-coding scheme represents light, saturated, and dark colors for red, orange, yellow, yellow-green, green, blue-green, blue, and purple. The paper’s proposed system can be used for both mobile platforms and 2.5D (relief) models.

Electronics ◽  
2020 ◽  
Vol 9 (11) ◽  
pp. 1981
Author(s):  
Jun Dong Cho ◽  
Jaeho Jeong ◽  
Ji Hye Kim ◽  
Hoonsuk Lee

The recent development of color coding in tactile pictograms helps people with visual impairments (PVI) appreciate the visual arts. The auditory sense, in conjunction with (or possibly as an alternative to) the tactile sense, would allow PVI to perceive colors in a way that would be difficult to achieve with just a tactile stimulus. Sound coding colors (SCCs) can replicate three characteristics of colors, i.e., hue, chroma, and value, by matching them with three characteristics of sound, i.e., timbre, intensity, and pitch. This paper examines relationships between sound (melody) and color mediated by tactile pattern color coding and provides sound coding for hue, chroma, and value to help PVI deepen their relationship with visual art. Our two proposed SCC sets use melody to improve upon most SCC sets currently in use by adding more colors (18 colors in 6 hues). User experience and identification tests were conducted with 12 visually impaired and 8 sighted adults, and the results suggest that the SCC sets were helpful for the participants.


Electronics ◽  
2021 ◽  
Vol 10 (9) ◽  
pp. 1064
Author(s):  
Jun-Dong Cho ◽  
Yong Lee

Visually impaired visitors experience many limitations when visiting museum exhibits, such as a lack of cognitive and sensory access to exhibits or replicas. Contemporary art is evolving in the direction of appreciation beyond simply looking at works, and the development of various sensory technologies has had a great influence on culture and art. Thus, opportunities for people with visual impairments to appreciate visual artworks through various senses such as hearing, touch, and smell are expanding. However, it is uncommon to provide a multi-sensory interactive interface for color recognition, such as integrating patterns, sounds, temperature, and scents. This paper attempts to convey a color cognition to the visually impaired, taking advantage of multisensory coding color. In our previous works, musical melodies with different combinations of pitch, timbre, velocity, and tempo were used to distinguish vivid (i.e., saturated), light, and dark colors. However, it was rather difficult to distinguish among warm/cool/light/dark colors with using sound cues only. Therefore, in this paper, we aim to build a multisensory color-coding system with combining sound and poem such that poem leads to represent more color dimensions, such as including warm and cool colors for red, orange, yellow, green, blue, and purple. To do this, we first performed an implicit association test to identify the most suitable poem among the candidate poems to represent colors in artwork by finding the common semantic directivity between the given candidate poem with voice modulation and the artwork in terms of light/dark/warm/color dimensions. Finally, we conducted a system usability test on the proposed color-coding system, confirming that poem will be an effective supplement for distinguishing between vivid, light, and dark colors with different color appearance dimensions, such as warm and cold colors. The user experience score of 15 college students was 75.1%, that was comparable with the color-music coding system that received a user experience rating of 74.1%. with proven usability.


Author(s):  
Rachel Sarah Osolen ◽  
Leah Brochu

While working as production assistants for the National Network of Equitable Library Service (NNELS), an organization that creates and shares accessible versions of books to people with print disabilities, we were tasked with a challenging request from a user: Could we make an accessible version of the comic book The Walking Dead? Audio description services are available to the visually impaired in a few different venues such as television, movies, and live theatre. Guidelines for the creation of these descriptive texts are available to potential creators, but in our case, we could find nothing that would help guide us to create a described comic book. While some people and organizations have created prose novelizations of comic books, these simply tell the story, and do not include the unique visual aspects of reading a comic book. We have found that it is possible to create a balanced description that combines the visual grammar of a comic with the narrative story. In addition to creating a described comic book, we are developing guiding documentation that will be a necessary tool to ensure that visually impaired readers have a comic book experience (CBE) that (a) closely matches the CBE of a sighted reader, and (b) is standardized across producers, so that the onus of understanding the approach to comic book description (CBD) is not put on the visually impaired reader. At this point in our work, we need more feedback from users with print disabilities to ensure we are meeting the highest standards.


Author(s):  
Alfonso Sánchez Orea

In order to give visually impaired people a greater degree of inclusion in society, it is necessary to consider not only aspects related to independence in their physical mobility but also in their intellectual and labor mobility. Currently if a blind person needs information from a book, it must be previously translated in Braille language; in addition, the person must know this language or in the absence there should be the audio version. Most public and private libraries do not currently have books in Braille versions or in their absence audio books, so getting the information to perform some task is complicated. On the other hand, translating books from their original version into Braille language or its audio version is a titanic and expensive task, so in the chapter, the authors propose a technological solution based on the mobile platforms for the blind to perform this task in the place and time necessary without more resources than a Smartphone.


2020 ◽  
pp. 026461962093593 ◽  
Author(s):  
Mariana Lopez ◽  
Gavin Kearney ◽  
Krisztián Hofstädter

Enhancing Audio Description is a research project that explores how sound design, first-person narration, and binaural audio could be utilised to provide accessible versions of films for visually impaired audiences, presenting an alternative to current audio description (AD) practices. This article explores such techniques in the context of the redesign of the short film ‘Pearl’, by discussing the creative process as well as evaluating the feedback supplied by visually impaired audiences. The research presented in this article demonstrates that the methods proposed were as successful as traditional AD in terms of providing information, enjoyment, and accessibility to audiences, demonstrating that both practices can coexist and, as a result, cater for the different stylistic preferences of end users.


2021 ◽  
Vol 48 (4) ◽  
pp. 65-77
Author(s):  
Teresa Tomaszkiewicz

In this paper the author demonstrates the limits of audio description in the transfer of the humorous effects of a film comedy which constitute the “semantic dominant” of this kind of production. The analysis is illustrated by examples from Philippe de Chauveron’s film, À bras ouverts (2017). In this form of intersemiotic translation, the lack of certain visual data can block the possibility of understanding the comic by blind or visually impaired people. The author tries to propose some solutions to this problem in the form of creative audio description.


2018 ◽  
Vol 19 (1) ◽  
pp. 99-111 ◽  
Author(s):  
Virginia P. Campos ◽  
Tiago M. U. de Araújo ◽  
Guido L. de Souza Filho ◽  
Luiz M. G. Gonçalves

Agriculture ◽  
2020 ◽  
Vol 10 (6) ◽  
pp. 219
Author(s):  
Gianluca Stefani ◽  
Giuseppe Nocella ◽  
Giovanna Sacchi

Despite the fact that policy makers and governments are promoting the development of diverse agro-bio food systems to push and promote sustainability, they are challenging to implement because of a series of obstacles that hinder a successful transition from a conventional to an agro-ecological model of agriculture. Produce is extremely heterogeneous and agricultural technology is often not standard, rather alternative, and knowledge is contextual, tacit and place-specific. However, information about the characteristics of these systems is still sparse and difficult to analyse because of the complexity and multidimensionality. As a result, the aim of this paper is to review the existing literature in order to identify a coding system that allows for the creation of a meta-database of case studies on agroecological transitions. This coding system will be piloted in six case studies dealing with agrobiodiversity along cereal food systems producing grains, bread and pasta in France, Italy and the UK. In this analysis, we found that both the transition towards sustainable agriculture and the reduction of transaction costs require social innovation, which benefits from strong social capital. In the conclusions, we discuss the efficacy of the proposed coding scheme and its ability to capture in-depth information contained in similar case studies.


Sign in / Sign up

Export Citation Format

Share Document