Using Spatial Audio in Game Technology for Expressing Mathematical Problems to Blind Students

Author(s):  
Flaithrí Neff ◽  
Ian Pitt

Game technology often offers solutions to problems that are difficult or impossible to solve in traditional educational settings. Maturing spatial audio technology being developed to enhance the playing experience of gamers is increasingly recognized as a promising method for relaying complex educational scenarios to blind students. The subject of mathematics is a prime example of complex information in education that has challenged teachers of blind students, the students themselves, and researchers for many years. This is especially prevalent in relation to mathematics with inherent spatial attributes or complex sequences that are most effectively portrayed in the traditional medium using visual diagrams or spatially organized symbols on a page. This chapter discusses the alternative uses of spatial sound in gaming industry for overcoming some of the problems associated with presenting some of these complex attributes in mathematics to blind students. The authors also present a theoretical framework designed to offer guidelines to audio game designers focused on presenting complex information to blind students using spatial sound technology. Furthermore, the authors present results of a pilot study examining the presentation of trigonometric shapes using game surround sound tools.

2018 ◽  
Vol 2018 ◽  
pp. 1-17 ◽  
Author(s):  
Simone Spagnol ◽  
György Wersényi ◽  
Michał Bujacz ◽  
Oana Bălan ◽  
Marcelo Herrera Martínez ◽  
...  

Electronic travel aids (ETAs) have been in focus since technology allowed designing relatively small, light, and mobile devices for assisting the visually impaired. Since visually impaired persons rely on spatial audio cues as their primary sense of orientation, providing an accurate virtual auditory representation of the environment is essential. This paper gives an overview of the current state of spatial audio technologies that can be incorporated in ETAs, with a focus on user requirements. Most currently available ETAs either fail to address user requirements or underestimate the potential of spatial sound itself, which may explain, among other reasons, why no single ETA has gained a widespread acceptance in the blind community. We believe there is ample space for applying the technologies presented in this paper, with the aim of progressively bridging the gap between accessibility and accuracy of spatial audio in ETAs.


Telepresence ◽  
1999 ◽  
pp. 40-56
Author(s):  
M P Hollier ◽  
A N Rimell ◽  
D Burraston

2013 ◽  
Vol 37 (1) ◽  
pp. 11-22 ◽  
Author(s):  
Nils Peters ◽  
Trond Lossius ◽  
Jan C. Schacher

SpatDIF, the Spatial Sound Description Interchange Format, is an ongoing collaborative effort offering a semantic and syntactic specification for storing and transmitting spatial audio scene descriptions. The SpatDIF core is a lightweight minimal solution providing the most essential set of descriptors for spatial sound scenes. Additional descriptors are introduced as extensions, expanding the namespace and scope with respect to authoring, scene description, rendering, and reproduction of spatial sound. A general overview presents the principles informing the specification, as well as the structure and the terminology of the SpatDIF syntax. Two use cases exemplify SpatDIF's potential for pre-composed pieces as well as interactive installations, and several prototype implementations that have been developed show its real-life utility.


Author(s):  
Jan C. Schacher

Beginning with a brief historical overview of spatial audio and music practices, this chapter looks at principles of sound spatialization, algorithms for composing and rendering spatial sound and music, and different techniques of spatial source positioning and sound space manipulation. These operations include composing with abstract objects in a sound scene, creating compound sounds using source clusters, altering spatial characteristics by means of spectral sound decomposition, and the manipulation of artificial acoustic spaces. The chapter goes on to discuss practical issues of live spatialization and, through an example piece, the ways a number of different algorithms collaborate in the constitution of a generative audio-visual installation with surround audio and video. Finally, the challenges and pitfalls of using spatialization and some of the common reasons for failure are brought to attention.


2020 ◽  
Vol 29 (4) ◽  
pp. 1783-1797
Author(s):  
Kelly L. Coburn ◽  
Diane L. Williams

Purpose Neurodevelopmental processes that begin during gestation and continue throughout childhood typically support language development. Understanding these processes can help us to understand the disruptions to language that occur in neurodevelopmental conditions, such as autism spectrum disorder (ASD). Method For this tutorial, we conducted a focused literature review on typical postnatal brain development and structural and functional magnetic resonance imaging, diffusion tensor imaging, magnetoencephalography, and electroencephalography studies of the neurodevelopmental differences that occur in ASD. We then integrated this knowledge with the literature on evidence-based speech-language intervention practices for autistic children. Results In ASD, structural differences include altered patterns of cortical growth and myelination. Functional differences occur at all brain levels, from lateralization of cortical functions to the rhythmic activations of single neurons. Neuronal oscillations, in particular, could help explain disrupted language development by elucidating the timing differences that contribute to altered functional connectivity, complex information processing, and speech parsing. Findings related to implicit statistical learning, explicit task learning, multisensory integration, and reinforcement in ASD are also discussed. Conclusions Consideration of the neural differences in autistic children provides additional scientific support for current recommended language intervention practices. Recommendations consistent with these neurological findings include the use of short, simple utterances; repetition of syntactic structures using varied vocabulary; pause time; visual supports; and individualized sensory modifications.


1999 ◽  
Author(s):  
W. Todd Nelson ◽  
Robert S. Bolia ◽  
Mark A. Ericson ◽  
Richard L. McKinley

Sign in / Sign up

Export Citation Format

Share Document