The fungible audio-visual mapping and its experience
Miniatura indisponível
Data
2014
Título da revista
ISSN da revista
Título do Volume
Editora
Resumo
This article draws a perceptual approach to audio-visual mapping. Clearly perceivable cause and effect relationships can be problematic if one desires the audience to experience the music. Indeed perception would bias those sonic qualities that fit previous concepts of causation, subordinating other sonic qualities, which may form the relations between the sounds themselves. The question is, how can an audio-visual mapping produce a sense of causation, and simultaneously confound the actual cause-effect relationships. We call this a fungible audio-visual mapping. Our aim here is to glean its constitution and aspect. We will report a study, which draws upon methods from experimental psychology to inform audio-visual instrument design and composition. The participants are shown several audio-visual mapping prototypes, after which we pose quantitative and qualitative questions regarding their sense of causation, and their sense of understanding the cause-effect relationships. The study shows that a fungible mapping requires both synchronized and seemingly non-related components – sufficient complexity to be confusing. As the specific cause-effect concepts remain inconclusive, the sense of causation embraces the whole. KEYWORDS: Audio-visual Mapping; Perception; Causation; Multisensory Integration; User Studies.
Descrição
Journal Of Science And Technology Of The Arts
Palavras-chave
AUDIOVISUAL, AUDIOVISUAL, PERCEÇÃO MUSICAL, MUSIC PERCEPTION, EXPRESSÃO MUSICAL, MUSICAL EXPRESSION, EXPERIÊNCIA DO UTILIZADOR, USER EXPERIENCE
Citação
Sá, Adriana; Caramieux, Baptiste; Tanaka, Atau (2015) The Fungible Audio-Visual Mapping and its Experience. Journal Of Science And Technology Of The Arts vol. 6 No. 1 pp.: 85-96