Sá, Adriana2023-06-192023-06-192013Sá, Adriana (2013) How an Audio-Visual Instrument Can Foster the Sonic Experience.. In Live Visuals, eds. L. Aceti, S. Gibson, S. M. Arisona, O. Sahin, Leonardo Almanac vol. 19 No. 3, MIT Press, pp. 284-305978-1-906897-22-2http://hdl.handle.net/10437/13962Live VisualsThe chapter formulates an understanding of how an audio-visual instrument can be composed in such a way that the experience is driven through sound organization – modulated, but not obfuscated, by a moving image. This is particularly challenging, as normally the audio-visual relationship is skewed in favor of the visual. The investigation is motivated by insights derived from artistic practice. It outlines psychophysical boundaries with the aid of existing cognition/ attention research, and it describes three principles for the creation audio-visual instruments. As an example, the article describes how they are explored in a specific audio-visual instrument, combining an acoustic zither and modified software from audio processing and video-game technologies. This instrument addresses the three principles while exploring the disparities between an acoustic and a digital output. Keywords: NIME, Audio-visual relationship, Musical expression, Perception, Multisensory integrationapplication/pdfengopenAccessAUDIOVISUALAUDIOVISUALPERCEÇÃO MUSICALMUSIC PERCEPTIONEXPRESSÃO MUSICALMUSICAL EXPRESSIONSENTIDOSSENSESHow an audio-visual instrument can foster the sonic experience.bookPart