Ulster University Logo

Gesture and Embodied Metaphor in Spatial Music Performance Systems Design

Graham, Ricky and Bridges, Brian (2014) Gesture and Embodied Metaphor in Spatial Music Performance Systems Design. In: NIME 2014 (New Interfaces for Musical Expression), Goldsmiths, University of London. Goldsmiths University of London. 655 pp. [Conference contribution]

Full text not available from this repository.

URL: http://www.nime2014.org/technical-programme/proceedings/


This paper describes the theoretical underpinnings, design, and development of a hyper–instrumental performance system driven by gestural data obtained from an electric guitar. The system combines a multichannel audio feed from the guitar (which is parsed for its pitch, spectral content and note inter–onset time data to provide abstractions of sounded performance gestures) with motion tracking of the performer’s larger–scale bodily movements using a Microsoft Xbox Kinect sensor. These gestural materials are used to provide the basis for the structures of relational mappings, informed by the embodied image schema structures of Lakoff and Johnson. These theoretical perspectives are refined via larger–scale ecological–embodied structural relationships in electroacoustic music outlined in Smalley’s theory of spectromorphology, alongside the incorporation of an additional active–agential response structure through the use of the boids flocking algorithm by Reynolds to control the spatialization of outputs and other textural processes. The paper aims to advance a broadly–applicable ‘performance gesture ecology’, providing a shared spatial–relational mapping (a ‘basic gestural space’) which allows for creative (but still coherent) mappings from the performance gestures to the control of textural and spatial structures.

Item Type:Conference contribution (Other)
Keywords:Gesture, embodied, schemas, boids, flocking, spatialization, mapping
Faculties and Schools:Faculty of Arts
Faculty of Arts > School of Creative Arts and Technologies
Research Institutes and Groups:Arts and Humanities Research Institute
Arts and Humanities Research Institute > Creative Arts and Technologies
ID Code:29889
Deposited By: Dr Brian Bridges
Deposited On:12 Aug 2014 06:57
Last Modified:12 Aug 2014 06:57

Repository Staff Only: item control page