VIMEO
Documentation: https://vimeo.com/228634638
Performance Excerpt: https://vimeo.com/228541508


DESCRIPTION
Opto-Phono-Kinesia (OPK) is a body-based audio-visual performance piece. The title “Opto-Phono-Kinesia” is a play on the possible synesthetic state involving connections between vision, sound and body motion. Theoretically, for a person who experiences this state, a specific colour could trigger both a sound (i.e. a particular note) and a body action (i.e. a flick of the hand). This synesthetic intersection is simulated in OPK by simultaneity of body movement, and audio-visual result.

Using the Gesture and Media System 3.0 (GAMS) motion tracking system, the performer can dynamically manipulate a complex immersive system using two small infrared trackers. With the FlashTrack 3D mapping software, single note melodies, drum hits, samples, light effects and images can be programmed to be triggered anywhere in 3D space. Individual parameters (filters, reverb, delay, light colour, image brightness, etc.) can be altered in real-time using changing x, y or z coordinates or velocity..


PERFORMANCE HISTORY
Upcoming Premiere: March 20, 2018, Tangible, Embedded and Embodied Interactions (TEI), Kulturhuset Stadsteatern, Stockholm, Sweden.


SYNESTHESIA MAP EXAMPLE
This maps is from the Performance Excerpt in the Vimeo link at the top of this page. Image/Light Colour is listed, followed by the matching music note, and where these two are activated on the z plane (floor to ceiling). The colour of the images passes through the spectrum, from Light Blue to Gold. Click on the audio controller below each colour to play the associated sound.