VIMEO
OPK Album: https://vimeo.com/album/5176262


SOUNDCLOUD
OPK set: https://soundcloud.com/steve-gibson-101/sets/opk


DESCRIPTION
Opto-Phono-Kinesia (OPK) is a body-based audio-visual performance piece. The title is a play on the possible synesthetic state involving connections between vision, sound and body motion. Theoretically, for a person who experiences this state, a specific colour could trigger both a sound (i.e. a particular note) and a body action (i.e. a flick of the hand). This synesthetic intersection is simulated in OPK by simultaneity of body movement, and audio-visual result.

Using the Gesture and Media System 3.0 (GAMS) motion tracking system, the performer can dynamically manipulate a complex immersive environment using two small infrared trackers. With the FlashTrack 3D mapping software, single note melodies, drum hits, samples, light effects and images can be programmed to be triggered anywhere in 3D space. Individual parameters (filters, reverb, delay, light colour, image brightness, etc.) can be altered in real-time using changing x, y or z coordinates or velocity. Conceptually OPK makes a case for physically-engaged interaction in response to much of present-day ‘lazy media,’ while at the same time the piece subtly references possible damaging uses of those technologies.


PERFORMANCE HISTORY
Premiere: March 19, 2018, Tangible, Embedded and Embodied Interactions (TEI), Stockholm, Sweden.


SYNESTHESIA MAP EXAMPLE
This maps is from the Performance Excerpt in the Vimeo link at the top of this page. Image/Light Colour is listed, followed by the matching music note, and where these two are activated on the z plane (floor to ceiling). The colour of the images passes through the spectrum, from Light Blue to Gold. Click on the audio controller below each colour to play the associated sound.