I am interested in changing the classical music performance scene by creating a media interface that would allow the audience to interact with the orchestra. The result would be a collaborative performance between professional musicians and their audience. This area of study, using intelligent visual stimuli in addition to traditional audio stimuli, has the potential to change music performance as well as music education.
My explorations in this area as an undergraduate have included the visualization of rhythm, chord qualities, and musical phrasing. Initially, my inspiration for these projects came from personal experience while practicing flute and later from information obtained in my psychology coursework. As a visual learner, I use imagery to achieve particular tone colors and characters of music. Psychology has taught me about how the brain mainly acts as a processor of images. With both of these inspirations in mind, I would like to create a music performance setting in which the audience can join in on the music making process by experiencing the visual stimuli that fuels musical expression of the individual and of the entire ensemble.
Visualization of Rhythm & chords
I used Processing and the Arduino to create a visual representation of a rhythmic pattern generated by the song "Here Comes The Sun". This project functions to assist people who may need more than just auditory stimuli to feel the rhythm of a song. We see a similar effect at rock concerts, when the lights blink in time with the music to help the audience groove with the beat. However, in this project, the blinking is generated by code that relates directly to a MIDI file of the song melody, as opposed to a click track that conveys a more general, metronomical beat. This project won Best In Show for the Physical Computing category at the 2017University of Miami Interactive Media Show.
Performance Art: Fruit keyboard
This project uses a Makey Makey to create a functional, octave-and-a-half piano keyboard made of fruit. The Makey Makey is a children's invention kit that uses computer code and circuit principles to allows physical objects to function as a computer keyboard. This project acted as performance art in one of my final undergraduate music concerts: I provided fruit bass line accompaniment for a flutist performing a movement of Bach Sonata in C.
More projects coming soon.