Challenge | How can people with vision impairments experience exhibits such as those found at aquaria and zoos? What role can music play in improving the experience?

Process | We explored approaches to research, considering variations ranging from open ended to tightly controlled.

Design | Researchers brought improvisational musicians to the aquarium so they could play while watching the exhibits. Researchers also systematically interviewed them about their approach.

Outcome (anticipated) | Using computer vision to track the creatures, the system would automatically play certain tones that are mapped to certain movements.

This research was conducted at the Georgia Institute of Technology and the Georgia Aquarium in 2011. This project is part of a larger research effort led by the Sonification Lab.
Project Directors: Dr Bruce Walker, Carrie Bruce
Research Lead: Keith R Bujak
Research Team: Thom Gable, Riley Winton, Hyewon Suh