Experience art in the form of music.
—
Roles: User Experience Researcher, Interaction Designer, Product Manager
Timeline: 1 week - Microsoft One Week Hackathon (2017).
Team: David Vega Ramirez, Francisco Valente Castro, Nelson Troncoso Aldas, Priscilla Nini Ikhena, Eduardo Romo Almazan, Diego Garza, Pablo Alejandro, Diya Joy, Saijel Varma, and Anukrati Agrawal.
Where each painting has its own unique sound/song, based on the emotions that are depicted in the painting.
Our intention for creating such an application was to enhance the experience of viewing art, and also to provide a way for individuals who are visually impaired to experience art in a unique way. The technology was implemented using Microsoft’s Cognitive Services and Emotion API for emotion recognition, as well as Machine Learning.
For this project, I was responsible for all things related to design research, defining personas and scenarios, and the interaction/UX design.
After developing a prototype, we then went on to carry out evaluations and usability tests with potential users, including individuals who are visually impaired, in order to get their feedback and reiterate on our application.
In addition to using the application to hear art musically, users also used it to take selfies and listen to the music that was generated from their photos. We coined these sound portraits.
For this project, we used: the Microsoft Azure Cognitive Services for face detection and sentiment analysis.
Watch our demo below: