Rafaël Rozendaal's new app translates vision into melody
Now available! The new Iphone app by Rafaël Rozendaal: Here Hear.
The app translates vision into melody and uses color contrasts to recognize shapes. Point the camera anywhere to see the visual structure of what you see.
The second part is the sound of those shapes. Each generated shape has it's own color, and each corresponds with a note. There are 12 notes related to the 12 colors of the app.
On first tap, the image freezes and a timeline starts moving across the image. Every time this timeline hits a shape, you hear a tone.
It's a tool for finding melodies in a visual way. Instead of using traditional musical instruments, which are usually played based on your decision, Here Hear can help you find melodies that are floating around you.
The app was created to accompany the book Everything Always Everywhere, published by Valiz, that will be launched in October 2017.
Download the free app here!