August 7, 2018.
SoundSeeker Produces Original Soundtracks Based on Mood and Content of Pictures, Powered by Music Theory from Berklee College of Music
A picture may be worth a thousand words, but what if it was possible to “hear” what it sounds like? Royal Caribbean International has designed and built a first-of-its-kind tool that transforms travelers’ photos into an original, shareable soundtrack with a video to match. More than a year in the making, SoundSeeker™ is a groundbreaking, patent-pending digital experience powered by artificial intelligence (AI). The innovative tool is specifically designed to use machine learning to seamlessly create original soundtracks based on the content of each photograph.
By visiting www.royalcaribbean.com/soundseeker, users can upload three photos of their choice, and the AI analyzes them based on color, landscape, backdrop, emotion, body language and facial expression. SoundSeeker then turns them into a shareable and one-of-a kind soundtrack – virtually DJing life’s moments. Fans can follow along on Royal Caribbean’s social channels, and by searching #SoundSeeker.
Royal Caribbean teamed up with experts from Berklee College of Music, and technologists from around the world, to create the unique song generator. Berklee leveraged music theory to create a roadmap for the tool that helps determine the musical pairing to photos, accounting for pitch, tempo and instrumental combinations, among others.
SoundSeeker uses machine learning, an artificial intelligence technique that enables computers to simulate human intelligence and make decisions on their own without explicit instructions. The learning process entailed more than 600 hours in which Royal Caribbean and a team of musicians and technologists reviewed hundreds of music tracks along with 10,000 photos, matching each of the 2.5 million combinations to one of 10 moods.
The AI in SoundSeeker uses Google Cloud Vision to identify objects, facial expressions and colors in a user’s photo by referencing the roadmap developed by the leaders in music theory at Berklee. SoundSeeker then finds the musical elements corresponding to each mood in the photo to compose a genuinely distinct audio and visual photo album. The Royal Caribbean tool is equipped to generate over one million unique tracks, based on custom base tracks, composed exclusively for the cruise line. The customized tracks take inspiration from a wide variety of music, including 90s hip-hop, rock, modern and electronic dance music.
Pretty cool huh?