SongUp AI
An AI music generation product offering a Hum to Song feature. It combines browser-side audio analysis with AI models to generate accompaniment and complete songs.
Timeline (last 90 days)
Spotify open-sourced the audio transcription model Basic Pitch, and SongUp AI uses it to transcribe pitch, rhythm, and chords from humming.
After Lyria's output proved uncontrollable, the SongUp AI team switched to measuring the returned audio, with all analysis performed in the browser's OfflineAudioContext.
The SongUp AI team wrote a unit test script containing 60 checks to lock down the math logic.
The Hum to Song feature plays the transcribed melody notes on their own before incurring any cost, letting the user first confirm whether the transcription is correct.
All Facts (4)
Spotify open-sourced the audio transcription model Basic Pitch, and SongUp AI uses it to transcribe pitch, rhythm, and chords from humming.
50%UnverifiedAfter Lyria's output proved uncontrollable, the SongUp AI team switched to measuring the returned audio, with all analysis performed in the browser's OfflineAudioContext.
50%UnverifiedThe SongUp AI team wrote a unit test script containing 60 checks to lock down the math logic.
50%UnverifiedThe Hum to Song feature plays the transcribed melody notes on their own before incurring any cost, letting the user first confirm whether the transcription is correct.
50%