Implementing AI Music Generation (Suno/Udio) in a Mobile App
Suno and Udio — two main APIs for full track generation with vocals. Both accept text prompt, both return mp3/wav via async task. Integration technically simpler than video generation — smaller files, shorter times — but several nuances.
Suno API: what's actually available
Official public Suno API in closed beta as of March 2025. Direct integration possible via unofficial API wrappers (unstable) or via Replicate where open-source alternatives deployed (MusicGen from Meta, AudioCraft).
For production more reliable:
- ElevenLabs AI Music — REST API, tracks up to 3 minutes, styles by text
- Replicate + MusicGen — open-source, controlled, cheaper
- Udio API — early access, prompt + reference track for style
Example request to ElevenLabs Music:
POST https://api.elevenlabs.io/v1/sound-generation
xi-api-key: <key>
{
"text": "Upbeat electronic music for a fitness app, 120 BPM, energetic",
"duration_seconds": 30,
"prompt_influence": 0.5
}
Response in 15–40 seconds — binary mp3 or JSON with URL.
Async flow on iOS
class MusicGenerationService {
func generate(prompt: String, duration: Int) async throws -> URL {
// For long tracks - async job
let jobId = try await elevenLabsClient.createMusicJob(
prompt: prompt,
duration: duration
)
// ElevenLabs: polling or webhook
for delay in [5.0, 8.0, 10.0, 15.0, 20.0, 30.0] {
try await Task.sleep(nanoseconds: UInt64(delay * 1e9))
let status = try await elevenLabsClient.getJobStatus(id: jobId)
if status.state == "complete", let url = status.audioURL {
return try await downloadAudio(from: url)
}
if status.state == "error" { throw MusicGenError.failed }
}
throw MusicGenError.timeout
}
}
30-second track generation time — 15–30 seconds. Spinner + progress sufficient, push not necessary for short tasks.
Audio playback and management
On iOS audio generation needs correct AVAudioSession integration:
// Configure session: play even in silent mode
try AVAudioSession.sharedInstance().setCategory(
.playback,
mode: .default,
options: [.mixWithOthers]
)
try AVAudioSession.sharedInstance().setActive(true)
Without .playback category, music silences on screen lock. Common MVP implementation error.
Android: MediaPlayer for simple playback, ExoPlayer for track queue with smooth transitions (DefaultCrossfadeHandler).
Licensing and copyright
Main legal question: who owns generated track rights? ElevenLabs: on paid plan — user. MusicGen: MIT model license, but commercial use track status not explicitly settled. Suno: by ToS tracks belong to user on paid subscription.
In app: clearly inform users of license conditions for chosen provider. If track used in commercial videos — recommend provider paid plan.
Video integration
Generat track, then layer on-device with video via FFmpeg:
// iOS: merge audio with video
let composition = AVMutableComposition()
let videoTrack = try composition.addMutableTrack(
withMediaType: .video,
preferredTrackID: kCMPersistentTrackID_Invalid
)
let audioTrack = try composition.addMutableTrack(
withMediaType: .audio,
preferredTrackID: kCMPersistentTrackID_Invalid
)
// Append video and audio from their AVAsset sources
Timeline
Basic generation + playback UI — 3–4 days. With video sync, queue management, custom styling — 1–2 weeks. Music selection interface with preview — additional 5 days.