MusicLM: Google’s AI Maestro for Music Composition

AI has been flexing its creative muscles in many art forms recently. Google is pushing those boundaries even further with MusicLM — an AI system for generating musical compositions from text. MusicLM shows astonishing potential for AI to mimic human creativity.

Teaching AI the Language of Music

MusicLM is built using Transformer machine learning architecture — the same used in natural language models like GPT-3. Google trained MusicLM on a huge dataset of musical scores paired with corresponding lyrics and descriptions.

This allowed MusicLM to learn the “language” of music on a deep level — connecting words, phrases and concepts with musical elements like melody, rhythm, structure and style. MusicLM builds an understanding of music theory and conventions during its training.

Making Music with Text Prompts