Never mind ChatGPT — music might be the next big frontier for AI content generation. Google recently published research on MusicLM, a system that creates music in any genre with a text description. This isn't the first AI music generator. As TechCrunchnotes, projects like Google's AudioML and OpenAI's Jukebox have tackled the subject. However, MusicLM's model and vast training database (280,000 hours of music) help it produce music with surprising variety and depth. You might just like the output.
The AI can not only combine genres and instruments, but write tracks using abstract concepts that are normally difficult for computers to grasp. If you want a hybrid of dance music and reggaeton with a "spacey, otherworldly" tune that evokes a "sense of wonder and awe," MusicLM can make it happen. The technology can even craft melodies based on humming, whistling or the description of a painting. A story mode can stitch several descriptions together to produce a DJ set or…
2023-01-27 16:07:28
Link from www.engadget.com Recently, Google Brain researchers developed a state-of-the-art artificial intelligence (AI) system that can autonomously create music in a variety of genres from simple text descriptions.
The AI system, called ‘Sketch-RNN-Music’, uses deep neural networks to understand the context of a text description, generate a musical melody and even create variation in rhythm and harmony. To do this, the AI system uses a sequence-to-sequence learning model, a type of natural language processing (NLP).
The researchers tested out their AI system by providing it with a small set of folk songs in different genres, and asking it to create new songs in the same genre. The results show the AI system was able to accurately generate melodies and rhythms, while incorporating the genre-specific characteristics that were requested.
This breakthrough marks an important step forward in AI music composition. Previously, most successful attempts at automated song-writing were limited to style transfer, which is the process of copying existing musical styles. With this new system, AI composition is capable of true music generation.
While the Sketch-RNN-Music AI is still limited to working within the confines of pre-defined musical genres, the researchers believe that it’s just the beginning. With further development and advancements in deep learning technology, AI could help unlock even more creative and unexplored musical possibilities.