Key Highlights
- Adobe recently announced the launch of Project Music GenAI Control.
- The new tool allows users to edit, extend, remix and loop a music video.
Adobe unveiled an AI-powered tool that can create music in response to text commands. The AI tool known as Project Music GenAI Control not only generates music from text prompts but also allows fine-grained control to edit that audio for their precise needs.
According to Adobe, Project Music GenAI Control is being developed in collaboration with colleagues at the University of California, San Diego, including Zachary Novack, Julian McAuley, and Taylor Berg-Kirkpatrick, and colleagues at the School of Computer Science, Carnegie Mellon University, including Shih-Lun Wu, Chris Donahue, and Shinji Watanabe.
As of now, Adobe’s Project Music GenAI is in its early state allowing users to edit, shorten, lengthen, remix, and create loops in addition to producing music. Nicholas Bryan, Senior Research Scientist at Adobe Research and one of the creators of the technologies said, “With Project Music GenAI Control, generative AI becomes your co-creator. It helps people craft music for their projects, whether they’re broadcasters, podcasters, or anyone else who needs audio that’s just the right mood, tone, and length.”
As per the company, the new tools in Project Music GenAI begin with a text prompt fed into a generative AI model, a method that Adobe already uses in Firefly.
In order to generate music, a user inputs a text prompt such as “powerful rock,” “happy dance,” or “sad jazz” to generate music using the new Project Music GenAI tools.
Users could modify the tempo, structure, and repeating patterns of a piece of music, choose when to increase and decrease the intensity of the audio, lengthen a clip, re-mix a section, or create a smoothly repeatable loop. With Project Music GenAI Control, users may create exactly the pieces they need to compose intros, outros, and background audio without having to manually chop existing music.
“One of the exciting things about these new tools is that they aren’t just about generating audio—they’re taking it to the level of Photoshop by giving creatives the same kind of deep control to shape, tweak, and edit their audio. It’s a kind of pixel-level control for music,” explains Bryan.
