Adobe unveils GenAI tool for music


There are many music editing and creation tools based on GenAI, but Adobe wants to put its own spin on the concept.

Today at the Hot Pod Summit in Brooklyn, Adobe unveiled Project Music GenAI Control, a platform capable of generating audio from text descriptions (e.g. “happy dance”, “sad jazz”) or of a reference melody and allowing users to personalize the results at the same time. workflow.

With Project Music GenAI Control, users can adjust things like tempo, intensity, repeating patterns, and structure. Or, they can take an existing track and extend it to an arbitrary length, remixing music or creating an endless loop.

Developed in collaboration with researchers at the University of California and Carnegie Mellon, Project Music GenAI Control will likely be released to the public in some form in the future. But for now, it’s firmly in the research stage, Gautham Mysore, head of audio and video AI research at Adobe, said during a panel at Hot Pod — the platform has no not even a user interface yet.

“So it really gives the idea that AI is generating music with you in the director’s chair and there’s a bunch of things you can do with it,” Mysore added. “[The tool is] generate music, but it is [also] giving you these different forms of control so you can try things. You don’t have to be a composer, but you can get your musical ideas out there.

GenAI music tools – and GenAI tools in general – raise ethical and legal concerns as AI-created music, artwork, and text proliferate.

Homemade tracks which use GenAI to evoke familiar sounds that can be considered authentic, or at least close enough, have gone viral. Music labels were quick to flag AI-generated tracks to streaming partners like Spotify and SoundCloud, citing intellectual property concerns. But it remains unclear whether “deepfake” music violates the copyrights of artists, labels and other rights holders.

Mysore said Adobe, as a rule, trains its GenAI tools on licensed or public domain data to avoid potential intellectual property issues. (But Mom knows if that will be the case with Project Music GenAI Control.) He added that Adobe was working on watermarking technology to help identify audio produced by Project Music GenAI Control, but admitted that it was a work in progress.

“Adobe takes a particularly responsible approach [these things,]» Mysore added. “There are a lot of really good musicians creating this content… I think [they and tools like Project Music GenAI Control] will coexist. New musical ideas will emerge.


Leave a Comment

Your email address will not be published. Required fields are marked *