Magenta RealTime: An Open-Weights Live Music Model

I played around with this and really dig it.

While there's a lot of hostility towards musical applications of genAI, and in many cases rightly so (that interview with Suno's CEO earlier this year[1] still gives me the creeps), I believe that models like this offer a lot of creative possibilities. If users could include parameters like tempo and key, this would be excellent for creating real-time backing tracks for guitarists.

[1]https://youtu.be/E0YL83U5VWk?feature=shared&t=1380

Fun to play with:

https://colab.research.google.com/github/magenta/magenta-rea...