Deforum Music Visualizer

Album Covers Come Alive

The combination of music and visual arts has become prevalent in the modern music industry, from music videos to concert visuals, in an attempt to enhance the music listening experience. Music visualization is a difficult task to approach and evaluate, as music is a complex form of art combining contextual and emotional information, and it’s interpretation is largely subjective. It can range from being strictly representational of the musical content, to more abstract context and emotion based.

This work explores the possibility of using Generative text-to-video models, and more specifically Generative text-to-video Diffusion Models, to create music visualizations with the goal of enhancing the musical experience for the listener.

We introduce a free-to-use and easily accessible Music Visualization tool which we call Deforum Music Visualizer, based on Deforum Stable Diffusion, an open-source Generative text-to-video model.

The tool is available here:

• Visualization Examples
• Methodology
• Step-by-Step: Running Deforum Music Visualizer

Note

• For related issues and problems with running Deforum Music Visualizer feel free to create a new issue.

• If you have any ideas or questions start a new discussion.

See also

Deforum Music Visualizer is based on Deforum Stable Diffusion. Readers are encouraged to take a deeper look into the framework and what it provides.