I used OpenAI’s CLIP model and BigGAN to create a music video that goes along with the lyrics of a song that I wrote. The song lyrics are made from ImageNet class labels, and the song itself is performed by me on a looper.
0:00 - Intro
1:00 - AI-generated music video for “be my weasel”
3:50 - How it was made
7:30 - My looping gear
9:35 - AI-generated music video #2
12:45 - Outro & Credits
Code and references: GitHub - yk/clip_music_video: Code for making music videos using CLIP