The First Music Video Created with OpenAI's Video Generation Tool, Sora
The music video for Washed Out's 'The Hardest Part' was made using Sora.
In the past 1-2 years, artificial intelligence tools have shown tremendous progress. While companies have recently focused more on text-based ones, we cannot ignore the level of detail achieved by visual generation tools. Particularly with the emergence of GPT-4, visual generation tools have reached a whole new level, and Sora is ready to take it even further.
Added to OpenAI‘s ChatGPT and DALL-E models, Sora is focused on video production. While we have seen video production in tools like Stable Diffusion, Sora stands out thanks to its provided demos and shared prompt accuracy. Now, we see that a music video has been produced with it.
The music video for Washed Out's 'The Hardest Part' was created using Sora.
The description of the video also states that the said music video is the first official music video produced with OpenAI’s Sora. In the clip, which seems to emerge from dreams, we see a couple navigating between spaces and dimensions, finding themselves in different places. The couple, never staying in one place, wanders through various locations, from vehicles to concerts, from beds to landscapes.
Produced by Trillo Films, the output provided by Sora in the video appears quite consistent, despite occasional minor errors. As a result, watching the video from start to finish evokes a dream-like feeling. In the song, we listen to a character who sees their ex-lover in someone else’s arms.
