DEV Community

Cover image for 🎬 From image to text data... to image...to movie clip.
adriens
adriens

Posted on • Edited on

2

🎬 From image to text data... to image...to movie clip.

📰 About

I previously wrote an article that showed, how, for totally free of charge, and with 100% open source software, it is possible to analyze photos and produce textual analysis:

👉 Today, I'll show, what can be achieved on top of these textual analysis.

📜 What we'll do

This time, we will enrich the previous pipeline with the following workflow:

  1. 🎨 text2img: inject text analysis into an image with https://ideogram.ai
  2. 🎬 img2video : Put resulting image into Gen-2 by Runway to get a movie clip with
  3. 🎙️ Prepare a small storytelling
  4. 🎶 Select a soundtrack
  5. 🎛️ Put all the stuff into a single short movie clip

Enough talk, here is the resulting movie clip.

🎞️ Demo

Top comments (1)

Collapse
 
adriens profile image
adriens

The Most Contextual AI Development Assistant

Pieces.app image

Our centralized storage agent works on-device, unifying various developer tools to proactively capture and enrich useful materials, streamline collaboration, and solve complex problems through a contextual understanding of your unique workflow.

👥 Ideal for solo developers, teams, and cross-company projects

Learn more

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay