Generative AI with Google’s Veo 3.1 – Frames-to-Video

Generative AI (GAI), like other AI models, learns from training data to generate new data. Google’s Veo is a GAI that creates videos. A content creator may use three forms of input—text, frames, and ingredients—in combination to help Veo generate the clips for a movie.

Frames to Video

The “frames-to-video” mode in Veo lets you smoothly extend the movie narrative by “connecting” clips. (It also allows you to transition between 2 snapshots. But that’s for another time.)

Follow these steps:

Step 1 – Start with a Brilliant Idea

Sign in to Google Flow Veo and generate a movie clip using a text prompt (text-to-video). Note that SceneBuilder requires landscape. Press the arrow button.

Watch the sample videos and follow along with our Clown in Mirror example:

Step 2 – Add to Scene

After video generation completes, select “Add to scene” button to add the clip to SceneBuilder.

Step 3 – Switch to SceneBuilder

Step 4 – Save Last Frame as Asset

Move the playhead to the last frame in the timeline. Save this frame as a reusable asset.

Step 5 – Set to Frames to Video

Step 6 – Get Saved Asset

Select the “+” button to add a frame. The saved asset is the last frame of the first clip. We now make it the first frame of the second clip as well.

Step 7 – Add a new prompt

The new prompt continues the story. (In the clown example, let’s have our reflection go rogue .)

Summarizing:

  • Set mode to ‘Frames to Video’
  • Set aspect is set to landscape
  • Get First Frame
  • Include new text prompt
  • Press arrow button
  • Prompt: “One twin stands up while the other remains seated and says to the camera ‘Happy Halloween!'”
  • Video: Reflection Goes Rogue

Step 8 – Edit Video (Optional, but Important)

  • Download the connected clips as a single landscape video.
  • While landscape suits computers, portrait is best for phones; use a post-production editor like iMovie (for Mac) or CapCut (free) to crop or adjust the aspect ratio of the screen.
  • Upload a final clip to your favorite social media platform.

Step 9 – Upload Video

Upload a final clip to your favorite social media platform.

Final Notes:

Watch for a smooth transition from a behaving to misbehaving reflection in Reflection Goes Rogue.

Related: