DEV Community: Albania Sandhu

How to Build a Shot-by-Shot Storyboard for AI-Generated Videos

Albania Sandhu — Sat, 22 Aug 2026 13:12:55 +0000

Creating an AI video is not simply a matter of writing one long prompt and pressing “generate.” When a project includes several scenes, actions, characters, and transitions, it can quickly become difficult to control.

A storyboard solves this problem by dividing an idea into individual shots. Before generating anything, creators can decide what each shot needs to communicate, how the subject should move, and which visual details must remain consistent.

The workflow can be used with different AI video tools. For example, a Seedance 3 video workflow can begin with separate storyboard entries for each scene before the final sequence is generated and assembled.

Why AI Video Needs a Storyboard

Traditional production teams use storyboards to plan framing, movement, timing, and continuity. AI video creators can use the same method to reduce ambiguity during generation.

Without a storyboard, a single prompt may ask the model to make too many decisions at once:

What the main subject looks like
Where the scene takes place
What action occurs
How the camera moves
What kind of lighting appears
How long the action lasts
How one scene transitions into the next

A model may produce an attractive individual clip while still misunderstanding the larger sequence. The character may move in the wrong direction, the product may change between shots, or the final frame may not connect naturally to the next scene.

A storyboard turns one complicated request into a series of smaller visual tasks. Each shot has a specific purpose and can be generated, reviewed, and revised independently.

Step 1: Define the Purpose of the Video

Before writing prompts, define what the video needs to achieve.

A product demonstration may need to show appearance and functionality. An educational video may need to explain a process clearly. A social media video may need to create curiosity within the first few seconds.

Start by answering three questions:

Who is the intended audience?
What should viewers understand or feel?
What should viewers do after watching?

These answers influence the length, pacing, visual style, and number of shots.

For example, a 15-second product video should not try to explain every feature. It may be more effective to introduce one problem, demonstrate one benefit, and finish with one clear result.

Step 2: Write a One-Sentence Video Concept

Summarize the complete video in one sentence before dividing it into shots.

For example:

A compact water filter transforms cloudy water into clean drinking water through a simple three-stage process.

This sentence becomes the central rule for the storyboard. Every shot should support it.

If a shot does not introduce the product, explain the filtration process, or show the final result, it may not be necessary.

A one-sentence concept also prevents the project from expanding into unrelated scenes during generation.

Step 3: Divide the Concept into Individual Shots

Each shot should perform one main task.

A basic five-shot structure might look like this:

Shot	Purpose	Framing	Main action
1	Introduce the subject	Wide shot	Establish the environment
2	Reveal the main detail	Medium shot	Focus attention on the subject
3	Demonstrate the process	Tracking shot	Follow the primary action
4	Show the result	Close-up	Highlight an important change
5	Finish the message	Static shot	Present the final outcome

The sequence does not need to be complicated. A clear five-shot story is usually more effective than ten loosely connected scenes.

When reviewing the sequence, ask whether every shot moves the story forward. If two shots communicate the same information, one of them can probably be removed.

Step 4: Create a Continuity Sheet

A storyboard describes what happens. A continuity sheet records what must remain unchanged.

For a recurring character, it might include:

Approximate age
Hairstyle and hair color
Clothing and color palette
Accessories
Body proportions
Typical expression

For a product, it might include:

Shape and dimensions
Primary and secondary colors
Material
Packaging
Logo position
Buttons or controls
Details that must remain visible

For an environment, it might include:

Time of day
Lighting direction
Background colors
Furniture arrangement
Weather
Important objects

Separate the details into two categories.

Fixed details

These should remain unchanged across the entire video. Examples include a character’s jacket, a product’s color, or the direction of the main light.

Flexible details

These may change when the story requires it. Examples include the character’s expression, the camera position, or the background activity.

This distinction prevents the prompt from becoming overloaded with unnecessary restrictions.

Step 5: Define the Start and End of Every Shot

A useful storyboard should describe more than the middle of an action. It should define how each shot begins and ends.

Consider these two descriptions:

A woman picks up a camera.

The shot begins with the camera resting on a wooden table. A woman reaches into the frame, picks it up with both hands, and turns toward the window. The shot ends with the camera held at chest level.

The second description is easier to connect to surrounding shots because it defines the opening state, action, and final state.

A practical shot description can include:

Starting position
Main action
Ending position
Subject direction
Camera behavior
Approximate duration

The final state of one shot should support the starting state of the next.

If Shot 2 ends with a person walking toward a door, Shot 3 should not begin with that person sitting at a desk unless the transition makes the change clear.

Step 6: Write a Separate Prompt for Each Shot

Avoid using one large prompt for the complete video. Give every shot a focused instruction.

A practical structure is:

Subject + environment + action + framing + camera movement + lighting + duration + continuity rules

For example:

A young industrial designer with short black hair and a dark blue work jacket stands beside a prototype on a white studio table. She turns the product slowly with both hands while examining its surface. Use a medium shot with a very slow push-in, soft daylight from the left, and realistic hand movement. Keep her hairstyle, jacket, product shape, and product color unchanged. Duration: five seconds.

This structure clearly separates the main visual variables.

The prompt does not need to describe every object in the room. It should prioritize the information required for that particular shot.

A Reusable AI Video Storyboard Template

The following template can be copied for each shot.

Shot number and purpose

What information does this shot communicate?

Duration

How many seconds should the shot last?

Starting frame

Where are the subject, camera, and important objects when the shot begins?

Main action

What is the single most important action?

Ending frame

What should the scene look like when the shot finishes?

Camera

Specify the framing and movement, such as wide shot, close-up, static camera, tracking movement, or slow push-in.

Lighting and visual style

Describe the light direction, color palette, atmosphere, and level of realism.

Fixed details

List the character, product, or environment details that must not change.

Transition

Explain how the shot connects to the next one.

Final prompt

Combine the essential information into one generation-ready instruction.

This format makes it easier to compare different versions of the same shot without rewriting the complete project.

Complete Example: A Five-Shot Product Story

Imagine a short video introducing a portable reading light.

Shot 1: Establish the problem

Purpose: Show a person trying to read in a dark room.

Starting frame: A reader sits beside a desk with a closed book.

Action: The reader opens the book and leans closer because the room is too dark.

Camera: Wide, static shot.

Ending frame: The reader looks toward a small light on the desk.

Shot 2: Introduce the product

Purpose: Reveal the portable light.

Starting frame: The light rests beside the book.

Action: A hand picks it up and turns it toward the camera.

Camera: Close-up with a slow push-in.

Ending frame: The product fills the center of the frame.

Shot 3: Demonstrate the main action

Purpose: Show how the light attaches to the book.

Starting frame: The book is open on the desk.

Action: The reader clips the light onto the top of the book.

Camera: Medium close-up, static camera.

Ending frame: The light is securely attached.

Shot 4: Show the result

Purpose: Demonstrate the lighting effect.

Starting frame: The page is still dark.

Action: The reader switches on the light, illuminating the page.

Camera: Close-up of the page and product.

Ending frame: The text is clearly visible under warm light.

Shot 5: Finish the story

Purpose: Present the successful outcome.

Starting frame: The reader holds the illuminated book.

Action: The reader relaxes and continues reading.

Camera: Medium shot with a slow pull-back.

Ending frame: A clean composition showing the reader, book, and light.

This example has a simple progression:

Problem → product → action → result → conclusion

Every shot has a defined role, which makes the complete sequence easier to understand.

Review the Storyboard Before Generating

Before producing the clips, read through the storyboard as if the video already existed.

Ask:

Does every shot have a clear purpose?
Does the ending of one shot connect to the beginning of the next?
Are the subject and important objects positioned consistently?
Is the main action simple enough to understand?
Does the camera movement support the story?
Are any visual instructions contradictory?
Can any unnecessary shots be removed?
Is the final message clear without additional explanation?

It is usually faster to correct a storyboard than to repeatedly regenerate an unclear sequence.

Generate a Low-Cost Draft First

The first generation does not need to be the final version.

Start with shorter clips, simpler actions, and basic visual settings. The goal is to test:

Shot order
Subject placement
Action timing
Transition logic
Overall pacing

Once the structure works, improve the lighting, detail, motion, and final presentation.

This approach prevents creators from spending too much time refining a visually impressive shot that does not fit the finished video.

Revise One Shot at a Time

If one shot fails, avoid changing the entire storyboard.

Identify the specific problem:

If the action is unclear, simplify the movement.
If the product changes, strengthen its fixed description.
If the composition drifts, reduce camera movement.
If the transition feels abrupt, revise the ending frame.
If the shot is too crowded, remove secondary elements.
If the timing feels slow, shorten the action or duration.

After revising the shot, compare it with the previous version and keep the rest of the sequence unchanged.

This makes it easier to determine which adjustment improved the result.

Final Thoughts

A strong AI-generated video begins before the first clip is rendered.

Storyboarding transforms a broad idea into a sequence of clear visual instructions. It gives every shot a purpose, defines how scenes connect, and records the details that need to remain stable.

A reliable workflow is to:

Define the video’s purpose
Summarize the concept in one sentence
Divide the idea into individual shots
Create a continuity sheet
Define the beginning and end of each shot
Write a focused prompt for every scene
Review the complete sequence before final generation

Instead of asking an AI model to invent an entire project at once, creators provide a visual path from the opening frame to the final shot. The result is easier to generate, evaluate, edit, and repeat.

Reference, Extend, or Edit? Choosing an AI Video Workflow

Albania Sandhu — Tue, 11 Aug 2026 12:21:34 +0000

AI video tools increasingly let us upload existing media instead of starting with text alone. But attaching a video creates a new problem: what exactly should the model do with it?

Depending on the tool, an uploaded clip might serve as:

A visual reference for an entirely new generation
The starting point for a continuation
The source footage that should be modified

These workflows may look similar in the interface, but they solve different problems. Choosing the wrong one can produce a technically valid result that completely misses your intention.

This article presents a practical framework for deciding when to Reference, Extend, or Edit an AI video.

The Three Workflows Solve Different Problems

The easiest way to distinguish the modes is to ask one question:

Do I want a new video, more video, or a changed video?

That produces a simple mapping:

Desired result	Workflow
Create a new clip inspired by existing material	Reference
Continue what happens after an existing clip	Extend
Change something inside the existing clip	Edit

Car example: Reference creates a new scene, Extend continues the action, and Edit changes one element.

This distinction sounds obvious, but it becomes less clear when a request contains multiple intentions.

For example:

Keep the same character and visual style, move the scene to a rooftop, and continue the action.

Should the model create a new rooftop scene based on the character reference? Should it extend the uploaded scene until the character reaches a rooftop? Or should it transform the existing background?

Before writing the prompt, decide which part of the request is most important.

Reference: Create Something New From Existing Material

Use Reference when the uploaded video should guide a new generation without becoming its timeline.

The source material can communicate:

Character appearance
Product design
Lighting
Color palette
Camera movement
Animation style
Motion rhythm
Overall atmosphere

The resulting video does not need to begin where the reference ends. It can use a different location, composition, action, or narrative situation.

Example

Imagine you have a five-second video of a silver running shoe rotating under studio lighting.

You want a new scene showing the same type of shoe landing on a rain-soaked street at night. The source video provides information about the product's shape, materials, and visual treatment, but its existing timeline is irrelevant.

That is a Reference task.

A useful prompt might be:

Create a new cinematic night scene guided by the attached product reference. A silver running shoe lands on wet pavement, sending small droplets outward. Preserve the metallic mesh texture, dark sole, and reflective side details. Low tracking camera, blue storefront lighting, realistic material response.

The prompt describes the new result while explaining which properties should survive from the reference.

When Reference Is the Wrong Choice

Do not use Reference when the next frame must connect precisely to the final frame of the uploaded video.

A reference can communicate visual identity, but it does not necessarily preserve the exact position, movement, or timing at the end of the source clip.

If temporal continuity matters most, use Extend.

Extend: Continue From the End of a Video

Use Extend when the existing clip is already correct and you want to generate what happens next.

The final frames of the source video become the transition point for the continuation. This makes Extend useful for:

Completing an unfinished action
Holding a product shot for longer
Adding an ending to a scene
Continuing a camera movement
Creating extra room for a title or call to action
Lengthening a clip without rebuilding its beginning

Example

Suppose the shoe in the previous example lands successfully, but the original clip ends immediately after impact.

You want the camera to follow the runner for several more seconds before slowing into a final product frame.

That is an Extend task.

The prompt should focus on what happens after the current ending:

Continue from the final frame. The runner accelerates forward as the camera tracks beside the shoe at ground level. Water splashes naturally with each step. After several strides, transition into a slower side profile and finish on a clean frame with space in the upper-right corner.

Notice that the prompt does not redesign the beginning of the scene. It assumes the existing video remains unchanged.

When Extend Is the Wrong Choice

Extend cannot repair a mistake that already appears in the source footage.

If the product changes color halfway through the original clip, continuing the video will not remove that error. The model may even carry the inconsistency into the new section.

Fix the source first or use Edit if the workflow supports the required modification.

Edit: Change the Existing Video

Use Edit when the uploaded clip contains the timeline you want, but something inside it needs to change.

Typical Edit tasks include:

Replacing a background
Adjusting the visual style
Changing weather or lighting
Removing or replacing an object
Modifying clothing or product color
Reworking part of the motion
Creating a variation of an existing shot

Unlike Reference, Edit is not primarily creating a separate scene. Unlike Extend, it is not adding material after the ending. It is transforming the attached clip itself.

Example

Suppose the shoe animation and camera movement are correct, but the background is a plain studio floor. You want to preserve the motion while moving the scene into a rainy city environment.

That is an Edit task.

A clearer prompt would be:

Preserve the shoe, its rotation, the timing, and the existing camera path. Replace the studio environment with a rain-soaked city street at night. Add realistic reflections beneath the shoe and soft blue storefront lighting. Do not change the shoe's color, proportions, materials, or movement.

For editing tasks, preservation instructions matter as much as transformation instructions.

A useful structure is:

Keep A, B, and C. Change D. Do not alter E or F.

This reduces ambiguity about which parts of the input are constraints.

A Practical Decision Framework

Before generating, answer these questions in order.

1. Must the original timeline remain visible?

No: Choose Reference.
Yes: Continue to the next question.

2. Should the output happen after the existing ending?

Yes: Choose Extend.
No: Continue to the next question.

3. Should something inside the current footage change?

Yes: Choose Edit.
No: Reconsider whether a video attachment is necessary.

The decision can also be summarized like this:

Do you need a new clip?
└── Yes → Reference

Do you need more footage after the ending?
└── Yes → Extend

Do you need to modify the current footage?
└── Yes → Edit

If your request seems to require two modes, split it into two generations.

For example:

Edit the original clip to correct the environment.
Extend the corrected result to create a longer ending.

Trying to perform both operations in one ambiguous instruction usually reduces control.

Person example: Reference creates a new setting, Extend continues the next moment, and Edit changes only the jacket.

Aspect Ratio and Duration Matter

The selected workflow can also affect which output settings remain flexible.

A new Reference generation may allow you to choose a different aspect ratio because it is creating a new composition.

Extend and Edit usually need to preserve more properties from the attached video. Changing the aspect ratio during these operations could require inventing visual information outside the original frame or cropping important content.

Editing may also stay close to the duration of the source because the operation modifies its existing timeline rather than adding a separate sequence.

The exact constraints vary by tool, so check them before preparing a prompt. One interface that separates these behaviors is the Seedance 2.5 AI video generator, where Reference, Extend, and Edit are presented as distinct operations after a video is attached.

Common Workflow Mistakes

Using Reference When You Need Frame-Level Continuity

The new result may resemble the source but begin with a different composition. Use Extend when the transition must feel continuous.

Using Extend to Repair Existing Footage

Extension adds to the ending. It does not automatically correct problems in earlier frames.

Using Edit With a Prompt That Changes Everything

If the prompt replaces the character, environment, camera, lighting, and action, there may be too little left to preserve. In that case, Reference is probably a better fit.

Failing to State What Must Remain Unchanged

"Make this more cinematic" leaves the preservation rules undefined. The model may change details you considered essential.

Name those details explicitly.

Combining Multiple Production Stages

A request such as "replace the background, continue the action, add a new product, and create a different ending" contains several jobs.

Separate them into an editing step and an extension step so each result can be reviewed independently.

A Pre-Generation Checklist

Before submitting, confirm the following:

Am I requesting a new clip, a continuation, or a modification?
Which properties from the source must remain unchanged?
Does the result need to connect to the source's final frame?
Am I trying to fix something that already exists?
Does the operation need to preserve the original aspect ratio?
Would two separate generations provide more control?
Have I described both the desired change and the preservation constraints?

A short decision process can prevent several failed generations.

Final Thoughts

Reference, Extend, and Edit are not interchangeable labels for "use this video." They represent three different relationships between the source material and the output.

Use Reference when the source should inspire something new.

Use Extend when the existing ending should become the beginning of what happens next.

Use Edit when the timeline is useful but something inside it needs to change.

Choosing the workflow before writing the prompt makes the rest of the generation process much easier. It clarifies what the model should preserve, what it should invent, and where the output should begin.

Disclosure: I am affiliated with Seedance2AI.io. The product is included as one example of an interface that separates Reference, Extend, and Edit workflows.

AI assistance disclosure: This article was created with AI assistance and reviewed by the author before publication.