Keeping the same character across every scene in AI video generation

Most text-to-video models are great at a single shot and bad at a sequence. Ask for one cartoon scene, then ask for the next one, and the main character quietly changes face, hair colour and body proportions between cuts. Across 30–60 seconds that reads as a bug rather than a style choice, which is exactly the problem I ran into while building ToonBee AI Cartoon Animation Generator.

Here is what the problem actually is, and the approach that ended up working.

Why the character drifts

Three things stack up against you:

1. Each generation is stateless. The model has no memory of the shot you generated thirty seconds ago. Every scene is a fresh sample from the same distribution.
2. Text is a lossy way to describe a face. "A young girl with brown hair and a red hoodie" is compatible with thousands of faces. Sampling twice gives you two of them.
3. Style and identity are entangled. If you push the prompt to fix the style, you often move the character with it.

The practical result: the first shot looks great, and the fifth shot looks like a different person.

The approach that worked

Anchor on an image, not a description. A reference image is a much denser constraint than a sentence. Once the character is pinned to a picture, you stop asking the model to re-invent a face on every scene.

Separate identity from staging. The character reference and the scene description are two different inputs. Scene 1 might be "on a rooftop at sunset", scene 2 "in a kitchen", but the character block stays byte-identical between them.

Lock the look before you animate. Pick the cartoon style once for the whole video. Mixing styles mid-video is the fastest way to break the illusion, even if the face holds.

Generate audio after the visuals. Narration and music are laid under a finished timeline. Trying to time visuals to pre-generated audio makes scene boundaries fight the audio, and you end up regenerating both.

What this buys you

• One upload, then the same face, outfit and proportions in every scene.
• Either a full script or a one-line idea — the scenes get written for you when you only have the idea.
• 16:9 for YouTube, native 9:16 for Shorts, Reels and TikTok.
• Commercial use on every plan, and a credit cost shown per scene before it renders.

Where it still breaks

Worth being honest about the limits:

• Consistency holds within one video. Jumping between unrelated projects means a fresh reference.
• Big changes of age or costume mid-video still need a new reference, not just a new prompt.
• Long videos cost more, because every scene is a generation. The per-scene credit preview exists so this is not a surprise.

Try it

If you want to see the difference a reference image makes, ToonBee AI gives you 100 free credits on signup, no watermark on downloads, and a 9:16 export for short-form. The free tier is enough to render a short story end to end.

Curious how others are solving character consistency — reference-image conditioning, or something else?