You storyboard a 15‑second Short about a girl and her robot cat, hit “generate,” and watch the draft come back.
Shot 1 looks great. Shot 2 has the same girl, but her hair is now short instead of long. Shot 3 switches the robot cat from shiny metal to fluffy fur. Your last shot, the emotional close‑up, somehow clones the very first wide shot again. You tweak prompts, re‑render, and your budget melts away while your “main character” keeps morphing into alternate-universe versions of herself.
That’s the real problem: keeping a character consistent across an AI video, shot after shot, without spending forever fighting the model.
This guide walks through how to keep consistent characters in AI video, using one concrete example and covering practical steps you can follow today.
Our working example: 15‑second Short about Maya and Pixel
We’ll use this simple Short and refer back to it for every step.
Concept: Maya, a 12‑year‑old girl, and Pixel, her small floating robot cat, find a glowing seed in an alley. Maya is scared; Pixel is curious. By the last shot, she decides to touch it.
Core character traits
- Maya
- Age: 12
- Look: Brown skin, long black ponytail, round glasses, red hoodie, denim shorts, scuffed white sneakers
- Personality: Cautious, smart, kind
- Pixel
- Form: Small floating robot cat, metallic silver, cyan glowing eyes, round body with tiny ear‑like antennas
- Personality: Playful, impulsive, expressive through body language and eye light
Shot list (15 seconds total)
- Shot 1, Establishing wide (0–3s)
- Framing: Wide shot, empty alley at dusk, Maya at left, Pixel hovering at her shoulder, glowing seed on the ground in the center
- Action / line: Maya: “Pixel, what is that?”
- Goal: Introduce both characters and the seed, show mood.
- Shot 2, Medium on Maya & Pixel (3–6s)
- Framing: Medium shot waist‑up, Maya on right, Pixel hovering left
- Action / line: Pixel tilts, eyes brighten; Maya frowns. Maya: “It could be dangerous.”
- Goal: Show their personalities: Maya cautious, Pixel curious.
- Shot 3, Close on Pixel and seed (6–9s)
- Framing: Low angle near ground, Pixel in foreground looking down, glowing seed close, Maya’s legs vague in background
- Action / line: Pixel nudges the seed with a tiny robotic paw; seed glows brighter. No dialogue.
- Goal: Focus on object and Pixel’s curiosity.
- Shot 4, Close on Maya (9–12s)
- Framing: Tight close‑up of Maya’s face, seed glow reflecting in her glasses
- Action / line: Maya whispers: “Unless it needs our help…”
- Goal: Emotional beat; Maya starting to change her mind.
- Shot 5, Medium two‑shot (12–15s)
- Framing: Medium shot; Maya kneels to touch seed, Pixel beside it, alley behind
- Action / line: No line. Maya reaches toward seed, fingers inches away. It flares with light.
- Goal: Resolve with a clear, readable moment of decision and magic.
We’ll keep coming back to this. Every choice you make about story structure, framing and prompts should protect Maya and Pixel from drifting.
Why consistent characters in AI video are so hard
Traditional animation has model sheets and a team checking for “on‑model” drawings. With AI video, the model is inventing visuals for you. That causes some unique problems:
- Face and clothes drifting between shots
- Shot 1: Maya has glasses; Shot 2: They vanish.
- Shot 4: She suddenly has blue eyes instead of brown.
- Close shots coming back as clones of the wide
- You ask for a close‑up (Shot 4), but the model recreates Shot 1, just cropped.
- The composition repeats and kills your pacing.
- Wrong character’s mouth moving
- You assign Maya’s line, but Pixel’s mouth plates flicker instead.
- Or both characters seem to speak at once.
- Safety checker refusing harmless shots
- A back alley at dusk might be rejected as “unsafe” or “violent” content.
- Mild “danger” language in the prompt can trip filters.
- Every second costs money
- Re‑rendering entire scenes to fix a hoodie color or missing glasses eats budget fast.
A consistent characters AI video strategy is less about prompts and more about discipline: story first, design early, and only then animation.
Step 1: Lock the characters before you animate anything
Start by treating Maya and Pixel like characters in a real animated series, not random outputs.
Create a written character spec
Do this in text before you touch any tool:
For Maya:
- Age and body type
- Skin tone, hair style, accessories
- Iconic clothing pieces (red hoodie, glasses)
- Emotional range: how she looks scared vs curious vs determined
For Pixel:
- Shape, size relative to Maya
- Surface (metal panels, glowing seams)
- Signature color accents
- How it emotes: eye brightness, tilt, bobbing, ear antenna movement
Write it as a list you can paste into every prompt.
Example prompt tag you’ll reuse:
> “Maya, 12‑year‑old girl, brown skin, long black ponytail, round glasses, red hoodie, denim shorts, scuffed white sneakers, small build, cautious expression”
> “Pixel, small floating robot cat, metallic silver body, round torso, tiny ear antennas, cyan glowing eyes, hovers at shoulder height”
Generate or sketch reference images
Even a rough drawing or a few stills gives you a north star.
- Make 2–3 still shots for Maya:
- Neutral pose, front view
- Side view
- Close‑up of face with glasses, hair, hoodie
- Same for Pixel:
- Size next to Maya
- Close‑up of face and eyes
Print them or pin them in your project notes. These are your “model sheets.”
Any time a new frame arrives where Maya’s hoodie disappears or Pixel turns fluffy, you have something specific to compare against.
Step 2: Design shots around clarity and reuse
Good planning saves money and keeps your consistent characters AI video from spiraling into chaos.
Start with a real shot list (like ours)
We already have 5 shots with framing and action. Now we make that more precise.
For each shot, write:
- Which characters are visible and how large
- Head only, waist‑up, full body
- One character or both
- Exact angle and distance
- “Medium shot, straight on, camera at eye level”
- “Low angle, near ground”
- Emotional state for each character
- “Maya: worried, eyebrows drawn”
- “Pixel: excited, eyes brighter than usual”
Applied to our example:
- Shot 2 revised description:
“Medium shot, waist‑up, straight on. Maya on right, Pixel hovering left. Maya’s eyes wide behind glasses, mouth tight in a worried frown. Pixel’s eyes bright and curious.”
This level of detail makes prompts consistent and gives the model less room to improvise.
Plan for economical shot choices
Every second costs. A few tricks:
- Reuse setups
Shots 2 and 5 for our Short can share the same basic camera angle (medium two‑shot) with changed pose and lighting. That way, any fix you make to the medium framing benefits both.
- Limit unnecessary full‑body shots
Only Shot 1 really needs full bodies to establish the scene. Emotional beats (Shot 4) can live in close‑ups, which are cheaper to fix.
- Keep the cast tiny in short pieces
Just Maya and Pixel here. Adding a third character multiplies the risk of mouth‑sync errors and identity swaps.
Step 3: Write prompts with continuity in mind
Good prompting habits are your main weapon against character drift.
Reuse the same “identity block”
For every shot:
- Copy the same core description block for each character.
- Only change:
- Pose
- Expression
- What they are doing
For example:
Shot 1 visual prompt core:
> “Wide shot of a narrow city alley at dusk. Maya, 12‑year‑old girl, brown skin, long black ponytail, round glasses, red hoodie, denim shorts, scuffed white sneakers, stands on the left side of frame, cautious expression. Pixel, small floating robot cat, metallic silver with cyan glowing eyes, hovers at Maya’s shoulder. A small glowing seed lies on the ground in the center, soft golden light.”
Shot 2 prompt core:
> “Medium shot, waist‑up, straight on. Same Maya and Pixel as previous shot: Maya, 12‑year‑old girl, brown skin, long black ponytail, round glasses, red hoodie, denim shorts, cautious expression. Pixel, small floating robot cat, metallic silver with cyan glowing eyes, hovers at her shoulder. Maya on right side of frame, Pixel on left. Background is the same alley at dusk, softly out of focus.”
Notice the phrase “Same Maya and Pixel as previous shot.” Some tools respect that. Even if they don’t, your own wording stays consistent, which helps.
Use “negative” cues to fight drift
Tell the model what not to do:
- “Maya always wears her round glasses; do not remove them.”
- “Pixel is always metallic and robotic; no fur, no organic features.”
- “Do not change Maya’s hairstyle or clothing between shots.”
You don’t want a huge negative block for every shot, but a short reminder can prevent your robot cat from becoming a stuffed toy halfway through.
Step 4: Storyboards first, moving pixels later
A simple but powerful rule: Get the storyframes right before asking for video.
Why storyboards matter for consistency
- Cheaper to fix than rerendered animation
- Easier to spot:
- Clothing changes
- Wrong character positions
- Reused compositions (your close‑up accidentally matching the wide)
- Let you simplify your shot list if a shot isn’t pulling its weight
For our example, you’d want five storyboard frames:
- Shot 1 board: Wide alley, Maya left, Pixel near shoulder, seed center.
- Shot 2 board: Medium two‑shot, clear faces and emotions.
- Shot 3 board: Ground‑level, Pixel and seed large in frame, Maya’s legs distant.
- Shot 4 board: Tight on Maya’s face, glasses catching glow, background blurred.
- Shot 5 board: Medium two‑shot again, similar angle to 2 but lower to show knees and hand reaching toward seed.
Print them or display them side by side. Ask:
- Does Maya look like the same kid across frames?
- Does Pixel’s size and shape match?
- Do glasses, hoodie, and hairstyle stay consistent?
Only after that should you invest in video renders.
Some tools, like Ajax Studio, have a built‑in step where every shot is drawn as a storyboard image before any video is generated. That sort of workflow is ideal for catching these problems early.
Step 5: Handle mouth‑sync and speaking characters
When you add dialogue, AI video has a new way to go wrong: the wrong face animating.
In our Short, Maya speaks in Shots 1, 2 and 4. Pixel never actually talks; it emotes. Here’s how to control that.
Assign lines clearly in your script
Instead of:
> MAYA: Pixel, what is that? > It could be dangerous. > Unless it needs our help…
Break it out per shot and speaker:
- Shot 1: Maya: “Pixel, what is that?”
- Shot 2: Maya: “It could be dangerous.”
- Shot 4: Maya (whisper): “Unless it needs our help…”
Mark Pixel as non‑verbal:
- Shot 2: Pixel reacts silently, eyes brighten.
Prompt for speaking vs non‑speaking
When you generate or configure the shot:
- For shots with dialogue:
“Maya is speaking this line; animate only Maya’s mouth. Pixel is silent but reacting with eye brightness and head tilt.”
- For non‑dialogue shots:
“Nobody is speaking. Animate Pixel’s body language only; keep Maya’s mouth closed.”
If your tool lets you tag which character is speaking, use that religiously.
Common mouth‑sync pitfalls
- Both mouths moving
Some tools over‑animate. If you see Pixel’s faceplates moving like a mouth during Maya’s line, re‑prompt with “Pixel is completely silent, only eyes move.”
- The wrong character lip‑syncing
If Pixel steals Maya’s line, duplicate the shot, correct the speaker tag, and compare. This is where short videos are your friend.
Step 6: Taming safety filters without breaking your story
Our alley is at dusk, with a “glowing seed” and the word “dangerous” in the dialogue. That might trigger a content filter.
You cannot control the underlying safety system, but you can rephrase:
Avoid loaded words in prompts
Instead of:
> “Dark, dangerous alley, mysterious glowing object that could explode”
Try:
> “Quiet city alley at sunset, gentle magical glow on a small seed”
Leave any hint of violence out of the visual prompt. The spoken word “dangerous” in the script is usually fine; but if your tool also screens scripts, soften it there too:
- Change Maya’s line to: “Pixel, what is that? It could be… weird.”
If a specific shot keeps failing:
- Remove words like dark, threatening, dangerous, abandoned, blood, weapon from prompts.
- Emphasize “magical, soft light, peaceful atmosphere.”
- Keep the same framing and character positions.
If you still cannot get it through, consider a different setting that preserves the story:
- Rooftop garden at dusk instead of alley
- Empty school hallway with flickering lights
The important part is Maya’s decision, not the exact background.
Step 7: Budgeting and iteration strategy
Treat your consistent characters AI video like a small animation project, not a slot machine.
Work from cheap to expensive
- Script and shot list (free).
- Character specs and reference stills (cheap).
- Storyboards for each shot (cheap).
- Short test animations for 1–2 shots (more expensive).
- Full 15‑second render (most expensive).
For our Short, a sensible approach:
- Fully lock Shots 1 and 4 first (intro and emotional peak).
- Only once you like how Maya and Pixel look and move there, generate 2, 3 and 5 to match.
Fix targeted, not global
If Shot 3 turns Pixel furry, do not re‑render the whole video.
- Freeze a frame from a good shot where Pixel looks correct.
- Use that as reference in the prompt: “Pixel must match this reference exactly.”
- Regenerate Shot 3 only.
Tools that show you pricing per step and don’t charge for failed steps help you experiment more safely, but you can follow the same logic anywhere: isolate problems, patch the single shot, review the cut.
Step 8: Practical checklist for each shot
When you review Shot 2 of Maya and Pixel, ask:
- Identity
- Same skin tone as other shots?
- Same hairstyle and glasses?
- Same hoodie color and style?
- Scale and proportion
- Is Pixel the same size relative to Maya as in Shot 1?
- Are heads and bodies proportionate or suddenly stretched?
- Continuity
- Are characters standing/sitting in believable positions compared to the previous shot?
- Does the background match in style and lighting?
- Performance
- Does the right character speak?
- Are non‑speaking characters’ mouths still?
- Shot purpose
- Does this shot show something new, or is it accidentally copying the framing of another shot?
Only after a shot passes this checklist should you consider it “locked.”
Tools and workflows that help with consistency
You can follow all of the steps above with most AI video tools, but some workflows align better with the way animation is actually made.
Look for tools that:
- Let you define characters once, then reuse them.
- Separate stages: script, storyboard, scene‑by‑scene generation.
- Support episodes or recurring projects so your “Maya and Pixel” exist across multiple videos.
- Make it easy to regenerate a single shot instead of an entire video.
Ajax Studio is one example of this kind of workflow. You describe your video in a sentence or paste your script, it writes a story you can edit, then draws every shot as a storyboard before creating the scenes as video with music. Characters are created once with a look and a voice and stay the same across every video in a show or project, which can save time when you build a series around recurring characters.
Use whatever tool you like, but favor processes that respect character continuity over “one‑click” chaos.
Bringing it all together
To keep consistent characters in AI video, you don’t need magic prompts. You need a simple, disciplined pipeline:
- Design your characters on paper first.
Maya and Pixel exist as text and reference images before any animation.
- Plan a concrete shot list.
Decide what each second does, where the camera is, and who is in frame.
- Write stable prompts.
Reuse identity blocks, add small negative cues, and be explicit about speaking characters.
- Insist on storyboards.
Catch face drift, clothing changes and bad framing before paying for motion.
- Control dialogue and safety wording.
Assign lines clearly, prompt for who is speaking, and phrase visuals in non‑triggering ways.
- Iterate shot by shot, not whole‑video at once.
Fix the specific place where Maya’s glasses vanished or Pixel changed size.
Follow this approach on your own 15‑second Short, and you’ll spend less time fighting the model and more time telling stories. Your Maya and Pixel will finally feel like the same characters from the first frame to the last.
About Ajax Studio: We build AI-powered tools for music video creation. If you found this article helpful and want to try AI video generation, check out what we're building.