DEV Community

Cover image for Prompt Patterns That Work in an AI Anime Image Editor
Abirami Vina
Abirami Vina

Posted on • Originally published at Medium

Prompt Patterns That Work in an AI Anime Image Editor

Find out how to use an AI anime image editor to change poses, objects, text, and backgrounds in PixAI while preserving your character and art style.


Every anime creator knows the frustration of an image that is almost right. Not broken, not wrong, just off by one detail you can't unsee. We ran into it while designing the lead for a new manga, a junior panda keeper at a mountain zoo.

After more attempts than we want to admit, we had a base image that finally read like a real character. The morning light was right, her glasses caught it just enough, and the cub was reaching for the bamboo in her hands at exactly the angle we wanted. Then we looked closer at her ID badge. It said "MEI 12", and it needed to say "MEI 07".

Everything else was right, so we did what everyone does and hit Generate again. Her face came back close enough, but the braid had moved behind her shoulder, the camera had pulled in, and the cub was cropped down to a paw at the edge of the frame. We had traded one problem we could name for three we never asked for.

Two anime images of a panda keeper generated from the identical prompt shown side by side, showing why creators use an AI anime image editor instead of regenerating.

The same prompt run twice, with the panda cub, the camera distance, the braid, and the bamboo all landing differently while the character herself stayed close to consistent.

That happens because generating a new anime image doesn't adjust the one you have. It starts over from random noise and rebuilds everything from your prompt, so every detail you liked is back in play, including the ones you never mentioned because they were already fine.

The more practical approach is to edit anime images with AI, keeping the original and changing only the part that needs changing. That is what an AI anime image editor is for, and PixAI handles it through instruction-based editing, where you describe the change in plain language and the model applies it to the image you already have.

Let's walk through that workflow hands-on, following one character across a full reference-sheet build.

Why an AI Anime Image Editor Beats Hitting Generate Again

So, what's the technical difference between generating a new anime image and editing the one you already have? The two actions feel similar because they sit behind the same button, but they work in opposite directions.

Generating starts from nothing. The model begins with random noise and shapes it into an image that fits your prompt, which means every element is decided fresh each time. Your prompt only steers the parts you thought to describe. Everything else gets decided by the roll, including the camera distance, where the cub sits, and how the braid falls.

Editing starts from something. When you edit anime images with AI, you hand the model an existing image along with an instruction, and that image becomes the anchor. Instead of inventing a scene that matches your words, the model works out what your instruction changes and leaves the rest of the picture where it is.

That difference is really about preservation. When we looked at our base image of Mei, the badge was the only thing we wanted to change.

Base anime image of a panda keeper with labels marking her round glasses, collar pin, name badge, side braid, wrist bandana, and the panda cub, used as the reference for AI image editing tests.

The details we needed to protect through every edit.

Everything else was already doing its job, right down to the soft morning light behind the fence. None of that was in the prompt in enough detail to reproduce it, and some of it we never described at all.

Diagram comparing AI image generation from random noise with instruction-based editing, where an anime keeper's name badge is changed from MEI 12 to MEI 07 while the rest stays the same.

Generating rebuilds the whole image from noise each time, while editing starts from the image you already have and changes only the detail you describe, in this case, the name badge.

An AI anime image editor lets you keep all of it. You aren't rebuilding the image and hoping the good parts survive. You are pointing at one thing and asking for that one thing to be different.

When to Edit Anime Images with AI and When to Start Over

Editing isn't always the answer, so it helps to know which situations call for it. Here are the ones we ran into while building Mei's reference sheet:

  • The image is right, and one small thing is wrong: This is the clearest case. Our badge said MEI 12 and the manga needed MEI 07. Nothing else about that image needed to move, so nothing else should have been put at risk.
  • You want the same pose with something changed: Suppose you have Mei kneeling and you want to try three uniform colors. Describing that pose again in a prompt gets you close, but never the same. Editing keeps the pose fixed and swaps only what you asked for.
  • The composition took too many attempts to reproduce: The cub reaching up with both paws at that exact angle took us many tries. Once you have a composition like that, regenerating means putting it back on the table. Changing an outfit color isn't worth losing the panda.
  • You need controlled variations rather than new images: Four passes at a character sheet should give you four versions of the same keeper, not four different women in similar uniforms. Editing from one source keeps the set coherent.
  • The concept itself is wrong: This is the case where you should start over. If the setting, the mood, or the character design isn't what you wanted, no amount of targeted editing will get you there. Editing adjusts an image. It doesn't rescue a wrong idea.

The rough test is whether you like the image. If you do and one thing is off, edit it. If you don't, generate again and describe it better this time.

How to Edit Anime Images with AI in Tsubaki.3: Step by Step

Every edit in this article was made with Tsubaki.3, PixAI's newest image model. Alongside generating from a prompt, it handles instruction-based editing, which means you hand it an image and describe the change in plain language rather than masking a region or rebuilding the scene.

PixAI has another model built for this kind of work too, called Edit Pro, so if you have used it before, the approach here will feel familiar. Here's an overview of using Tsubaki.3:

  • Start from the image you want to keep: Any image works, whether it came from PixAI, another generator, or your own drawing tablet. The closer it already is to what you want, the less the edit has to do.
  • Place the image to edit first in the reference slots: PixAI's guidance for Tsubaki.3 is to put the image you want changed in the first slot, with any additional references after it.
  • Switch to Auto mode: This tells the model to work out the change itself instead of generating from scratch.
  • Write the instruction, naming what changes and what stays: Both halves count. Naming what should stay put gives the model a reason to leave it alone, and almost every prompt in this article ends with that kind of clause.
  • Generate, then compare against the original: Open both at full size. A small drift in the face or a background detail is easy to miss in a thumbnail.

To show what that looks like in action, we ran a small change on Mei before moving on to the bigger tests.

The PixAI Tsubaki.3 interface with an anime panda keeper image loaded as the editing reference and an instruction typed in the prompt field.

The Tsubaki.3 editing setup, with the base image placed first in the reference slots and the instruction written below it.

The prompt was:

"Change the blue bandana on her wrist to a dark red one. Keep her face, glasses, side braid, olive uniform, name badge, collar pin, the panda cub, the bamboo, the background, and the art style exactly as they are."

Here's the result we got.

Before-and-after comparison of an anime panda keeper, with her blue wrist bandana edited to dark red using an AI image editor for anime.

The wrist bandana changed from blue to dark red while her face, uniform, badge, and the panda cub stayed where they were.

Change a Pose, Outfit, or Expression Without Losing Your Character

If there's one type of edit that is most likely to break the image you were trying to protect, it's a character edit. An object sits in a scene and can be swapped out without much consequence.

A character is a set of features that have to agree with each other, so touching one of them means the model redraws the region around it, and that region contains her face.

The three most common character edits sit on a difficulty curve, and it helps to know where you are on it before you write the prompt.

Outfit and color changes are the safest. The body stays where it is, and only a surface gets repainted. This is why the bandana swap earlier came back clean, and the same instruction pattern works for a collar, a jacket, or a full uniform color.

Expression changes are riskier than they look. The area being redrawn is small, but it is the part of the image a reader's eye goes to first. A face that shifts by a few percent still reads as a different person.

Pose changes are the hardest ask. The entire figure is rebuilt from a new angle, so every identifying detail has to survive being drawn again rather than simply carried over.

We ran all three on Mei while building her reference sheet, which is the situation where this problem actually bites. One image isn't a reference sheet.

Before you can draw a character on a manga page, you need her standing, walking, and mid-laugh, and the usual approach is to go back to the prompt box and describe her again with a new pose attached. That gets you someone who is nearly her. Do it four times, and you have four cousins instead of one character.

Changing the pose

The sheet needed her upright and carrying something, so we started at the hard end of the curve and asked for a full pose change in one instruction:

"Change the character's pose to standing upright, carrying a bundle of bamboo over her right shoulder, looking down toward the panda at her feet. Keep the same character, face, glasses, braid, uniform, and art style unchanged."

The prompt doesn't describe her. No black hair, no brown eyes, no uniform color. This is the single most useful habit for character edits, since the image is already holding her identity, and re-describing it gives the model a second, weaker version of the truth to work from. Your words should cover only the delta.

Before and after comparison showing an anime panda keeper's pose changed from kneeling to standing with a bundle of bamboo, using AI image editing.

Mei stands and carries a bamboo bundle over her right shoulder, with her glasses, braid, collar pin, and MEI 07 badge intact, while the enclosure behind her opens out into a bamboo path.

Tsubaki.3 got the pose right on the first attempt, and her character traits survived. She is recognizably the same person.

When you run a pose change on your own character, the details worth checking are the small, high-information ones. Not the hair color, which is easy for a model to hold, but the things that carry identity in a few pixels, like a scar, an earring, a marking, or text on a badge.

Changing the expression

A reference sheet also needs a few expressions, so we went back to the original image and asked for a smaller change to the one part of her the reader looks at first:

"Change her expression to a quiet, open-mouth laugh with her eyes softly shut. Keep her face shape, glasses, hair, braid, uniform, name badge, the panda cub, the background, and the art style exactly as they are."

Expression prompts work better when you describe the mechanics rather than the mood. "Happy" leaves the model to decide what happy looks like on this face. "Open-mouth laugh with her eyes softly shut" names the two features that actually have to move and leaves everything else alone by implication.

Before and after comparison of an anime panda keeper's facial expression edited to a quiet laugh while her glasses and hairstyle stay the same.

Mei's eyes close and her smile opens into a laugh, while her glasses, braid, badge, bandana, the bamboo in her hands, and the cub all stay where they were.

Tsubaki.3 shut her eyes and opened her mouth into a laugh, and almost nothing else moved. The one thing we didn't ask for is that her head tilts down slightly further than in the original, which reads as her looking toward the cub rather than past it.

It suits the laugh, so we kept it, but it is a reminder that a change to one feature can pull neighboring ones with it. A face is a system, and moving the eyes moves the head that carries them.

The wider lesson is that expression edits are the safest place to start if you are new to this. Very little of the image is at risk, and you get a fast read on whether the model is holding your character before you commit to something larger.

Changing the outfit

Outfit edits are where the same technique pays off fastest, because a reference sheet usually needs several versions of one design. Mei's uniform was the obvious candidate, and the instruction follows the same shape as the others, naming the garment that changes and then the ones that don't:

"Change the olive uniform shirt to navy. Keep the collar pin, name badge, rolled sleeves, her face, glasses, braid, and the rest of the image exactly as they are."

Here is the output.

Before-and-after comparison of an anime panda keeper's olive uniform changed to navy using an AI image editor for anime, with her badge and collar pin unchanged.

Mei's uniform comes back in navy with the collar pin, MEI 07 badge, and rolled sleeves intact, though the trousers changed color along with the shirt.

Everything we asked to protect survived. The bamboo-leaf pin, the MEI 07 badge, the rolled sleeves, her face, glasses, braid, and the cub all came through untouched. Tsubaki.3 even reworked the inner cuff to a lighter blue so the roll still reads as a lining rather than a flat block of navy.

The overreach is in the trousers. We asked for the shirt and got the whole uniform, which is a reasonable reading, since a keeper's outfit is one set in most people's heads. Naming the trousers would have held them.

That is the pattern worth carrying into your own work. Anything you leave off both lists, the change list and the protect list, is fair game. When two garments sit next to each other, decide up front whether they move together and say so.

Add, Remove, or Replace an Object in an Image With AI

Objects are the easier half of editing. A character has to stay consistent with herself, but a bucket only has to sit convincingly on the grass.

They are also where editing saves the most time. Prompting a new scene means describing Mei, the cub, the enclosure, the light, and the bucket all at once, then re-rolling everything until the one new element lands. Editing puts a single object in play and holds the rest still, so a bad attempt costs you one object rather than the whole image.

What makes object edits interesting to test is the second subject problem. Mei's scene has a panda cub in it, and every time you ask the model to touch something in that frame, the cub is in range.

So we ran three edits from the same kneeling image, working up from the gentlest ask to the hardest one.

Adding is the easiest, because nothing has to be removed or reconstructed. The model finds space in the composition and fills it. We asked for a wooden feed bucket on the grass beside her.

Removing is harder, because the model has to invent whatever was behind the thing you deleted. We took out the wooden fence, which runs the width of the frame and hides a strip of bamboo grove behind it.

Replacing is the hardest of the three, because the new object has to fit a space the old one defined. Her hands are already closed around a bamboo stalk, so a replacement has to work with a grip drawn for something else. We swapped it for a milk feeding bottle.

We used the following three instructions, each maintaining the same shape as before:

"Add a wooden feed bucket sitting on the grass beside the character, to her left. Keep the character, her pose, the bamboo in her hands, the panda cub, the fence, and the background unchanged."

"Remove the wooden fence in the background. Keep the character, the panda cub, the bamboo grove, the grass, and everything else unchanged."

"Replace the bamboo stalk in the character's hands with a white milk feeding bottle. Keep her grip and hand position, the panda cub, her uniform, and the rest of the image unchanged."

This is what our edited images look like.

Four anime images of a panda keeper side by side, showing the original alongside AI object edits that add a feed trough, remove the fence, and replace the bamboo with a feeding bottle.

The same kneeling image after three object edits, with a wooden feed trough added, the background fence removed, and the bamboo swapped for a milk bottle.

Mei survived all three, badge included. Three versions of one scene, and none of them cost us the character.

Two things stood out. First, removing was easier than adding. Rebuilding the grove behind the fence was invisible work, while our request for a bucket came back as a feed trough. The model reads the noun, then decides what belongs in the scene, so describe the shape if the exact object is crucial.

Second, replacing an object can move things you didn't name. The bamboo became two bottles, and the cub started drinking. That isn't a mistake so much as a consequence. Swap something a second subject is interacting with and expect that subject to react.

Can You Add or Edit Text in an AI Image? We Tested It

We already ran one text edit at the start of this project, changing Mei's badge to MEI 07, and it worked on the first attempt. That is the easy version of the problem, since the badge already existed and the model only had to repaint what was inside it.

The harder ask is text that has to be created from nothing, and text is the one thing an image model can't approximate its way out of. A feed trough that comes back slightly wrong still reads as a feed trough.

A sign with a letter missing reads as a mistake, and every reader spots it. So we tried adding a sign to the enclosure and a speech bubble for the manga panel using these prompts:

"Add a wooden sign mounted on the fence behind the character, angled toward the viewer, with clear black text reading PANDA HOUSE. Keep the character, the panda cub, the fence, and everything else unchanged."

"Add a speech bubble above the character reading 'Almost feeding time.' Keep the character, the panda cub, the background, and the composition unchanged."

This is what our attempts looked like.

Five anime images of a panda keeper side by side, showing an AI-added enclosure sign across three prompt and aspect ratio attempts alongside an added speech bubble.

The sign in a portrait frame landed behind the bamboo with a letter hidden, moving to 4:3 gave it room, dropping the preservation clause cleaned up her hand, and the speech bubble worked without any of that.

In both tests, the letterforms held up. The speech bubble came back clean, punctuation included, and the sign rendered as readable block capitals.

Placement was the harder problem. In a portrait frame, the only free space for the sign sat behind Mei's raised hand, so the bamboo covered a letter and the frame edge clipped the end of the word.

The fix wasn't a better prompt but more canvas. We switched the aspect ratio from Auto to 4:3, ran the same instruction, and the wider frame gave the sign somewhere to go. The sign came out clean, but her hand didn't, with the fingers around the bamboo coming apart under the wider composition.

Close-up comparison of an anime character's hand holding bamboo, distorted in one AI edit and correctly formed in another.

Her upper hand on the left never closes around the bamboo, with one finger floating loose, while the shortened prompt on the right produced a proper grip.

So we ran it once more, this time dropping everything after the first sentence and asking only for the sign. That version fixed the hand, kept the badge, the braid, the bandana, and the pin, and put the sign on its own post where it reads easily.

That cuts against the pattern we have been going back to again and again, and the reason seems to sit in what Tsubaki.3 does well. PixAI describes it as following prompts closely, particularly long structured ones, and close following is exactly what makes a crowded instruction expensive.

We had asked it to widen the canvas and hold the character, the cub, the fence, and everything else in place, which are competing demands once the frame changes. Something has to absorb the strain, and hands are usually where it lands.

So keep the preservation clause for local edits, where it costs nothing and buys precision. Loosen it when you are changing the frame itself, and let the reference image carry what you would otherwise be listing.

Using an AI Anime Background Changer Without Losing the Character

Everything so far has changed something specific inside the frame. Backgrounds work the other way around, changing everything except the subject. That makes them the clearest test of whether the model actually understands what your character is, because Mei has to stay Mei while the light, the weather, the palette, and the world behind her all move.

A manga panel is where this bites. Mei was designed in flat morning sun, which is useful for a reference sheet and wrong for almost every scene you would actually draw her in.

We wanted to test how far the environment could move before she stopped looking like herself, so we ran four edits from the same kneeling image: two that change the weather and two that only change the light. We used the following prompts:

"Change the background to the same panda enclosure at dusk with light snow falling, warm lamp light from a keeper's hut. Keep the character, the panda, the pose, the outfit, and the art style unchanged."

"Change the scene to heavy rain, with the character and the cub under a wet grey sky and rain streaking the air. Keep the character, the panda, the pose, the outfit, and the art style unchanged."

"Change the lighting to strong backlight from a low evening sun behind the character, keeping the same daytime enclosure."

"Change the lighting to a single warm lamp above and to the left of the character at night, with deep shadows and the background falling into darkness."

Here's what we got.

Anime panda keeper shown side by side across four AI background and lighting edits, including snow, rain, backlight, and night lamp light.

The same kneeling image moved into dusk snow, heavy rain, evening backlight, and night lamp light, with the character holding steady in three of the four, while the snow version rebuilt the whole enclosure.

Three of the four held almost everything. However, the snow version went somewhere else. It pulled the camera back, built a caged enclosure with two adult pandas, added a keeper's hut, and left the badge as an unreadable smudge.

That isn't weather being harder than light. It is what happens when the instruction names something that doesn't exist yet. We asked for lamp light from a keeper's hut, and there was no hut, so the model built one, and a building needs a scene around it.

Changing how a scene is lit is a contained edit, and changing what is in the scene isn't, even when it sounds atmospheric. If you want dusk and snow without losing your composition, describe the light and the weather and stop there.

Instruction Editing vs AI Inpainting for Anime: Which Fits Your Edit?

You may have noticed that every edit in this article was instruction-based. We described a change in a sentence, and the model worked out where to apply it.

The older approach, inpainting, works the other way around. You paint a mask over the region you want redrawn, then describe what should fill it, so you define the where and the model handles the what.

The choice comes down to one question. Can you name the thing you want to change?

Instruction editing needs the thing you are changing to have a name. That covered almost everything we did here, and it also explains our two misses. We asked for a bucket and got a trough because the word left room for interpretation, and the sign landed behind the bamboo because a sentence cannot specify coordinates.

Inpainting answers exactly that problem. Some changes are a patch of pixels rather than an object, like a smudge on a sleeve or a fence rail cutting across the cub's outline. You can't easily name those things in a prompt, but you can circle them. Masking also guarantees what stays untouched, because anything outside the mask is never in play.

Also, these two work well together. Instruction editing handles the substantive changes, and masking cleans up what it leaves behind.

Tips for Better Results From an AI Image Editor for Anime

Here's a look at what our testing actually taught us:

  • Describe only what changes: None of our prompts described Mei's hair, eyes, or uniform. The image already holds that, and re-describing her only competes with it.
  • Name what stays for local edits, and loosen it for structural ones: The preservation clause helped with every contained change. It worked against us once we also asked for a wider canvas, and her hand came apart under the competing demands.
  • Describe an object, don't just name it: We asked for a bucket and got a feed trough. Give the model shape and material if the exact object is crucial.
  • Expect a second subject to react: The cub was on our protect list and still ended up drinking from the bottle once the bamboo became one. Naming it is not enough when the thing it interacts with changes.
  • Change the light, not the furniture: Rain, backlight, and lamp light all left the composition intact. Asking for light from a keeper's hut built a hut, and a building needs a scene around it.
  • Use the aspect ratio when text has nowhere to go: The lettering held up in both tests. Placement was the problem, and widening the frame fixed it faster than rewriting the prompt.

An AI Anime Image Editor Turns Almost Right Into Right

We started with one image of Mei that was almost right and a badge that was wrong. Everything after that came from editing with Tsubaki.3 rather than regenerating.

She now has a corrected badge, a second pose, a laughing expression, a uniform variant, three object edits, a signed enclosure, a speech bubble, and four lighting setups. Feed four of those edited images into Edit Pro as references, and you get a finished character sheet with the same person throughout the panel.

An anime character sheet for a panda keeper showing full-body views, expressions, a name plate, and an equipment list, assembled from AI-edited images.

A character sheet built in Edit Pro from four of our edited images, carrying the MEI 07 badge, the glasses, the braid, the wrist bandana, the feeding bottle, and the PANDA HOUSE sign into one page.

Not everything was perfect in our tests. A bucket came back as a trough, a hand came apart when we widened the canvas, and a keeper's hut rebuilt an entire scene.

Editing doesn't remove the iteration. It changes what each attempt costs, because a failed edit costs you one element instead of the whole image. So when you have something you like, protect it. Open the image you almost love, name the one thing that is wrong, and fix that instead of rolling the dice again.

You can try it yourself on PixAI. Pick an image you nearly gave up on, load it into Tsubaki.3, and see what one instruction does to it.

Top comments (0)