Genjutsu character swap: replace one performer, keep the shot

What is a Genjutsu character swap?

Genjutsu character swap replaces one performer in footage you already own while preserving the original action, camera and timing. You provide the source clip and a set of reference images for the replacement character; the model rebuilds the person while keeping the performance as the anchor.

This is a recast job, not a face filter. The goal is a consistent character across the whole shot, including profile changes, hands and clothing. The source footage decides what the person does, and the references decide who the audience sees.

How is character swap different from multiple characters?

A character swap usually changes a single subject in a single-person shot. The multiple-characters workflow changes two or more people in the same frame and must preserve who belongs to which body, especially when they move close together.

Start with the simpler one-person workflow whenever the shot allows it. It gives the model one identity to solve and one reference set to follow. Move to the two-person guide only when both performers are visible and the final edit genuinely needs both of them replaced.

• One performer: use one clean reference set and protect every other element.
• Two performers: use separate reference sets and explicit left-right instructions.
• Character plus location: rebuild both only when the story needs a complete recast.
• Character plus outfit: decide whether the new identity already carries the wardrobe or needs a second pass.

What reference images make a character stay consistent?

The strongest reference set shows the same invented character from several useful views: a neutral front view, three-quarter view, profile, full body and one close-up of unique details. Keep the lighting, age and styling consistent across the set so the model does not have to choose between different versions.

A group photo is a poor reference because it forces the model to guess which face belongs to which body. Screenshots with hard crops, filters or heavy motion blur are also weak anchors. Use clean images where the face, hair and silhouette are readable.

• Three to six references per character is a practical starting point.
• Include front, three-quarter and profile coverage when the source turns.
• Show the outfit and distinctive features that separate the character from the crowd.
• Keep every image clearly tied to one identity; do not mix near-duplicate faces.
• The project limit is 40 reference images, not a target to fill.

How do you write a character swap prompt?

Name the replacement character, the source performance and the invariants. The prompt should say that the original motion, camera, timing and background survive. If the source has one person, state that no additional people should appear.

Avoid writing a biography. The reference images carry appearance; the prompt should resolve ambiguity. Focus on which reference belongs to whom, the body position, what must not change and whether the original wardrobe should stay.

What footage is easiest to character swap?

Use one person, one camera angle and a continuous 3 to 30 second take. The most reliable clip keeps the face visible for a useful portion, keeps hands away from the face, and avoids long periods where the performer is turned away or hidden.

Fast fights, overlapping crowds and constant cuts are harder because the model has to invent the missing parts of the identity. Choose the smallest clean section that contains the meaning of the shot instead of submitting the whole sequence at once.

• Use even light on the face and body.
• Keep the person separated from background clutter.
• Trim around cuts, flashes and severe motion blur.
• Keep the original wardrobe simple unless the costume is part of the new identity.
• Use explicit permission for every real person and likeness in the source.

How do you keep identity stable through a turn?

Identity stability comes from the reference set and the source geometry. Give the model a profile view if the source turns sideways. Keep the same character set across every render, use the same reference order, and avoid changing the light direction between attempts.

If the face drifts, isolate the failure. Compare a front-facing still, a profile and a hand-heavy frame. Replace only the weakest reference and rerun the same clip. Changing the prompt, references and motion at once makes the next result impossible to evaluate.

Can you use a real person as the replacement?

Only with clear permission and the rights needed for the way the output will be used. Replacing a performer with a real person’s likeness can create impersonation, privacy, publicity and safety issues even when the source footage is yours.

Use invented characters or licensed references whenever possible. Keep a record of consent for models, footage and reference images. If the clip will be published, check the platform’s synthetic-media and disclosure requirements before posting.

What causes a failed character swap?

The common failures are extra people, a face that changes between frames, mismatched clothing and hands that lose ownership of an object. These usually come from ambiguous references or a source shot with occluded bodies, not from the wording alone.

Simplify the shot before adding adjectives. Remove extra people from the reference set, separate the performers, trim the clean window and state one identity per object. A stable silhouette is more useful than a longer prompt.

• Face changes: add a clear front and profile reference with matching styling.
• Second person appears: explicitly preserve the background and prohibit additional people.
• Hands drift: keep hands visible or trim before a hand crosses the face.
• Wardrobe merges: separate identity from outfit or rebuild the full character in Motion Transfer.
• Identity looks flat: replace low-resolution references with clean, well-lit images.

Key takeaways

• Character swap keeps the source clip and rebuilds one performer around it.
• Use a separate workflow for two-person recasts with explicit left-right ownership.
• Three to six consistent references beat a large, contradictory image set.
• Protect the camera, motion, background and any unchanged wardrobe in the prompt.
• Use real likenesses only with permission and the correct posting disclosures.