Genjutsu background swap: change the world, keep the take

What is a Genjutsu background swap?

Genjutsu background swap replaces the location around an existing performance while keeping the subject, body motion, camera move and timing. The source clip supplies the action; location references define the new street, interior, landscape or world behind it.

The result works when the replacement changes what surrounds the subject without turning the whole shot into a different production. For a complete cast, wardrobe and location rebuild, use Motion Transfer. For one contained environmental element such as a sign, window or poster, Object Swap is often the cleaner route.

How is background swap different from motion transfer?

Background swap is a goal, not a separate model. In practice, a whole-location change runs through Motion Transfer because the generator has to rebuild the space around the preserved performance. Object Swap is better when the environment change is small and local.

Choose by the area that must change. If the street, sky, walls and depth all need to become a new place, rebuild the scene. If only the billboard, storefront sign or screen changes, protect the rest of the original frame with an object edit.

• Whole environment: Motion Transfer with location references.
• One environmental object: Object Swap with a focused reference.
• Subject and location both change: character or multi-character recast plus the new location.
• Wardrobe and location change together: a full recast, not two competing point edits.

What source clip works best for a background replacement?

The best source has one clearly visible subject, stable framing and a readable separation between the body and the scene. A short 3 to 30 second shot with one camera angle gives the model a consistent geometry to preserve.

Do not rely on a busy background to hide errors. Strong edges, foreground objects and fast camera moves make the new location harder to attach. A clean silhouette and controlled lighting are more valuable than raw resolution.

• Keep the subject fully visible and avoid heavy foreground occlusion.
• Use a stable camera or one intentional move; avoid cuts inside the clip.
• Match the source aspect ratio to the destination channel.
• Collect three to six location references with wide, mid and detail views.
• Keep the new location’s light direction compatible with the original face and body.

How do you prompt a background swap?

The prompt must protect the subject before it describes the new place. Start with “keep the performer, face, wardrobe, motion and camera,” then name the replacement location and the reference. This ordering stops a location description from spilling into a full cast or outfit recast.

Describe depth in layers: foreground, midground and background. A useful location brief names the ground material, main structures, horizon and atmosphere. Avoid writing a long story; the image references should carry visual style and detail.

How do you match perspective and lighting?

Perspective matching starts before the prompt. Choose a location reference photographed from a similar camera height, lens character and horizon. A low-angle location will not sit naturally behind a high-angle subject unless the model is allowed to rebuild the geometry.

Lighting is the second anchor. Record the source’s key direction, contrast and colour temperature, then choose a destination that can plausibly produce the same illumination on the subject. If the new world has a huge window from the right, the original subject should already be lit from the right.

• Match horizon height and vanishing direction.
• Keep the subject’s feet or contact points attached to the new ground.
• Repeat the source key-light direction in the prompt.
• Use haze, atmosphere or foreground depth to blend the location seam.
• Check shadows under the body before reviewing decorative details.

How can brands use background swap?

Brands use background swap to localise one approved performance for multiple markets, move a product demo into a seasonal environment, or replace a set that was not available on shoot day. The master clip remains the same, which reduces the cost of another production.

The output still needs a rights review. A recognisable landmark, storefront or private interior may require permission even if the file can be uploaded. Do not describe a real location in a way that implies a partnership or endorsement that does not exist.

• Campaign localisation: same performer, different city or market context.
• Seasonal refresh: keep the product action and replace the set.
• Remote production: combine a controlled studio performance with a location reference.
• Concept testing: compare environments before committing to a full reshoot.

What goes wrong in a background swap?

The common failure is a beautiful location that no longer belongs to the person. Feet slide across the floor, shadows point in opposite directions, edges glow, or the camera seems to tilt between two geometries. Fix the spatial relationship before adding more style words.

If the subject looks pasted in, reduce the amount of background detail, improve the location reference, and restate the original lens and horizon. If the model changes the person, shorten the prompt and repeat the invariants in one clear sentence.

• Floating or sliding feet: choose a flatter ground reference and state the contact plane.
• Wrong light direction: name the key-light side and simplify the destination lighting.
• Subject changes: remove character and wardrobe language from the location prompt.
• Edge halo: use a cleaner source silhouette and reduce foreground clutter.
• Inconsistent depth: provide a wide location image instead of several mismatched angles.

Can you keep the original camera movement?

Yes. When the source clip anchors the performance, its camera speed, direction and timing remain the reference. Do not ask for a new camera move unless you are intentionally rebuilding the shot. A second camera instruction creates two competing spatial systems.

If the original move is too aggressive, trim to a steadier section rather than instructing the model to smooth it. Preserving a short useful section is more reliable than trying to repair one long, unstable take.

Key takeaways

• Background swap replaces the world around an existing performance.
• Use Motion Transfer for a whole location and Object Swap for a contained environmental detail.
• Choose reference locations that share the source camera height and light direction.
• Protect the subject, wardrobe, motion and camera before describing the new place.
• Check ground contact, shadows and perspective before judging the style.