The VFX Integration Checklist: 10 Pro Steps for Seamless Live-Action Compositing

Every VFX shot begins with a promise: that the viewer will never question what is real and what is added. The moment a composite breaks — a hard edge, a mismatched shadow, a color that doesn't belong — that promise is broken. Compositing is the final gatekeeper between practical footage and digital elements, and getting it right requires more than just a good keyer. It demands a systematic approach. This checklist covers the ten steps we use to ensure live-action composites feel grounded, from the first plate to the final render.

Whether you are a solo artist on a short film or part of a larger pipeline, these steps are designed to catch the common pitfalls that eat up hours of revision time. We focus on the integration phase: the moment when CG elements, matte paintings, or effects layers meet real-world footage. Let's start with the foundation — the plate itself.

1. Why Integration Deserves Its Own Checklist

Compositing is often treated as a single stage in the VFX pipeline, but experienced teams know it is a series of interconnected decisions. A beautiful render will fail if the plate has unresolved lens distortion. A perfect key will look fake if the grain direction doesn't match. The stakes are high because the human eye is remarkably sensitive to subtle inconsistencies — our brains evolved to detect anomalies in lighting, depth, and motion. When a composite feels off, even a non-technical viewer can sense it, even if they can't articulate why.

That's why we advocate for a dedicated integration checklist. It shifts the mindset from 'make it look good' to 'make it belong.' This distinction saves time and frustration. Instead of tweaking parameters reactively, you work through a structured sequence: prepare the plate, match the color space, align the lighting, blend the edges, and then refine. Each step builds on the previous one.

Who is this for? It's for compositors who have struggled with shots that never quite sell, for VFX supervisors who need a consistent review process, and for indie filmmakers who want to elevate their visual effects without a Hollywood budget. By the end, you should be able to identify weak points in any composite and fix them methodically.

The Cost of Skipping Steps

Consider a typical scenario: an artist receives a greenscreen plate, keys it quickly, and drops in a CG background. The result looks passable in a single frame but falls apart in motion. The edge flickers, the background color bleeds into the foreground, and the shadow direction contradicts the plate lighting. Fixing these issues after the fact often requires re-keying or even re-shooting. A checklist prevents this by forcing you to address each layer of the composite before moving on.

Why This Matters Now

With the rise of real-time engines and AI-assisted tools, some assume that compositing is becoming automatic. In practice, these tools still require human judgment to handle edge cases and to maintain creative intent. A checklist is not a replacement for skill; it is a framework that lets skill shine. It also helps teams collaborate more effectively, because everyone agrees on what 'done' means at each stage.

2. Core Idea: Matching Reality Through Layers

At its heart, seamless compositing is about matching the physical properties of the original footage. Every real-world image carries signatures: the color temperature of the light, the falloff of shadows, the texture of grain or noise, the curvature of the lens. Digital elements lack these signatures by default. The compositor's job is to reverse-engineer the plate's characteristics and apply them to the added layers.

This is not about making everything look perfect in isolation. It is about making the added elements feel as though they were captured by the same camera, under the same conditions. We think of it as building a 'shared reality' between the plate and the CG. The checklist breaks this into ten concrete steps:

1. Plate Preparation: Clean the plate — remove dust, fix flicker, and apply lens distortion grids if needed.
2. Color Space Alignment: Ensure all elements are in the same working color space (e.g., ACES, linear).
3. Lighting Matching: Analyze the plate's light direction, intensity, and color. Adjust CG lights accordingly.
4. Shadow and Reflection Integration: Add contact shadows, ambient occlusion, and environment reflections.
5. Edge Blending: Soften keyed edges, handle spill, and match edge detail to the plate's focus.
6. Grain and Noise Matching: Apply plate-specific grain or noise to CG elements.
7. Motion Blur Alignment: Match shutter angle and motion blur direction.
8. Depth and Atmosphere: Add fog, haze, or color grading that varies with distance.
9. Color Grading Pass: Apply a final look that unifies all layers.
10. Review and Iterate: Check the composite in motion, at full resolution, and on a calibrated monitor.

These steps are not rigid; they adapt to the shot. But the order matters. For example, you cannot match grain before you have locked the color space, because grain is amplified or suppressed by color transforms.

The Role of Observation

Before touching any tool, spend time studying the plate. Look at the highlights: are they warm or cool? Look at the shadows: are they sharp or soft? Look at the noise pattern: is it fine or chunky? This observation phase is the most undervalued part of compositing. It tells you what the plate expects from the CG.

3. How It Works Under the Hood

Understanding the technical mechanisms behind each step helps you make better decisions when things go wrong. Let's look at three core systems: keying, edge blending, and color management.

Keying and Spill Suppression

Keying separates the foreground from the background based on color difference (usually green or blue). Modern keyers like Keylight or Primatte use a combination of chroma key and luminance key to generate an alpha matte. The challenge is that green spill — light reflecting from the screen onto the subject — contaminates the edges. Spill suppression works by sampling the screen color and subtracting it from the foreground, but aggressive suppression can desaturate skin tones or create unnatural halos. The solution is to use a targeted spill suppressor that only affects the edge region, often using a garbage matte to protect the interior of the subject.

Edge Blending Techniques

Even with a perfect key, the edge between foreground and background often looks too sharp or too soft. The plate's camera has a specific depth of field, and the CG element must match. Edge blending involves: (1) eroding or dilating the matte to remove thin spill lines, (2) applying a blur that matches the defocus of the plate, (3) using edge blur tools that vary the blur based on distance from the center of the frame (to simulate lens falloff). A common mistake is to blur the entire matte uniformly, which flattens depth. Instead, we use a depth map or manual roto to apply varying blur.

Color Management Pipeline

Color management ensures that all elements are interpreted consistently. If the plate was shot in Rec.709 but the CG render is in linear sRGB, the composite will have mismatched contrast and saturation. The industry standard is ACES (Academy Color Encoding System), which provides a unified color space from capture to display. In ACES, you convert the plate to ACEScc (color correction) or ACEScg (rendering), render CG in the same space, and then apply a display transform for viewing. This eliminates guesswork. For teams without ACES, the principle remains: convert everything to a linear working space, do your compositing there, and then apply a final LUT.

Motion Blur Matching

Motion blur is the result of the shutter being open while the subject moves. CG renders often have motion blur calculated, but it may not match the plate's shutter angle (typically 180 degrees, giving a blur length equal to half the frame duration). To match, you need to know the plate's shutter angle and apply a corresponding motion blur to the CG element, using 2D or 3D motion vectors. Additionally, the direction of motion blur must be consistent: if the camera pans left, the blur streaks should align with that direction.

4. Worked Example: A Greenscreen Product Shot

Let's walk through a realistic scenario. You have a plate of a person holding a product in front of a greenscreen, and you need to place them in a virtual kitchen environment. The plate was shot with a Sony FX6 at 24fps, 1/50 shutter, Rec.709 color. The CG kitchen was rendered in Blender with a physical camera matching the focal length and aperture.

Step-by-Step Walkthrough

Plate Prep: The greenscreen has a few wrinkles and uneven lighting. We apply a clean plate pass using a holdout matte to even out the green, which helps the keyer. We also remove a dust spot on the lens using a clone stamp.

Color Space: We convert the plate to ACEScg using a transform matrix. The CG render is already in ACEScg. Now both are in the same linear space.

Keying: Using Keylight, we sample the green and generate a matte. The subject's hair has fine strands that are lost. We create a separate edge matte using a difference key and combine it with the main matte. Spill suppression is applied only to the edge region with a strength of 30%.

Lighting Match: The plate has a key light from camera left, with a warm color temperature (3200K). The CG kitchen was lit with a similar key, but the intensity is slightly off. We adjust the CG key light's intensity and add a warm tint to the CG fill light to match the plate's ambient warmth.

Shadows: The product is held in the subject's hand. We add a soft contact shadow beneath the product using a shadow catcher in the CG scene. The shadow's opacity is set to 60% to match the plate's shadow density.

Edge Blending: The hair edges are too sharp. We use an edge blur node with a radius of 2 pixels for the hair region, and 0.5 pixels for the rest of the subject. We also add a slight defocus to the background to match the plate's depth of field at f/2.8.

Grain: The plate has moderate noise at ISO 800. We generate a grain sample from a clean area of the plate and apply it to the CG elements using a grain node with matching size and intensity.

Motion Blur: The plate has a 180-degree shutter. The CG render already had motion blur, but the product's rotation was slightly faster than the plate's motion. We adjust the CG motion blur multiplier to 1.2.

Atmosphere: The kitchen render is too crisp. We add a subtle haze layer using a fog node, with a falloff that matches the plate's slight atmospheric perspective (the background is slightly cooler and lower contrast).

Final Grade: We apply a color correction that warms the midtones and adds a slight teal tint to the shadows, matching the plate's original grade. The composite is then output as a 10-bit DPX sequence.

What Could Go Wrong

In this example, the first attempt at keying left a green halo around the subject's hair. The fix was to use a dedicated hair keying technique: instead of a single key, we used a combination of a chroma key for the body and a luminance key for the hair, then merged the mattes. This is a common workaround when the greenscreen is not perfectly lit.

5. Edge Cases and Exceptions

No checklist covers every situation, but being aware of common exceptions helps you adapt. Here are three frequent edge cases and how to handle them.

Fine Hair and Transparent Objects

Greenscreen hair is notoriously difficult because the thin strands mix with the background color. Standard keyers treat hair as semi-transparent, resulting in a matte that is either too solid (losing detail) or too transparent (showing green). The solution involves multiple passes: a core key for the solid body, a separate edge key for the hair using a different sampling area, and manual roto for the most problematic strands. Additionally, using a dedicated hair keying plugin like Composite Brush or Re:Key can improve results. For transparent objects like glass or smoke, you cannot rely on chroma key alone. Instead, use a combination of luminance key, difference key (if you have a clean plate), and manual rotoscoping.

Reflective Surfaces

Reflections on shiny objects (cars, mirrors, water) will pick up the greenscreen color, making them appear green. The standard approach is to key the reflection separately and replace the green tint with the desired reflection. However, if the reflection is of the subject itself, you may need to render the reflection in CG. For example, a car commercial often requires the CG environment to be reflected on the car's paint, which means the car must be a CG object or have its reflections replaced via projection.

Mixed Lighting Conditions

When the plate has multiple light sources with different color temperatures (e.g., warm tungsten on one side, cool daylight from a window), matching CG lighting becomes complex. The solution is to use multiple CG lights, each matching the color and direction of a real light source. Additionally, the CG shadows must respect the dominant light direction, but the fill light's color should be considered. In extreme cases, you may need to relight the plate in software like Flame or Nuke to simplify the lighting, then add CG.

When the Plate Has Lens Flares or Vignettes

Lens flares and vignettes are often considered artifacts, but they contribute to the realism of a shot. If the plate has a strong vignette (darkening at the corners), the CG elements must be vignetted similarly. You can sample the plate's vignette using a radial gradient and multiply it over the CG. Lens flares, if present, should be matched in position and color. Some compositors add a subtle lens flare to the CG to tie it to the plate's optical characteristics.

6. Limits of the Approach

Even with a thorough checklist, some composites will never be perfect. Understanding these limits helps you manage expectations and decide when to cut losses.

Resolution and Data Constraints

If the plate is low resolution or heavily compressed (e.g., from a phone or webcam), no amount of compositing can add detail that isn't there. Grain matching becomes impossible because the compression artifacts dominate. In such cases, the best approach is to keep the composite simple and avoid fine details. Use broader strokes and accept a lower level of realism.

Time and Budget

Every step in the checklist takes time. A high-end commercial might afford days of roto and color matching, but an indie short may need to compromise. The limit is not technical but practical. We recommend prioritizing steps that have the biggest visual impact: lighting match and edge blending usually give the most bang for the buck. Grain matching and atmosphere can be simplified if needed.

When the Plate is Unstable

If the original plate has excessive camera shake, rolling shutter, or focus pulsing, the composite will inherit these flaws. Stabilizing the plate before compositing can help, but it may introduce warping. In extreme cases, you may need to rebuild the plate using a 3D camera solve and reproject the footage onto geometry — a process that goes beyond standard compositing.

The Uncanny Valley of CG Characters

For character compositing, even perfect integration of lighting and color can't fix an unnatural rig or animation. The compositor can only work with what they're given. If the CG character's skin shader looks plastic, no amount of grain or motion blur will sell it. This is a reminder that compositing is the final step, not the magic bullet. Collaboration with lighting and shading departments is essential.

Final Thoughts and Next Actions

Checklists are not meant to constrain creativity; they are meant to free it by removing the guesswork. The next time you sit down to composite, start by preparing your plate and setting your color space. Then work through the steps, but stay flexible. If the shot calls for a different order, adapt. The goal is a composite that holds up under scrutiny.

Here are three specific next moves: (1) Create a personal template in your compositing software that includes nodes for grain, edge blur, and color management — this will speed up every future shot. (2) Spend 15 minutes on your next project just studying the plate before you start — note the light direction, shadow softness, and noise characteristics. (3) Share your checklist with your team and discuss which steps they find most critical. Collaboration often reveals shortcuts you hadn't considered.