How do I best capture the lighting in a video shot so I can easily insert rendered objects into the scene that are correctly lit?


While there are many subtleties and nuances to your question, the following should deliver reasonable results with equipment you may very well have around you or possibly borrow.

  1. Use a DSLR and use your widest lens. The Sigma 8mm fisheye and a full 35mm sensor allows one to capture edge to edge sphere shots, for example.
  2. Do a bracketed exposure series of your set in enough directions to cover the scene. For example, with the 8mm above, it is three directions. If you require four photos to deliver your 360 degree view, you would require a set for each exposure. Depending on your scene's dynamic range, pan to your first position and take photos at exposure, several stops down, and several stops up. -3, -1.5, 0, +1.5, +3 stops might be required, or fewer. Shoot raw to preserve as great a range as possible for each image.
  3. Merge each bracketed exposure set together into a spherical merged image. An example might be Hugin or other such tool.
  4. Merge the stacks of exposures into a single HDR scene referred EXR image from the layers of stitches. An example might be Luminance HDR or other such tool.

A single exposure will fail to deliver upon the "correctly lit" aspect of your question.

It is important to understand the difference between a scene referred and a display referred image here. Where a typical JPEG or such image is a low dynamic range and being bent to fit the 0..1 range, a scene referred image attempts to maintain the original scene's ratios of light levels being cast from objects. This is stored in a linear fashion and the values can range from zero to a theoretical infinity.

When a series of bracketed photos are merged into a scene referred file format such as EXR, the original values of the scene are reconstructed. These values will much wider apart than the 2.5 stops of light a typical JPG or PNG can represent1.

Granted that the above will only deliver an accurate estimation of the lighting at the given point you photographed your HDRI images. If you seek more accuracy such as a CG element nears a wall or other object, you would need to attempt to project the light values upon a placebo object to correctly estimate the inverse square law of energy (1/d^2). Project from view with some tracking might be useful here.

For further reading:

1: A middle grey card photographed and converted to a JPEG will land at approximately 48.45% value in sRGB. This translates to a value of 0.2 when linearized to display linear. If we double this, we arrive at 0.4 for one stop. Doubled again to 0.8 for two stops. 1.0 therefore can't express any greater dynamic range than a little over two and a tenth stops of light. Further complicating this is the fact that a standard camera will hold a wider dynamic range and curve this into the resulting JPEG or display referred format. This ends up baking both the sRGB curve and the camera curve into the resulting image, and it cannot be reasonably undone from these formats.

  • $\begingroup$ So what's your take on mirror balls? $\endgroup$
    – Maccesch
    Oct 14 '13 at 15:49
  • $\begingroup$ Mirror balls are lower resolution and subject to drifting and shifting. Remember, if you want to get to scene referred linear values, you will need to stack at least a couple of exposures. A mirror ball can make this challenging for your software, as well as wasting a good chunk of the captured image that isn't the spherical ball. Mirror balls are typically used with grey balls for lighting references, not for HDRI construction. $\endgroup$
    – troy_s
    Feb 10 '14 at 19:18

The easiest thing to do to get similar lighting in your scene is to use an HDRI environment map (tutorial on how to get it: http://www.otake.com.mx/Apuntes/Imagen/EnviromentMaps/). Basically, you take a picture pointing in every direction and stitch it together later in GIMP or Photoshop.

Once your map is set up (and you want more intense lighting) throw in a few light sources where the sources are in the HDRI map.

You can also use the Mirror Ball approach (a mirror ball is a glossy ball which reflects the scene arount it).

To make a mirror ball map, take the frame with the mirror ball into photoshop or GIMP and crop it as closely to the edges as you can. Then, load the mirror ball into Blender. Add it as an environment map and choose mirror ball from the "type" dropdown. After that, you simply render.

  • 1
    $\begingroup$ In a making-of of a hollywood production I saw that they held something like a big christmas ball into the camera before shooting. Do you know something about that? $\endgroup$
    – Maccesch
    May 28 '13 at 15:48
  • 1
    $\begingroup$ @Maccesch, yeah, there called mirror balls. It's a quick way to get a (most) of an environment map. It's usually enough to adjust the lighting. (Blender also supports mirror balls, so it's super easy to use them. $\endgroup$
    – CharlesL
    May 28 '13 at 16:01
  • $\begingroup$ could you add a how-to of this to your answer please? $\endgroup$
    – Maccesch
    May 28 '13 at 21:35

There are two steps to setting up this kind of lighting system.

The first step is to find a good HDRI environment map. It doesn't need to match your scene exactly, just so long as it gets a good approximation of the overall scene. I recommend that you look for good HDRIs from here or here, or just Google search for 'HDRI environment maps.' To use one of these images, add an image texture to the world environment (world panel of Properties bar) and load in your image.

Once you've done that, you need to place in the same lighting sources as in the original video. There are a couple of rules of thumb for figuring out where the lighting sources are. First, look at people's feet (or any other vertical object). You should find a shadow cast for every major light source in the scene. Or, if there are any reflective surfaces, like glass or metal, you might be able to see reflections of the light sources that you want. Once you've identified the light sources in the video, it's just a matter of duplicating them, then tweaking positions and emission intensities of the light sources until you have the effect you want.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.