5
$\begingroup$

So, the Piano Guys made a pretty cool video a while ago where they had green screen footage chroma keyed and then inserted into 3D space as some sort of plane like object. The process can be seen in this video :https://youtu.be/mJiEXKF6WTI

I understand how to do lightsaber composition (by superimposing a shadeless cylinder on top of footage and then blurring and coloring it, however if there is a more efficient way, I would like to know.), and I understand the basic process of chroma keying, but once these steps are completed, I am somewhat confused about how to place these video in a 3D setup like he does in the video (having this way as opposed to simply overlaying the footage on top of the renders allows for paralax and such). I would like to do this with preferably as few steps as possible.

I have an idea on how I might do this, but I would like input from the community so I don't waste as much time. I'm thinking maybe to key out the green screen, export png sequences with transparency for every piece of footage, and then importing images as planes into a 3D scene, however this would not be very effective if I had lots of clips and I had to do the same thing for each one. Preferably, I would like to see the footage in the scene in real time (although the scene doesn't have to look rendered) while animating the camera and such.

Thanks a bunch!

|improve this question
$\endgroup$
  • $\begingroup$ Read: blender.stackexchange.com/questions/6942/… . Do note that there is no way to do chroma key directly as texture on a plane though. So your solution of pre-processing the images to create plates with alpha channel transparency might be the most accurate one (though it does add a lot of work to the process and there is no form to tweak the key). $\endgroup$ – user1853 Oct 9 '15 at 5:24
  • $\begingroup$ On a side note, there is also a plugin to create a camera image plane that you might find useful for what you are after. Read: blender.stackexchange.com/a/13694/1853. Blender is a powerful tool, and its free, but there are better tools out there for that kind of job, like Fusion (and its fee too) , Nuke or AfterFX. $\endgroup$ – user1853 Oct 9 '15 at 5:29
  • $\begingroup$ @cegaton Thanks for the comments. Did you mean to say that fusion is free or has a fee :)? I've looked into it before, and unfortunately, they don't make a version for Linux... Those links will be helpful. Thank you. $\endgroup$ – Anson Savage Oct 9 '15 at 14:07
  • $\begingroup$ @cegaton Ooh, I have Natron. Will that do the trick? $\endgroup$ – Anson Savage Oct 9 '15 at 16:43
  • $\begingroup$ As far as I know Natron doesn't have a 3d environment yet. $\endgroup$ – user1853 Oct 9 '15 at 16:49
3
$\begingroup$

Probably the best way, is to key out the green, and then import the image sequence into the 3D view.

Start by taking the image sequence into Blender, or your compositor of choice, and key out the green to your taste. Try to keep in mind the environment it's going to end up in and make sure that the key will reflect that. Then render out the frames as a PNG sequence, or any other image file format that Blender accepts that uses transparency.

In Blender, use the import image as planes addon (included by default) to import the image sequence into the 3D view. Make sure that alpha is enabled, and shadeless is checked in the settings before importing.

(You want to have shadeless checked, because if it interacts with light, it will be treated as a flat object, so any shadows that are there will be completely flat.)

Then place the plane where you want it to be, and use the color tools to make it fit into the environment properly. Or use some render layers magic to render it out separate from everything else to allow you to composite it back in properly either useing Blender or an external compositor.

|improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.