Digital Extension Experiments
🕑 Added 2024-01-27 13:22:01 +0000 UTCDiving into a couple digital extensions! Basically any time I'm on set I'm my own VFX supervisor, and these are the types of compositing techniques I'm thinking about when I'm framing up the shot to hopefully avoid signing myself up for a big headache later in post :P
The one bit I gloss over is the initial 3d tracking and projection, mostly because I've already covered it quite a bit and I think I'll be covering it again really soon, but if you want to see me get into it:
Digital Extensions without Greenscreen
And a more whimsical (if older) one- Making Boring Places more Interesting.
Oh! And here's Nathan's fantastic Projector addon.
Comments
Paul Pierantozzi
so basically you are compositing in the shader graph. It would be really cool if there was a way to subtract and plus the grain overtop completely in blender using this workflow
Phil South
Oh see this is why I need to watch these videos in order. All my questions about the later video are answered in this one. Duh. Hang on while I go slip my head into a hole.
Chromfell
I'm a bit late - but as for migrating the camera projected texture to the new secondary back-up texture I would've just done a texture transfer bake in Blender from the projected texture to the new texture, once at the beginning of the shot and another time at the end, and merge those. Should work, no?
Maxim Leo Diehl
oh god these 3D comp hacks with the luma channel blew my mind
Lukas Sprehn
Money for cans! Like in Europe. And like the deposit the US used to have for bottles and cans. They ought to bring it back, it gives a great incentive to recycle!
Tardsmat
your phrasing of "hitting old blender" is so accurate lol, blender is super smooth and easy to use until you wanna do something unusual and then you uncover these strange archaic bits of it that are really unintuitive. Also, one way of dealing with the reflections could be to replace the puddles with an actual reflective material. Maybe draw a mask with texture painting or something. Could cause more problems than it solves but maybe it could also work well
Nathel Sunrider
That's actually simpler in my opinion, would it be more demanding in terms of computer resources ? Or is there no downside ?
Nathel Sunrider
Big thanks to Platyelf and LucKleuskens !! I'm working on 3.6LTS, so I fully removed the addon and the zip file, re-downloaded the 0.1.0 from github. Then I installed the addon and to be able to enable it I went to "C:\Users\*username*\AppData\Roaming\Blender Foundation\Blender\3.6\scripts\addons", and renamed the file from “camera_projector-0.1.0” to “camera_projector-0”, just as you said Platyelf ! Refreshed Blender, click "enable", then it worked and life is now more simple and beautiful ! Thanks for helping and thanks Nathan and Ian for the addon !
Luc Kleuskens
looks Like im having the same issue. in blender 3.6 its working. but not in 4.0. Edit: Seems like completely removing the addon, downloading the latest (same as 2 years ago i think :P) and installing fixed it for me.
Clément Jolivet
great stuff ! You might have seen it, but Switchlight Studio has video normal extraction now for relighting from footage, maybe this could integrate nicely to further integrate / relight live action footage in your scenes. I quickly tried with the blender addon, and it's promising as you can animate lights in 3d space directly in Blender. Cheers !
Platyelf
I managed to fix the problem by changing the file name for the addon from “camera_projector-0.2.0” to “camera_projector-0”
Ricardo Peixoto
Same problem here, unfortunately :(
Robin Squares
Awesome! If you're really worried about lining up the texture to the view, you can always bake straight from the projected texture onto a clean one. You need to do it in a few steps though, so it's not necessarily easier.
Mark
I feel like with this workflow somebody could make a mod of blender to be like an after effects alternative. If you modified the UI a lot and automated certain things.
Mark Miller
I played with this for a few hours this evening. I had the best results with just replacing the water with an in-scene plane with a musgrave bump map. Didn't spend a ton of time on it, but it uses the same multi-plane luma-keyed silhouette technique. I may have to find one with a foreground to see how that would work. https://photos.app.goo.gl/S2KmZcf4hGhAGifP8
Mark Miller
Lol. The version of your comment that came in my email notification was perfectly truncated, and I initially misunderstood. :)
Nathel Sunrider
I'm in 3.6 LTS but had the same problem in 4.0 when I tried a month ago I think... I'll retry again but I don't have a lot of expectations anymore :') Thanks for your time !
Ian Hubert
No that's it exactly- adding light TO the scene isn't toooo tricky in this case (I've got all those video textures of water reflections, hopefully they could line up a bit), but subtracting seems really tricky, even with luma keys and stuff. I'm always curious how folks do water extensions in movies! I need to experiment with it more in the next week!
Luke Evans
Keep it coming Ian! Can’t get enough !
Ian Hubert
Ooo- which version of blender are you in??
Mark Miller
Yeah. I can't think of a way to do this well without separate view layers and the compositor, which takes you out of the whole "viewport as compositor" experience, but maybe if it's just filling in those reflections, it's fine. In a tripod scene like that, you could also just bake it.
skes
You could mirror the buildings down along the y-axis, give them a material that makes them fade to transparency the further down they go. Make the water-layer slightly transparent and add some kind of blurry translucent plane between the water-layer and the building "reflections". Not sure how convincing that would look though.
Sam Schippers
let’s go Nathan actually working at blender now, that’s so sick.
Peter Mackey
Rather than painting in the texture I've used a different method where I just duplicated the projecting camera and moved it on to a frame where is covers the clipped texture. Clear all the keyframes and turn off refresh in the shader so it's just contantly projecting that one frame. Then same just add the texture from the moving projecting camera on top. If the geomtery is well lined up it should be pretty seamless and saves having to manually line up painting in the texture.
Mark Miller
This is a really fun one. The last scene at the water's edge really reminded me of old school Disney multi-plane stuff. Super-powerful "viewport as compositor" stuff. I was really hoping you were going to show some cool trick to make the building reflections in the water instead of just seeing the bright sky reflected there. Those kind of reflections seem like the hardest part of digital extensions across water.
Nathel Sunrider
Hey Ian ! Thanks a lot it's a lot of very useful informations again :o But I have a python error when enabling the camera projector addon where it tells me that at line 333 there's no module named "camera_projector-0"... I tried the two versions with no success. Thanks anyway for everything !
Tomasz Zarucki
it's super cool you post more frequently now :)
alex
Dope video //dope boy (yes,hes back)
Kieron Estrada
Nice!!!