Camera projection of multiple cameras on to one object

Artistic Support Materials and Textures
1

I have a shot that I have “tracked” in Reality Capture and when I export the camera and mesh I have my scene in Blender. So far, so good. I have 70 cameras, each represents a frame of the shot and has a corresponding image. I also have the high poly mesh, which I don’t really need. I want to use a low poly mesh, like a cube (the shot is a hallway), to project the textures back on to.

Is there a way that I can set up a low res mesh to use each camera and image to project at it’s corresponding frame? That way, the scene has the best possible texture at that exact frame.

The reason for doing this is to add in a new camera so I can animate it closely along the original cameras path, but only smoother. There is too much parallax in the shot for AE’s Warp Stabiliser to make any sense of it, so I thought that this might work somehow to get a nice smooth camera move out of it.

I’ve been trying to mess with this technique, https://www.youtube.com/watch?v=p9IfDeNU8K0, and this one, https://www.youtube.com/watch?v=yq0XjvBlsiU, but I’m still missing that final way to reproject. Something like Nuke’s Geobuilder method would work a charm here I guess.

Any ideas are most welcome.

2

Is there a way to combine all of the projection cameras into one camera and have them create a camera animation path? As in, each projection camera represents a key frame for an animated projection cam. Any ideas on how to combine them apart from manually copying all the settings from each camera one at a time?

3

For your first challenge, it looks like you have some good leads (projecting the various UV maps), or you could also create various textures and form Texture Paint mode, project from camera via “Apply Camera Image”, though this is tedious and I’d recommend scripting something out.

On that note, this projection painting tool is looking very promising:

For creating an animated camera path between the various cameras from a photogrammetry scan, I use the “Blender-Addon-Photogrammetry-Importer” to bring all my cameras into Blender, and it includes an animated camera.