Stagecraft and reltime tracking for eevee

Hi everyone, hope this is the right place to post this:

I am trying to create a system where real time camera movement and rotation is getting translated into a blender scene.

If anyone is curious, please have a look at these videos to better explain what I am looking to do:


I believe that eevee is able to compete with unreal engine in this respect. Getting the 3d environment onto the led panels is not complicated. However, I am not sure how the camera movement and rotation is getting translated digitally to a 3d scene, live.

This tech is something that the company I work for is very interested in perusing.
Could anyone help guide me, or suggest a route to take in trying to get something similar?
Please let me know.

Thank you