Help with distorted lens + grease pencil

Hello, how are you doing? Hope you’re good ^^ I’m here asking for some insight or help.

Long story short, I’m making tests for an animation I’m makingm and I want to try out this idea of a 2D-like background which distorts and sort of “melts” around to make something surreal. My idea is to make something akin to a lens distortion and be trippy, so I want to try out using a camera set to Panoramic> Equirectangular , and move it around as the grease pencil contours every shape to make it look like 2D

I essentially want to make something like this:

//youtube.com/watch?v=Vo5tcNxF8AE//

so here’s my setup for the grease pencil set to scene, so far so good (1) Only thing is, as soon as I either bake the grease pencil or change the camera to panoramic, it goes all wonky and now it doesn’t match the scene anymore. (2,3 & 4)

Is it possible to keep the lineart intact while following the distorted lens effect? If not, what could I try to do to achieve this look?

Thanks in advance!

You might need to convert your GP setup into curves or meshes for correct rendering.