As far as I know, theres no such constraint, a vector displacement is just a direction and a magnitude from a reference point on a flat plane. If you use project from view on a part of the mesh, pin the UV edges and do a unwrap, you get the flat part of the equation, then just subtract it from the original coordinates and bake into a texture.
Blenderβs unwrap algorithm is actually very good at handling bad topology.