Layer brush - set persistent height stops working when switching to another object

So I want to sculpt on a plane and set persistent height as a base. But it stops working after switching to another object. Also stops working when switching res in mutlires mode.

Shown here - https://monosnap.com/file/nqIcUs7g0ODRaN71ouZSUEaiuqLq8i

Is there any way to set persistent height like with a height from 3d cursor?

update: it stops working after switching to a different layout too.