Tried a number of different ways to do this. In the end I “brute forced” it with modelling and shape keys.
