How to add separate top and bottom reference images

Want to model a sculp. I like to use separate reference images for top n bottom. I set 4 viewports for orthographic views of front, right, top n bottom. I cannot make Top n bottom viewports use different reference images. even after trying to create separate empty objects for them. Would appreciate some help please

Have a look at these settings:
image