it’s talking about the file that used to be called B.blend but as of this week, it’s called startup.blend. This file is a regular blender file that is your startup file and is where your user settings are kept.
When you get the message that blender can’t delete the file, does the change to your user preferences get saved?