It’s neither the Bone Roll, nor the Bone Direction as far as I know. I’ve included the .blend file =) Please don’t be alarmed by the nakedness of the character, the clothes are merely hidden xD;
I took a look at your file and think I might have figured it out. I looked at all the bones in both the upper and lower lips and noticed all of them had ‘hinge’ selected execept for the top outer right bone, a bone called ‘UpperLipSOuter.L.001’. I also went into edit mode, selected all the b-bones for the top and bottom lips and went into the ‘armature menu’ (next to the mode select box), under ‘bone roll’ there is an option ‘Clear Roll’ and selected that. It cleared the roll of all the b-bones so they all aligned with each other.