I do think the controlnet I'm using to keep a consistent composition is having some effect on the face shape, I'm working on finding a better method for testing this sort of thing