When it's a stick control, I think I'm 'locating" the control behind the protagonist's head, and their head is the pivot. So when I swing the stick left, their gaze aims to the right.

I've found a few games that offer X-axis inversion and it makes life much easier on me. Portal did on the Xbox, but Portal 2 didn't, so man, I was completely fouled up there.