Maps not pointing in the right direction

I have issues with google maps on my Nexus 5 running Android 5.0.1

The position dot (my location) has a spiky side indicating my orientation. However it doesn't point the right way.

Let's say I am pointing north and I hold my phone un portrait mode, then the orientation info will point east (to my right), which would be the right answer if I was in landscape mode. Now if, while still pointing north, I hold my phone in landscape mode, then the orientation info will point west (to my right), which would be the right answer if I was in portrait mode.

As any one ever had the same issue ? Is there a know fix ?