I thought it seemed more related to outside temperature. I've noticed it myself. It seems to be worse when the temperature outside warms up - the mirror changes position a little bit.
Might be just he opening and closing of the doors, but it doesn't happen all the time - you'd think if it was opening and closing the door it'd happen all the time.