Same here. Though I do the crying bit 90% of the time... I always feel it's my fault for making whoever it is dissatisfied, even when there's no reason to think that way :/ It's weird!
I don't usually confront them cause I feel like it'll make things worse.