Nobody can force you to do anything contrary to your own taste.

Thus whenever you acquiesce to make others ‘happy’, you only got yourself and lack of self confidence and willpower (and the will to be an ‘asshole’) to blame.