Why are we so ashamed of our actions?

For example, why is it so considered so rude to stare?