It bears repetition: our familiarity provides a depth of understanding that allows us to despise something/someone in nuanced detail, while our ignorance only allows an abstract vague revulsion.
The more you understand, the more alike you are.
The more alike you are, the more your contempt for them acts as a mirror, reflecting your self-contempt.