Because they are shallow and obsessed with appearances, they assume everyone else is. It's like the liar who thinks everyone lies all the time, or the cheater who is convinced everyone is constantly trying to cheat it.