It's because they're talking about it in a context where they turn down a fat guy. They're not thinking this applies to them, cause more often than not it is women turning down male advances, not the other way around.