Because they're full of excuses. Deep down they would love to be fit, even if they won't admit it. They're envious at his willpower and determination that produced results. So they have to try to knock it down a notch.