I don't think about clothing much, but you're right.  It's the difference between and hour glass and a sphere.  Clothing that is designed to be loose or fall down is pushed outward at the center.  If so many people weren't fat, I think clothing designers wouldn't bother with them.