I think it's because "places that shouldn't have fat" deform the body more than say a slight bulging stomach does on a small fat.  On a small fat they might even be able to hide it with clothes. Also, the fat hands and fat feet etc. make them look more like oversize babies which is weird.