I think it has more to do with the kind of people involved.  I've known successful cross-fitters.  I'm not really into it myself, but I'm not going to talk down about it.  Any active hobby is going to work for you if you put in the work and maintain a normal (human) diet.  Anything fats think they can shove themselves into will look worse while they are involved.