You know, I think in your case, it just might be bone structure :p I'm 5'8", 180 lbs, and I fit very comfortably into size 34, and can probably squeeze into size 32, though I like the way the 34s hang off my hips.