I've carefully balanced my diet to ensure that I'm getting everything I need while remaining vegetarian. Carefully counting up nutrients and organizing my favorite meals to make sure I've got a proper balance of everything even if I shift preferences around at any given point. Far more intricate and in depth than anyone just trying to lose weight would need. And even at that level it'd be laughable to call it hard.