If you met the person while you were fit, you owe it to them just as much to yourself to stay fit. They fell in love with a healthy you, not a buttergolem. Seems totally reasonable to me! You and your SO have a long, shitlordy relationship together: as it should be.