I have the same sometimes, but I noticed that my weight fluctuates during the day by around 3 lb. I drink a lot of water, regardless exercising or not (~4l a day and I'm quite small). It's a bit weird, there are indeed some factors that make your weight fluctuate, even if you eat your normal amount of calories.