This is actually the super awesome thing about not gorging on sweets.  I used to eat a lot of candy back in college, but decided I should cut back.  I stopped eating candy, drinking sodas, eating deserts, etc.  After a while I didn't crave them anymore after a meal (breaking dat conditioning) and when I did eventually have a soda or a chocolate bar, it tasted sweeter than I remembered, in a not-so-appetizing way.  Not a problem avoiding sugary junk when you don't really like it that much anymore.