To be fair, if it weren't a fat I would say yes out of politeness. Then I would give it to a homeless person or something lol.  If it were a fat I'd probably say "Sorry it would mess up my daily caloric intake" and so sweetly decline.