I get that all the time. At 6'1", 180, I am not skinny. I am quite human.  My coworkers ask how I stay so thin. I say,  "I eat less to get smaller and more to get bigger." Explaining it like they're 5 makes it easier,  I think.