Part of it is the "recommended diet" nutritional information.  When they came up with a 2k calories per day diet for the average man, the average man worked in a physical labor job and also did physical activity outside of work.  Now, the overwhelming majority of people don't have a job that requires much physical labor and people just sit on their ass outside of work.