I've wondered if it had something to do with the fact that his first wife died fairly young. Like, maybe watching her waste away has made him somehow correlate fat with health? Or maybe he doesn't like the idea of being with a woman who is as or more attractive than he is. Maybe he likes having a horrible pig at his side because he doesn't want her to overshadow him and wants her to be really constantly grateful.