That's really not the problem.  The problem is that we expect housing to be fungible, to be bought, sold, and mortgaged.  A man's poor handiwork can kill another man's children.  If people were rooted to the land, a man's mistakes would kill his own children or grandchildren.