Maybe the fact that something so self-destructive as excessive drugs/alchol/cigs/junk food can be seen makes it even worse, as it signals to the world that the person knows they cannot hide their failures, and even then cannot push themselves to find a solution. You definitely have a point though. We're probably more vain and appearance-oriented than most people and project our thoughts onto others, thus overestimating the above effect.