I've had "invisible" injuries that have made it pretty much impossible to use stairs, walk fast, or even walk at all.  If someone isn't overweight and I see them using the escalator, elevator, walking slow, or using a scooter/wheelchair I don't judge them because I know it's likely there is a legitimate reason behind it.  Unfortunately, there are a lot of people who don't realize this.