I have only had someone wait for my space maybe four times in my life, I just ignore them and go at my normal pace... except for that one time I had someone honk.  Whoa, looks like I'm not in a hurry at all anymore!  Might as well check facebook before I pull out!