Victoria's Secret leggings, sweats, and yoga pants all come in Long and XLong lengths (edited to clarify).  I'm 5'7" and have the same problem.  I know not a lot of people like wearing leggings/yoga pants, but their XS Long pants are the only bottoms I can wear that go down to my ankles and don't have a saggy ass/crotch area.