It probably doesn't help that petite sizes are getting harder to find.

I've had luck recently at J Jill (my guess is that you're an XS-petite there), and Lord and Taylor for dressier things. And I'm still a proponent of online shopping; it's worth finding a place that makes things that fit you right. (Eddie Bauer, Blakeley or Curvy cut pants for me.)