I don't have any recommendation for you, but you just made me feel better. I thought I had finally found a nice, flattering pair of black dress pants after two years of looking on and off ~ I bought AT's signature gabardine pants (I think it was those; wool with a lining). I put them on two nights ago thinking of wearing them to a concert with a friend, and showed them to hubby and kids. DH said they looked just OK, and were like a waiter's uniform, while DD piped up, "Your jeans look better on you, Mommy." DH elaborated a bit later, saying that they were not particularly flattering and that my old black pants (now dated, not to mention worn out) were much nicer on me. So I returned the AT pants the next day (hadn't taken tags off). Short story long, I'm feeling better about returning them, as I'm guessing they would have started to bag out on me too, from what you're describing.
Anyway, commiserating with you on the search for decent pants that fit well and stay fitting well.