I totally understand where you're coming from ALeigh! I've recently lost a lot of baby weight (15 lbs in 2014 and another 15 lbs in 2015), and just moved across the country, too. My wardrobe has for the first time in my life become a source of frustration, which is how I ended up here at YLF!
I don't have any super useful advice. Personally, I've found it easier to go slowly, rather than get rid of everything at once and start from scratch -- I just don't have the energy or money for that and I suspect I'd choose things I'd regret later.
I purged a moderate amount prior to my move (though it was company sponsored, so I didn't feel too bad about keeping stuff, either). Now that I'm in a place I plan to stay awhile, and at a weight I'm comfortable with, I feel freer to shop for things I really love, but still taking it slow -- PPP, as Angie says. When purging, I think PPP can be a good thing too. It's really important to go item by item and reflect on how much work each garment does for you, and what you like/dislike about it. It can be hard to embrace the notion of placeholders, but I've found them quite necessary.
It sounds like you might need to identify specific wardrobe holes -- like Rabbit mentioned, one pair of great-fitting jeans can do so much -- and focus on those. Also, evaluate what items you have that can be tricked into fitting -- e.g. belting a shirt that's too voluminous, or experimenting with layers.