Oh gosh-- I think it completely depends on living and working situations.
I usually just think I have the home-wear figured out, and then I move again. When you live alone, it is a non-issue. Living in a small town, I get more people showing up at the door. When I lived with the ex I never had any warning when he was going to bring someone home or one of his friends would call me or show up on my doorstep. When I am at home with my family, it is about the same since I have a younger brother and he often shows up with teenage boys in tow. Roomates are equally problematic.
Right now I am still not working, so I have two sections in my closet: pyjamas, and my beat-up everywhere else clothes. Pyjamas are the clothes I don't wear outside-- but since I am outside 10+ times a day between errands, yard work, and the dogs, I'm rarely in pyjamas if it is light out.
When I am working, I have work clothes, home/weekend clothes, and pyjamas. Generally I work out straight after work, so I come home and shower, but then I have to have something else to put on. After I get home, I tend to try and get outside for awhile, and it is often when I run errands, do visiting, or eat out. So, I might go from woven button-down, dark bootcut jeans, blazer/cardigans, and boots, to workout clothes, to loose straight leg jeans, an army jacket, striped t, and converse. There are also some days I just come home and put on my nice sweats and a long-sleeve top or cargo pants and a flannel shirt.
I am currently working on replacing all the men's t-shirts and sweatshirts I have with nicer stuff for my day-to-day time outside running around and in the yard as well as leisurely hikes outdoors and time spent in the mountains, ect. What was flattering and cute in a tomboyish way when I was younger just looks frumpy now, no matter that it still fits.
Also, I'm looking for some lounge/sleep bras that actually function as bras instead of breast smooshers--- I need something to wear when in my lounge clothes when I have company.