I've had periods throughout my life where my wardrobe was markedly bifurcated, but it never really seemed to be that much of an issue, until the rise of fast fashion, inexpensive clothing, and my discovery of secondhand stores.
What I've generally found over the past dozen years is that, when things are bifurcated, I would vastly prefer one side of my wardrobe over the other.
One thing that helped with the frustration, was to keep the less-enjoyed work wardrobe compact and manageable. For example, when I had to wear scrubs
(which I detested), I limited it to two sets - and I would bring something I liked, to change into before leaving the office for the day. It allowed me to shake off the stress and unpleasantness of my job, and feel like I had a fresh and happy start, even battling traffic on the drive home. And if the weather was cold, we were allowed to layer long-sleeve neutral tees underneath the scrubs, so I chose neutral shirts that I really liked and would happily wear for the fun half of my life as well.
Post-pandemic, the bulk of my wardrobe flows interchangeably between casual, and dressy. I swap out bags, shoes, accessories, and outwear as needed, depending on how relaxed or how fancy I want to be.
I have some specific activity capsules - yoga, gardening/hiking, post-pool/beach, and very cold weather. I try to keep these capsules pretty lean and streamlined.