I also wonder how much of your physical comfort depends on what you're used to. For example, I have often read comments about how comfy a pair of leggings and a tunic is. Lots of people find this combination more comfortable than jeans. For me, though, it's the opposite. I grew up wearing jeans to school, I wore jeans all through my academic years, and I even mostly wore jeans (smart jeans, of course) as a teacher. I am far more comfortable in jeans than in anything else -- and when I say this, I mean physically, not psychologically. Well, I guess it's true that I also find them psychologically comfortable, but that's not the point I'm trying to make. With the exception of baggy sweat pants, or possibly a loose flowing skirt with no hose, jeans are the most comfortable bottoms I own. (Well, maybe not the skintight ones, but I don't wear those a lot). Leggings, on the other hand, are clingy and sweaty and basically they annoy me all day long. I finally gave up wearing them this year, when I realized that even though they should be comfy, they're not.
I see what you mean, Anna, about how you enjoy wearing more structures clothing when you're not in your scrubs. I understand that. I wear pencil skirts with hose sometimes, a combination that, while not uncomfortable, is...how do I put it? I feel like it limits my range of movement. It's restricting. But I enjoy it at times, because it makes me feel ladylike and put-together and mature.