I think it's a fun outfit! And guys say whatever.
I do have a tendency to make outfits with parts I love, but end up with a different look than what wanted.
For example, I like tailored trousers, tailored blazers, relatively plain tops (wool sweater, for example), comfortable ("tailored") shoes which might mean oxfords or might be a plain-ish boot or bootie.
When I put all those together, though, the result is sometimes too ?? masculine, frumpy, or plain or something. It's like I need one of the elements to be dressier or more lady-like but without getting fussy. Because then the opposite,if I combine the soft blouse, dressy skirt, more feminine footwear and boom, it's not really the look I need for work.
Not taking DH's comment to heart, because you are no way looking like a lumberjack, but if you think the outfit looks more utilitarian than you intended, I think I for sure would have that issue if I did the tailored plaid shirt, tailored blazer, jeans and belt, boots. So if you want to play with the parts more, and the plaid shirt is your starting point, you could consider some kind of greater juxtaposition of a dressier jacket, or jeans, or footwear. Not so dressy that it would be out of place in smart casual, but just less expected with the shirt.
Anyway, that's an exercise that I've been doing because I've found that juxtaposing opposite types of wardrobe items makes a difference for me, and so it not only is affecting how I try to combine things, but also what I think I need to purchase to balance other items.