I have to think there's a big difference between "can't" (which just gets me revved up, anyway!) versus "what has some merit in the art of outfit creation".
Meaning, it is really cool to have the red jacket and some tiny echo of red somewhere--lipstick is the obvious, if one wears red well anyway, or some clever bit somewhere, tip of a belt, or earrings, or whatnot. Sometimes there is something like that going on in an outfit and it's almost subliminal--it's there and it provides cohesion, but it's very subtle, but was intentional by the wearer. But that's only if it makes sense, which it would not, in some outfits, or maybe I just don't have that item, so what, I'm going to stay home?! Lots of times, the "perfect clutch" would be a certain color or metallic but guess what, nothing I had in that vein looked good, but I had black, so black it was.
To me there's a lot more to fuss over if the proportions of items don't mix well, or the cut or fit is off. And sometimes the color itself isn't right, not because it's by itself, but because it distracts from the other pieces, or is the wrong intensity or clarity or even fabric or something. Like a red jacket doesn't look right but bright pink does. That sort of thing.