Matchy-matchy tendencies to the extreme, here, but at some point I dialed it back to matching hat and scarf in accent color, and matching gloves to coat. Gloves then stay with the coat; hat and scarf together on their designated wall hooks.
That was for conservative work-wear, though. For casual wear, hat and scarf roughly coordinate, and get worn until one needs cleaning or function requires a change-up. Sometimes I wear merino wristlets or armwarmers that stay on after I've removed jacket; then the question is whether to keep matching scarf on as well.
For outdoor practical tasks, I just need to be sure I can always immediately find the right pieces. So I'd be more concerned with the functional aspects of the jumble than with the esthetics. If it's 4 A.M., a storm is coming, and siding just blew off a feed shed, does it matter if work-gloves match parka, or whether hat color clashes, as long as one's head is warm?