I just wanted to chime in to say that I have been on a journey of figuring out "my colors" for a while now, and for me, it's been freeing rather than restrictive. I used to have a closet full of black. Literally - nothing but black. Today I'm wearing a light pinky peach. Unheard of!
I am actually considered neutral - I am warm, but not very warm. I need softness with my warmth (no mustard yellow or bright orange) and I can't go too dark or the color overwhelms me. For me, having a prescribed palette makes it incredibly easy to get dressed. If I follow my palette, I can literally reach into my closet and pull things out and know that everything will "go" together because they all fall within the same range of warmth and saturation. (I think of it as my color version of Garanimals!) For someone like me, who doesn't have a natural eye for color, these boundaries/guidelines really help.
Also, I do believe that there's a version of blue, or red, or pink, or whatever color you're looking for that works for everyone. Some blue has a lot of black in it - too dark for me. Some blue has a lot of red in it - too cool for me. Some blue has a lot of green in it - this makes it warmer and that's better for me. I would have a hard time finding these differences on my own, which is why I rely on a "system," but you certainly can do it on your own.