Well, I don't dye my hair and I have some gray/silver peeking and sticking out, and *hopefully* no one thinks I don't care, though I probably wouldn't know because it's not something anyone would say to my face. Maybe people here who have seen my WIWs or met me in person could chime in and share their opinion :). I certainly don't think that about others when I see them.
The decision--to dye or not to dye--seems so fraught because of all of the stuff wrapped up in aging, beauty, and gender, IMHO. It's also interesting that now, some very high percentage of women dye their hair (a big majority, though I can't recall the exact percentage), so the standard has shifted. Now the tendency is to associate graying or gray with "old." But if you think about it, if, say, half of all people had some visible gray by their 30s on up and didn't dye it, the association with "old" would no longer be so strong. Lots of adults would just have some gray hair--no big deal.
I don't dye because I want to be genuine to myself, in a way that makes sense to me. It's a personal decision. Maybe if I dyed it I could "pass" for 40, instead of my actual 45, but I really don't care about that. I like how my hair naturally aligns with my little wrinkles that are emerging. There is no mismatch or disconnect between my face, my experiences, my profession, my body, my hair, and how I dress. They all line up and point to 45 or thereabouts :)!
Just my two cents, of course.