This is such a personal decision and so many different factors can play into it.
I'm a few months' shy of 49 myself, with naturally dark blonde hair that I've been highlighting for years. Lately I'm noticing my roots don't grow in dark. Instead, it looks like it's snowed on top of my head!
I continue to color mostly because I like how it changes the texture of my hair. In fact, when it is time to go gray (or rather, white; my grays are white), I may still opt to apply chemical processes, just for the texture & shine effect.
Meanwhile, my DH went gray at a very young age. When we first met 12 years ago, he was sometimes a brunette and sometimes a red head, depending on his whim -- and what was on sale in the drugstore. One day he decided to stop coloring it. He went to the barber and had him cut his hair super short, cutting off all the dyed parts. He did not inform me in advance that he was doing this. Well, he came home that day looking just like John Slatterly but DANG! What a shock!!! I admit it took me several weeks to adjust!
After the initial adjustment, I have to say, he should have made the switch earlier. He is hot and sexy. And his gray hair suits him very much.
There is a point in time when the signs of age on our face look incongruous with our hair color. In DH's case, he has a lot of deep wrinkles, and his gray hair is a much softer and flattering frame, than dark brown or red.
As for you, Gardenchick, you are nowhere near that yet! Your skin is beautiful and youthful. I could understand being fed up with the whole process and bother, but aesthetically speaking, I'd hang in there awhile longer. Wait until you start hitting menopause -- waning hormones change a lot fast (my skin is rapidly aging lately). You've still got awhile for that; I say maximize and enjoy while you can!