I was wondering if heather grey would be better paired with black or brown, or does it matter?

I was thinking of wearing my navy blue ruffle neck shirt with the heather grey sweater on top. Usually I just automatically pair grey with black, but I really want to wear my new brown booties tomorrow. Does grey compliment brown?