Is it ok to mix gold hardware on a bag/tote with silver jewelry or should you keep it all the same?

For example I am interested in buying the bag Angie blogged about yesterday and it has gold hardware. I do not wear gold very often at all.

Does mixing it up keep things interesting or is it confusing to the eye making it seem like you have too much going on?

Thanks!