LOL @ your post title.
I like bags a lot, and have a decent collection, but I don't get too carried away with them. I definitely consider my bag for the day after I've put together my outfit. I consider it a lucky coincidence if I can just use the bag from the day before, but I don't carry a lot, so it takes me only a quick moment to transfer my stuff from one bag to another.
I admit, I often find my black bag easiest to default to, as well. I wear a lot of black, so it just works. But I do find that with just a moment of thought, I can usually find another bag in my collection that ups the style factor of an outfit just a bit more.
Sometimes I will choose a bag because it pulls out some color in a print in my outfit, but sometimes the choice will be more obvious and matchy-matchy. Sometimes, particularly when I'm wearing a very simple or more conservative outfit, I'll choose a bag that has a bit more visual interest or contrasts more with my outfit, colorwise. It depends on my mood.
I consider color carefully these days. I just noticed the other day that have some bags that have been going unused, and I'm considering why that is. I think some colors trended a few years ago and have faded (apple green Coach satchel, for instance), and some just don't grab me the way I thought they would (a deep red but not quite burgundy Hobo mini tote, which is now listed on eBay). I think the color needs to *go* with the outfit without necessarily matching. If I'm wearing an outfit of mid greys, denim, and white, for example, I will often reach for my mint clutch or maybe a bright red handbag.
I love metallic bags because they go with everything but still have the ability to stand out a bit on their own. I have a metallic clutch, and a very shiny casual, slouchy, silver leather tote, but I think I'll be on the lookout for a more polished, structured metallic bag soon. I suspect I'll be selling one or two more bags soon to make room.
I would look at your outfits and consider whether you want the purse to complement or contrast with it. Do you want the bag to stand out against your outfit or blend in a bit more to reinforce the color scheme or mood of your outfit? What colors do you love to wear, and do you reach for over and over again? And what about prints? I love a printed bag but have sometimes struggled to style them because I'm not a big pattern mixer and often wear a pattern in a shirt...but lately I seem more drawn to solids in my wardrobe, so a patterned bag is now appealing to me again.
Just some thoughts and questions to get you thinking about what kind of bag collection will serve your needs. I've fallen into the trap of buying a bag because "oooh pretty" and then never using it. And this is only touching on the aesthetic part of it! Then you need to consider what size works best for you, whether you like to use clutches vs. totes vs. satchels, etc.
