It's ironic that so many people who say they'd never wear flashy logos still wear the three Adidas stripes, or the Nike swoosh, or the Polo symbol. Just because those things don't cost thousands doesn't mean they aren't logoed. And for those who know bags, a Bottega Veneta, a Balenciaga, a Miu Miu or a Burberry are just as flashy as the LV logo.
I say it depends. Whereas this may not be a logo per se, I frequently wear McQueen skull scarves, and I wear the larger skull design of Zadig and Voltaire. If a piece with a logo appeals to me, I will happily buy it and wear it (I do favor the Adidas stripes). I'd venture a guess that most people have preferred brands, and many of those brands have something recognizable about them, whether that's a logo, symbol, design, leather work, etc. For most people, to pretend otherwise is disingenuous.