I understand both camps here. Personally, I reserve gear for exercise and athletic pursuits. Maybe it's habit? However, there is something about wearing the same type of clothes I do a heavy workout in for the rest of my day that doesn't appeal. I sometimes do grab my Yoga pants and a gear top on the weekend to wear around the house because they are easy and convenient. My neighbors have seen me, but I wouldn't wear it out to work, the grocery store, or to a school function.
My gear is fitted/bodycon by design. The athletic pursuits I enjoy, like Pilates use equipment, and involve inversion and twisting in ways that loose clothing could get snagged or caught in something, or expose something I don't want exposed. Gear is designed with an active pursuit in mind. In my world, you purchase the gear that works and is practical for what you plan to use it for, not for its appearance.
My neighbors are very prone to wearing gear because it's their business. One teaches fitness, and the other sells gear! :-). LOL, they definitely have the best gear wardrobes I've ever seen!
I have no problem with people who are neat and thoughtful about their gear selections. As others have mentioned there are so many nicely designed options. The gear I am least fond of is baggy sports team logo sweats worn dropped down too low with panties showing. It still happens here.
Oh, and in a hotel, if you are worried about wearing your gear to the exercise room, which in most hotels is in fact the proper etiquette unless you are staying at the most expensive of hotels, then you can purchase a lightweight cover-up to wear over your workout outfit, just like you might wear a cover-up over your swim suit to go to the pool. They sell them everywhere they sell gear. A track jacket will work in a pinch.