That's what they make driving loafers for!!! Google it... I'm not making this up.
I have a pair of black patent leather driving loafers, and the idea is that you are supposed to wear them for your driving commute, then swap into your pumps when you arrive to work, so your pumps remain scuff-free. A true driving loafer doesn't have any support and tends to have a very thin sole because you aren't supposed to walk much in them. Jcrew usually offers a version.
I have been known wear my driving loafers for more than just driving, because they are cute and highly comfy. I bought them originally not having a clue that's what they were supposed to be for.... my VFGF (very fashionable girlfriend) had to explain to me all this.... basically, they are like "car slippers."