Hi Nemosmom, I personally would wear a sock with them, but I think a number of people would not. I recently wore my tan/gold loafers on Christmas Eve to go grocery shopping and wander the mall briefly, without socks, and they gave me a blister. Lesson learnt. ( I generally wear with socks but had on cropped jeans and socks looked odd. Suffered for my looks! )
I would tend to keep the bigger size, and deal with heel slippage with insoles or socks, because the smaller size sounds too tight. But the other option is that neither really fits