how about a cardigan? a vest or blazer would be too structured and take away from the volume, so a cardi worn open could be a nice solution.
depending on the blouse, you could try wearing it with a black l/s turtleneck underneath, but that might detract from the look you're after.
you could also try a pashmina - if you get warm, it could be converted to a scarf.