Obviously jackets layer great over button downs--- however, sometimes you need a softer or cozier/more casual layer. Jackets can also be hard to fit for me and often need alternations, so they can be few and far between and cost prohibitive (I love them, I just don't have a high number and sometimes feel the need for variety).

I find sweaters (pullovers and cardis) can be difficult to layer over button-downs between fit and texture. I also sometimes don't care for the look as I mentally associate it with a "preppy" look--- which I am decidedly not.

What/how do you layer over button downs or other wovens?