For a start, the dress is FAB!! Really, really, great! I love the jacket, too, but feel you have a problem of clashing textures, rather than just colours. The dress seems too lightweight a fabric to sit happily with the tweed jacket. Added to which, you are wearing open-toed shoes, which automatically suggest Summer. To me open toes, mean any kind of hose is a definite 'No-No' (but perhaps that's just a French rule???).
I think JR's right that warm rust or any of the Autumn-leaf colours would look spectacular with the dress. Perhaps a long sleeved fine tee and some silky opaque tights in a rust, paired with a scarf in a similar hue? Even a chunky pendant or bangle (faux amber?), to pull the look together.
Oddly enough, these are the very colours, I'd pick to bring out that fine stripe you say is in the jacket, so they could be a great foil for that too. That way, you'd get double mileage from those few accessories. The jacket has a slightly 'hacking-jacket look' and I think it would look great with any black, cream/light beige, or burnt orange/rust/autumn-leaf coloured pants. Jeans too, as long as they were darkish ones. I'd also choose brogues, moccasins, or best of all, tall leather riding boots to pair with that great jacket, and make it feel like a completely new garment. I love an equestrian look (which is the vibe the jacket gives me), and your photos suggest you'd wear it well too.
You could turn these two basic garments into two spectacular Autumn outfits, I feel, rather than one slightly 'not quite right' one. Good luck, I know you'll pull it off in the end!