One of these days I'm going to have time to upload pictures of me and/or my clothing. Anyway, you and I look surprisingly similar upon first impression. So, not knowing anything about your personal style, I will respond with what I would do....
I think that the contrast between the dark jeans +t-shirt and the brighter jacket is something which would make me feel off balance. I'd only wear that jacket with light to medium toned neutrals on the bottom. And I would make sure to tuck any shirt into the waistband of my bottoms. I find that the shirt looks to busy with all of the details of the jacket.
I'm actually a little jealous, because I once had a similar jacket, not sure what year but at minimum 2009 and probably before. It was lined linen and fairly expensive for me. Over $100. I think that it was from Macy's but not sure. Anyway, it shrank worse than almost anything else that I have ever bought and after the very first time when I tried drycleaning it. I was so sad, but I couldn't afford to replace it, so I completely understand where you are coming from.
Anyway it's really difficult to judge the fit from the photo so if it makes you squirm when you wear it, then this is probably not salvageable.