Occasionally, I'll put on an outfit and feel kind of meh about it, only to have my husband compliment it, which makes me feel better and see the outfit with fresh eyes. But ultimately, I'm the one wearing it, so if it's a matter of comfort or fussiness, chances are the item will eventually leave my closet, even if hubs likes how it looks.
One time he was with me shopping and raved when I tried on a very cute dress in Karen Millen, but it was a size too small (the next size wasn't available) and it had a skirt silhouette I was not very comfortable with (it sort of flared at the hip and came back in in a tulip fashion, and to my eye, emphasized my hips too much), so I doubt that I would have bought it even if the fit had been right. So I'd say his opinion makes me take a second look, but the ultimate evaluation is always mine because there's usually some "good" reason I'm saying no.
On the flip side, when he doesn't like something, he's usually really good at articulating why, and I can often see his point once he's made it. I rarely keep something he doesn't like, because he usually pinpoints how it doesn't work for my style. The exception is when it's something that requires a little styling and I show it to him unstyled -- he needs to see a lot of things in the context of an outfit to appreciate them.
Let's see the sweater when you get a chance! It sounds lovely.