I think it's beautiful and a bit avant garde, and if the colors are good on you, I'd try it. I don't think it would be that hard to dress down either. Just wear some kind of shrug or open cardigan or jacket, and/or leggings underneath. I'd totally be tempted if it was my colors.
I think also it depends on fit, it could look interesting and flattering, or it could fall flat, but either way, you would probably know right away. If it's free shipping and free returns I might get more than one size to try.