I haven't read through all the replies yet but here is my two cents. I think the proportions are off- it seems to cut you in half and that is even more emphasized by the sweater that is about the same length.
If you still want to try to make it work I would play with different lengths. I find for me even an half inch in length can make a big difference. You probably know this but to start you can measure from your shoulder to the floor (typical shoes included) and divide this in thirds or fifths. Ratios of 1:2 or 3:5 tend to be the most flattering on a lot of people.