We were there several years ago. I thought the downtown was really nice and vibrant. It was attractive and there were lots of restaurants and shops. I live in a similar town in terms of general size, climate, elevation, river running through downtown, and having a college, and thought Boise was nicer, but our location (nearer to SF) was better.
I would go if I were you. It might be quite chilly though, especially compared to what you're used to.