I was going to say camel too. I get really confused with browns, ugh. I just am starting to get a handle on what taupe is, at least I think!
I read on a blog...can't remember which one, but it was one of those French wardrobe deals...that you can just pick your two neutrals, as you have done, but then you just add as much white or cream as needed. So the white/cream doesn't really count as a neutral but rather is just considered to be part of what is needed to make the wardrobe work. I think it might have been the Vivienne Files blog, come to think of it. I think the instructions for a color palette were two neutrals plus white/cream, plus two accent colors.
I like your neutral picks! Navy and camel is one of my favorite combos.