I had a white anorak and did not enjoy the need for frequent washing. I live in Canada so typically a puffer gets worn hard, almost daily, for 2-3 months and I don't want to plan around washing it. I am pretty messy (RATE) in general and don't really enjoy high maintenance clothing (hate ironing, dry cleaning, etc and have learned to buy accordingly), so, YMMV.
I think there's a certain amount of going with your gut - does white feel like it work for your lifestyle? It works for me better in the summer because I expect to wash those clothes with every wear due to sweat and city grime. But it turns out I dirty quickly and have no interest in frequently washing fall/winter outerwear.