In our daily life, how many of us have someone (besides immediate family) who will come up to us and say "those shoes REALLY don't go with those pants" or "you know...your body type isn't made for flowy tops". I think not very many of us. Most of those thoughts are self imposed.
The fact of the matter is, we (people in general) are all so into ourselves that I doubt we can recall what anyone wore yesterday besides us. Someone told me once that if anyone has the guts to tell you to your face what they really think about your outfit, then you have the right to tell them to their face what you think about them in return :).