MOST of the time when someone in game calls you dumb, you aren't, especially when it comes to gear. I don't want to go on about having fun, game time, availability to attend events, etc. It's been done before.
But, the way I think about it is that you can really think about level 80 like level 50... sorta. Are you going to go out and mix and match the most awesome level 50 set? Well, maybe, but just a decent set is cool too.
Still, that doesn't mean the full set is better. And it really doesn't have anything to do with you being smart. (I didn't bother with what you DO wear, because it doesn't even really matter.)