Truthfully, I think its all in fun. If you like it you do, if you dont you dont.
I was on a swim team so guys in speedos dont bother me (and some looked really good in them, im sorry im all about the athletic type)