Unfortunately, I think along the way in our vast and varied history, GLOs were very "elitist." The social attitudes of of colleges, and even the country as a whole, 50-100 years ago are very different than they are now, mostly, I believe, due to "unenlightenment." Once you're given that tag, no matter how long ago, it's very difficult to get rid of.
Though, today, most non-Greek arguments of GLOs being "elitist" come mostly from misconstrued preconceptions or a lack of understanding (and unwillingness to learn). I believe that natural human instinct is to fear or belittle that which we do not understand. It makes it less scary to us. And it's not easy to take that first step in bridging the gap to that of which we do not understand. It doesn't mean we (general we) shouldn't try.
Eh, but that's just me.