OES fans should wear their own clothes
Basically, when it comes to emblems of fraternities, sororities, fraternal orders, or other membership based organizations, you wouldn't want to wear a symbol just because you support what it is. It would make people think you are a member when you are not.
If you're a fan, just tell a member that you're a fan and hopefully they will accept the compliment graciously.