Possibly living in a culture far different than what you are used to could be a culture shock. If you have no plans in returning to a full musilum culture, it may work as it has for possibly some others.
If it is to big a thing to overcome, then the best thing to do is not join if you do not or will not feel comfortable with it!
If your concern is being dressed in cultural garb, Greek Social life does of course include males.
You and only you can make the final choice.