I never had this problem within my chapter. Of course, that might have something to do with the fact that (at least back when I was an active) the majority of brothers in my chapter were female.
It was just people not in the chapter that couldn't accept that a female could be a brother.