When I joined my chapter there was 4 actives on campus. My friend and I joined at formal rec. and started to really like it. (My pledge class tripled the size of our chapter.) The next fall we had another friend join and then the next semester another friend joined. I think if you get one or two friends that do have a big group of friends outside of the Greek system there is a bigger possibility of getting more members.
