The answer to your question is...yes.
Some people have a great time at sororities at a big school with a big Greek system, but would have been MISERABLE at a smaller school with a smaller Greek system. Or vice versa. (And no, the solution is not to transfer...the solution is just to realize that your school isn't 100% perfect because the Greek life there isn't for you, and get involved in other activities.)
Some people can't deal with the rules and expectations that are there in even the most laid back of chapters.
Some people have difficulty with time management, to the point that their sorority membership is a drain on their college career.
Some people just don't want to be around that many girls, that much of the time.
I don't know if any of these apply to you, but if venting out fear here helps you get through rush, go ahead and continue to do so.
Threaded Mode
