My 2 little pledged as a SENIOR (a senior who lived with very anti-Greek roommates on top of it) and she probably got more out of her two semesters as an active, and made more lasting friends, than some of the women in our chapter who pledged as freshmen. (She also had first semester freshmen in her pledge class, by the way.) I know that's a smaller chapter and things aren't so class-conscious in a smaller chapter, but just wanted to illustrate your experience is what you make of it.
Some people jump off the high dive, some people enter the pool one toe at a time. It doesn't mean that they won't both have an enjoyable swim.
Give yourself time to get to know everyone and don't just concentrate on whether you fit with your pledge class.