Hey, it happens a lot actually. Top houses on some campuses, have not so great reputations at other colleges (losers, nerds, etc). There are a few chapters that your chapter probably does get a long with, and it won't be a problem. Fact is, if what you say is true, and your house is top house on your campus, why would you wanna be anywhere else? Your next 4 years will be spent at your college., and you don't want to be part of the 'loser' house for your next 4 years, do you? Stick it out, it'll be worth it, you'll have fun for the next four years, and then on the bright side, when you graduate, those who matter (employers) may especially think you are a good quality man, because of your national reputation.
