my brother had this same problem, and grappled with it a lot. on the one hand, he loves his fraternity, but on the other, he was frustrated because none of the other brothers (he's one of three sophomores but the other two don't do much, and the rest are jrs/srs) were putting as much effort into trying to save their chapter (they were facing like, six members at the end of this year due to graduation), and he felt the entire chapter was too cliqueish and he didn't fit in to any one group.
he seriously considered deactivating but then he decided to stick with it.
he poured his heart and soul into pulling off a successful recruitment (they're hindered by being the only fraternity that doesn't have a house - they rent a house nearby), and heavily recruited his friends. he's had a few unpleasant hiccups with these new members, but generally, the effort seems to have paid off. he's happy and his chapter is saved.
my point being: why not try and save the situation? you say there's brothers you don't like, nor members of your own pledge class, but maybe those bonds will come later, and maybe try and recruit your own friends - then everyone's a winner. or maybe instead of expecting (perhaps unrealistically) that you'll bond with and be close to every brother, start with the ones you do like
as for your house, try encouraging everyone to chip in some work and do a few small touchups to the house. give it some more time