I would split up and go to the freshman halls. like you said.. recruitment would be awesome for you.
(I don't know how close all 4 of you are, or how close you are with each of them on an individual basis..) But, if you room with 1 brother for a semester, you could strengthen a bond, or even create a new super strong one?
Just my $0.02