The most respected brother in my fraternity did not drink or smoke. He did go to every party and event; and he (and his dates) always had fun.
Please note the bolded.
No one will care if you don't drink if you participate and are a fun and festive person. If, however, you use it as an excuse to not go to things or stand around like a bump on a log, you won't be very well liked in your sorority.
__________________
It is all 33girl's fault. ~DrPhil