I'm a member of the Alumnae chapter here in Lexington and honorary i guess to the one in Louisville(an hour away). I've never had a problem commuting for Louisville chapter and Louisville Alumnae Panhellenic stuff.
I say if it is the closest one, and/or you like them then dont let it stop you