Does that guy ever wear shirts/hats/etc. from his college? Assuming he's graduated, you could always give him the response that it's similar to wearing a university t-shirt or logo even after he's graduated. Of course, Pi Phi pride is on a higher level
but maybe this analogy will help him understand.