It's not really your military service that might get in the way, it's more your age. At a lot of schools chapters have heavy preferences towards 18 year old freshmen.
Also one of the things you need to ask yourself is how will you deal with being surrounded by a bunch of silly people right out of high school after everything you've already experienced? It could possibly drive you insane!