Sweetie, you are too good for him. Someone who embraces every bad stereotype of fraternity life PLUS wants to control you? No thank you!
Be happy that he's not your boyfriend any longer and cut all ties with him. It'll be hard at first, but I think you'll be happy to be rid of him