Keep in mind that if you decide to date, this is going to be VERY hard. And You will get to see him very little.
HOWEVER...
I'm a firm believer in following your heart. And if you truly care about him and are willing to put forth the effort, than do so. And if it doesn't work out, you've still got a friend, and so you can't lose either way.
Good luck!