If I was in this situation I would casually show up in letters. Or something like that. You know like asking him to get something from my car; tossing him the keys w/ my letters. Or I'd ask him over to my place to hang out. Hard to miss the paddles and pictures of my sisters.
Or even better; ask him to the next formal.