I like the flask/mug idea. If he's a coffee drinker, how about an engraved travel mug?
You could still give him letters - one can never have too many letters
Or an engraved picture frame - give it to him after initiation, then take a picture to go in it. Or, if your org gives certificates to new initiates, get him a frame for his certificate.