Doesn't bother me (in fact I kind of like it!) as long as it's in a pleasant tone. It's the patronizing ones that make my blood boil.
I'm extremely guilty of calling random people and small children "hon" or "sweetie". As in "You dropped something out of your purse, hon" or "Where's your mommy, sweetie?"
If I've offended anyone with it, they haven't shown any reaction!