I only friend those people I know. I've denied lots of people I don't know (or know and don't like). However, if I fall out with a friend, I don't "defriend" them on the off-chance we may reconcile.
I don't see why anyone would take offense from being denied by someone they didn't even know. That doesn't change who you are, it just means they don't know you!
