Thanks for the all the responses (too many to quote)...made me smile! I usually respond with: "I don't have kids because I like to sleep in." And, "We got married because neither of us wanted kids!"
Kids are great...just not for me
I usually just go into my "the world is overpopulated speech" and that shuts people up real quick.