Actually, it can still be good to get them out even if they're not causing immediate problems, if you're cavity-prone (like me). Wisdom teeth are more likely to get cavities in them, just because they're so far back in your mouth that they're hard to brush. In that situation, my dentist told me that the best thing is to just go ahead and take them out while you're young and can bounce back quicker in healing. They took my bottom 2 out as soon as they were fully erupted, and will do my top 2 whenever (if ever) they decide to come out.
But of course, your dentist will know best! 
 
ETA: I got mine removed under local anesthetic only. I didn't feel any pain, just some strong tugging, and my recovery was really easy with no swelling or anything. I was back at work the next day. I guess I was lucky!