Quote:
Originally Posted by cheerfulgreek
Do you think it can or will get out of control?
|
Definitely yes to the first question and probably yes to the second.
In some sense, there have been AIs which temporarily got out of control until they were reigned in. That would be some computer viruses. Although they aren't modern AI.
Eventually there will be modern AI based computer viruses, though.
With that in mind, there will be AI trained to hack computers. I'd be really surprised if that hasn't already been accomplished. If it hasn't or at the very least if it isn't being worked on & developed then many people in the computer security side of government (and cyber warfare) need to lose their jobs. Hacking is like solving puzzles... puzzles are games, basically & AI has already mastered many games, so why not hacking. Problem is that if we don't do this what if an enemy does. Train the AI to hack, train the AI to find new vulnerabilities, train the AI to infect, to evade detection, stuff like that and we have a real problem, especially if integrated into a virus.
Then there will be AI trained to protect against AI that is trained to hack. And who knows which side will win that battle.
But it doesn't even need to be an AI designed to do bad things for it to get out of control. Could be a completely well intentioned AI but some aspect of the logic was missed or not protected and the AI determines a solution to whatever problem it is solving is to do something really terrible.
It all seems like science fiction but we probably aren't too far off from having self driving cars that are safer than people driving. AI controlling things that have the potential to do a lot of damage becomes more and more real over time.