5. "RE: Intelligence we can't control is coming." In response to In response to 2
>I don't see the reason why AI would be bent on killing us, but >I don't see why it would be bent on helping us either.
The second possibility you mentioned is probably the most interesting question regarding AI that I've never heard before.
I tend to believe, like you, that it doesn't make sense for AI to destroy mankind. It just sounds like some sort of self-absorbed idea that humanity has that the universe is out for its destruction.
But the idea that AI would be agnostic towards humans and simply not try and better the world for humanity's benefit is an interesting one and something that is worth exploring.
> >We need to prepare for all outcomes.
There was a report that came up as I searched for the Inc article that mentioned that Russia is planning to use AI in a new fleet of 'smart' weapons. And while I can't forsee a 'digital' lifeform trying to exterminate humanity, it is easy to see a future where some autocratic regime tries to use AI to force the world into a period of repression. I have no idea how to prevent technology from getting into the wrong people's hands, but like you seemed to mention, it's an outcome that the world needs to prepare for.