It doesn't matter how "smart" AI is, or becomes.
We must keep AI in perspective. It can be, and is, helpful.
But it cannot "run everything" and create a utopia where people are sitting around in superabundance, without work or poverty anywhere in the world.
Human civilization functions on billions of individual decisions, and DISPERSED knowledge.
NOT centralized knowledge.
We each have SUBJECTIVE value scales that are changing at every moment. Those value scales are always private. That knowledge cannot be known by AI, no matter how much data is collected.
Our desires are in constant flux. Sometimes we make rational decisions ... and very often emotional decisions.
We make our decisions to act in our own local situations, with resources that are immediately available to us.
We PURPOSEFULLY choose our own individual ends, and the means that we will use to TRY to achieve them.
We make decisions in our minds, and with our hearts.
No AI, no matter how "smart" it is can "run" human civilization.
Yet, as with all the utopian schemes that come and go ... humanity will probably end up learning this the hard way.
