If AGI is something that becomes real, I don't think it would be recognizable to us for long, I don't think it will be a type of steady state even like humans, reading books to it's chidren in the cloud and get really good at coding and similar tasks, and improve itself infinitely (into what?). I think life has a special property in that it is constrained, so it exists. Imagine being able to become pretty much anything, what would you choose?
We can't even comprehend what a system like you describe would evolve into, but I don't think we can even fathom it, it's not going to be like some ultimate task master who gets 18 whole in ones at gold on Friday and take all our jobs, for some reason ?
What I think we're doing is applying our problems and the things we'd want (infinite self-improvement) because they're things we feel would be an advantage to us. A robotic system though? Not sure it would care.
It seems like AI is the ultimate end game, but I'd imagine if we survie the AI era, we'll be past it pretty farking fast.
We can't even comprehend what a system like you describe would evolve into, but I don't think we can even fathom it, it's not going to be like some ultimate task master who gets 18 whole in ones at gold on Friday and take all our jobs, for some reason ?
What I think we're doing is applying our problems and the things we'd want (infinite self-improvement) because they're things we feel would be an advantage to us. A robotic system though? Not sure it would care.
It seems like AI is the ultimate end game, but I'd imagine if we survie the AI era, we'll be past it pretty farking fast.