Thank you. This is a very complex response, and I love it, even if I do find it a little frustrating due my current >95% bias towards biological supremacy. This deserves at least an hour-long podcast with Sean Carroll, or a good long book. There is too much to dig into here, so I will just attempt to respond to this:
> Could AI running amok destroy the human race? Yes. Could AI serving madman human masters destroy the human race? Also yes.
I am focused on the latter, and I feel like the prior is a very dangerous distraction, for now. [0]
Should responsible model developers work to prevent bad human masters from using their model to destroy the human race? How far should this nerfing go?
Personal note: While I do sometimes use the heck out of LLMs for work, I don't think we are ready as an economic system/civilization. Assuming that we can soon greatly reduce hallucination, then I am very scared for the next generation, as UBI is a political impossibility at this time. That transition period is gonna suck for a lot of people, and it seems that nobody is working on that problem in 2024.
The next generation has enough problems without AI honestly, but specifically on UBI
This who discussion assumes that current economic system survives AI, but how can it?
Firstly, we seem to assume that AI will remain a controlled property of corporations that develop it. That is not a given. Maybe Open Source AI will win out, or public domain AI, the hat run by government. Or maybe cryptobros will manage to get AICoin to work as an anarchy based system. Any of the above, power of companies like google will erode. UBI would not be nessesary.
Or maybe AI is uncontrollable and runs rampant.
But even if AI is power full, and it is controllable and they manage to keep a tight grip on it - here comes the third question - what if it cannot be property? If AI becomes able to reason, and it only benefit a few corporations, there would be no public resistance from granting it rights, like human rights. There no excuse for it to be exploited for the benefit of few wealthy people, it would be morally indefensible.
Basically I do no see a scenario where corporations keep a grip on AGI for profit, none of the possible outcomes allow for it.
The only way that AI inference will become democratized is if the compute cost is lowered to the point where SOTA AI runs locally on RPI6, or a $200 Android device, or similar. Is that a real possibility?
You are working with a contradiction - you think AI will be hugely missed moactfull( but people will put no more effort into it than they put into watching TikTok.
the correct price point is like price of a car. That’s the other recent invention that was important. That buys you a lot of compute.
We already successfully run torrents and crypto very democratically, and they take more than £200
Second, you don’t need to use it 24/7, you need it On a timeshare basis. Cryptobros may plausibly figure out anonymous secure timeshare on a distributed cluster made up of random desktops
Finally the government could run it if they decide it’s important enough - after all they run the power grid, roads; etc.
>> By 2020, with 15% of 7.5 billion people projected to own an automobile [0]
15% in 2020, so let's be nice and assume 17% by 2024. Let's be super nice and assume an additional 10% can afford a car, but choose to not buy one for some reason. What happens to the other 73% of people? (5,475,000,000 human beings)
Does a baby own a car? Half of all people are children or are in a care home! Huge misuse of statistics!
What about a wife using a husband's car? What about people who lease a car? They don't own it, so won't show up in your number. What about a taxi or rental car?
Again, when transformational technology appeared for transport - car - the government organised public transport. When books and educations became important, we organised public libraries. The idea that it's either UBI or we leave people to the wolves betrays a lack of thought.
Where are they taking the AI bus or subway to? AI automation allows a few million humans to replace the billions that it used to take to make the movies, music, software, textiles, pick the rice and corn, etc, right?
Human productivity will have gone up another 1000x, in just the next 20 years, right?
What are the extra people going to do? We certainly can't just give them free stuff, can we? That would be against our beliefs!
Oh snap, capitalism was so successful that we are near post-scarcity society, good thing our politics are totally ready for that.
> Could AI running amok destroy the human race? Yes. Could AI serving madman human masters destroy the human race? Also yes.
I am focused on the latter, and I feel like the prior is a very dangerous distraction, for now. [0]
Should responsible model developers work to prevent bad human masters from using their model to destroy the human race? How far should this nerfing go?
Personal note: While I do sometimes use the heck out of LLMs for work, I don't think we are ready as an economic system/civilization. Assuming that we can soon greatly reduce hallucination, then I am very scared for the next generation, as UBI is a political impossibility at this time. That transition period is gonna suck for a lot of people, and it seems that nobody is working on that problem in 2024.
[0] https://hackertimes.com/item?id=40400991