Hacker Timesnew | past | comments | ask | show | jobs | submit | more rdtsc's commentslogin

> But the ChatGPT maker seems to no longer have the same emphasis on doing so “safely.”

A step in the positive direction, at least they don't have to pretend any longer.

It's like Google and "don't be evil". People didn't get upset with Google because they were more evil than others, heck, there's Oracle, defense contractors and the prison industrial system. People were upset with them because they were hypocrites. They pretended to be something they were not.


I worked at Google for 10 years in AI and invented suggestive language from wordnet/bag of words.

As much as what you are saying sounds right I was there when sundar made the call to bury proto LLM tech because he felt the world would be damaged for it.

And I don’t even like the guy.


> sundar made the call to bury proto LLM tech

Then where did nano banana and friends come from? Did Google reverse course? Or were you referring to something else being buried?


This was long before. Google had conversational LLMs before ChatGPT (though they weren’t as good in my recollection), and they declined to productize. There was a sense at the time that you couldn’t productize anything with truly open ended content generation because you couldn’t guarantee it wouldn’t say something problematic.

See Facebook’s Galactica project for an example of what Google was afraid would happen: https://www.technologyreview.com/2022/11/18/1063487/meta-lar...


I'm having a hard time believing this, or at least understanding the decision (not on your part). Why wouldn't they just continue R&D on it rather than drop it entirely?

Many products we use every day start out unsafe and dangerous during the early stages. Why would this be any different?

And why allow the paper to be published?


You’re applying logic to what was actually a series of major oversights.


Neema was running a fully fledged Turing passing chatbot in 2019. It was suppressed. Then written about in open source and openAI copied it. Then Google was forced to compete.

This is all well known history.


No it's actually possible for organizations to work safely for long periods of time under complex and conflicting incentives.

We should stop putting the bar on the floor for some of the (allegedly) most brilliant and capable minds in the world.


In a capitalistic society (such as ours) I find what you’re describing close to impossible, at least when it comes to large enough organizations. The profit motive ends up conquering all, and that is by design.


Counterpoint: B corporations.

It's clearly possible for companies to self-impose safeguards: ESG/DEI, Bcorp, choosing to open source, and so on. If investors squeal, find better investors or tell them to put up with it. You can make plenty of profit without making all the profit that can be made.


There are countless highly effective charities that achieve this

(Yes, I know there is an even larger number of "charities" that do not achieve this ideal)


> There are countless highly effective charities that achieve this

I'm highly skeptical of this.


You're intrinsically skeptical of claims that contradict your already-formed belief? Interesting!


I don't really agree. People are plenty upset with palantir and broadcom for being evil for example and I don't see their motto promiong they won't be.


> AI-assisted bioterrorism

Does he know something we don't? Why specifically the "bio" kind?


Engineering your own virus is becoming more and more accessible. AI isn't really the crucial part here, but it would further lower the barrier of entry


He didn’t actually write that, the BBC invented it.


> If Europe is to withstand rising populism and Euroscepticism, we must strengthen its democratic foundations. Allowing people to vote where they live would be a good start.

I like the gist of it but not sure how one would follow from the other. Populist tendencies can also manifest through voting preferences, can't they? Brexit happened via a voting preference. Just because mobile EU citizens vote, it doesn't necessarily mean they'll vote for who the author expect they'll vote for. So they are mostly orthogonal concerns in a way.


> I also balk at how much extra computing power is needed to generate effects I find no value in and would prefer to disable

Sounds like you need to spend some money for a new Apple device! /s


Not OP but I think they are making a slightly different claim — that the universe sort of dictates or guides the mathematical structure we discover. Not whether they hold everywhere or not.


> but I believe that all of mathematics arises from an underlying fundamental structure to the universe and that this results in it both being "discoverable" (rather than invented) and "useful" (as in helpful for describing, expressing and calculating things).

That is an interesting idea. Can you elaborate? As in, us, that is our brains live in this physical universe so we’re sort of guided towards discovering certain mathematical properties and not others. Like we intuitively visualize 1d, 2d, 3d spaces but not higher ones? But we do operate on higher dimensional objects nevertheless?

Anyway, my immediate reaction is to disagree, since in theory I can imagine replacing the universe with another with different rules and still maintaining the same mathematical structures from this universe.


It can’t be too different from what people are familiar with. So it has to be consistent with itself and with reality.”It’s like our reality except …” but the except part (faster than light travel, mind reading, time travel, dragons, magic, etc) can’t get arbitrarily complex or unreasonable or the reader will be lost or confused.


"can’t get arbitrarily complex or unreasonable or the reader will be lost or confused."

Indeed, but that is always the challenge of a writer. But if you introduce magic in your story, and you do it in a way to show the limitations and what is roughly possible, then you can give hints later, if there was a murder with the help of a magic trick. But I actually think I only ever read one detective fantasy story

https://www.der-spurenfinder.de/

(just in german as far as I know)

It mostly works, but in one instance there was a surprise fantasy ability, that I could have not guessed before. But the actual murderer in the end, there were enough hints that gave them away despite magic, as the skills were explained and then you could combine.


> If PV uses too much land, do we want to talk about what agriculture is doing?

If we’ve worried about land why not go for nuclear? Just plant nuclear reactor seeds add fertilizer and power plants spring up in a few months.

See it doesn’t quite work that way. It brushes away too many variables.


It's probably easier to build a solar farm than prepare new land for hay production at this point.

Have you noticed the price of beef going up? It's because we're losing arable land to climate change. It takes a large number of high quality acres to raise a cow on grass.

That's been getting less and less feasible over time between extreme weather and erosion, so the cows get hay instead.

Hay production in places like Texas is disrupted by drought every few years, which means that ranchers have to sell their cattle at a loss or let the cows starve in the fields (assuming they don't die of heat stroke - the cows and the farmers).

After a few bad cycles like that, the ranchers start selling off land, so there aren't enough cows even in good years. Presumably this is bad for hay farmers, since demand attenuates down to what it would be in a drought year.

That brings us to 2026. It's pretty clear what's coming next.


It's his life. I can certainly look at many other lives and say they are lot of more wasted than his. Heck, he already created Mathematica, if he wanted to go and lay on the beach for the rest of this life, it would still be a lot less wasted than what many other people have accomplished in related domains.

Yeah, I don't like his arrogance, it's very grating to read. And perhaps nothing revolutionary is going to end up as a result of all the play with cellular automata but it's still interesting. Not as a rule, but sometimes discoveries in history are made by wild and wacky directions of research.


> Any large scale provider with headquarters in the USA will be subject to backdoors

Wonder what large scale provider outside USA won’t do that?


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: