> "Anthropic believes that they are the ones who should have final say over how Anthropic is used; given that they think only they should be developing leading edge AI, they by extension think that only they should have final say over AI generally. When you further combine this realization with the company’s pronouncements about AI’s ability to conduct all economic activity, you realize that Anthropic’s leadership effectively wants to have power over everything and everyone."
To be fair, we're simultaneously mocking anthropic for believing in safety so much and also for them thinking they're the only ones that care enough about it. It's true that no one else seems to care as much. Judging by reactions from everyone, all their safety talk is very bad PR.
The criticism isn't that they believe in safety too much. It's that they patently using safety as a red herring with the actual goal of regulating away competition that they know the cannot beat.
The people involved have been talking about safety long before they had any users or a company.
"Concrete Problems in AI Safety" by Dario and another founder was published 2016, anthropic was founded 2021. Among a bunch of other examples, including other founders.
If safety is seen as a joke now, it was really seen as a joke back then. The reason they keep shooting themselves in the foot with bad PR is because they truly believe in risks.
I’m sorry, but this do-gooder concept doesn’t jibe with their other actions. For example, swindling their business partners (such as Figma). Filing an unnecessary trademark lawsuit against a customer whose brand predates Anthropic.
And for safety? Oh yeah, they literally sell the removal of guardrails in exchange for minimum spend commitments.
For example, swindling their business partners (such as Figma). Filing an unnecessary trademark lawsuit against a customer whose brand predates Anthropic.
Completely unrelated to AI safety.
they literally sell the removal of guardrails in exchange for minimum spend commitments
It seems blindingly obvious to me that you'd want to let trusted organizations use the models defensively, which means without guardrails, and that you'd probably gate that behind some kind of enterprise sales process, for multiple reasons.
Honestly, it just seems like you have an axe to grind and aren't really particularly knowledgeable (or curious) about AI safety.
1. This is not “unrelated to AI safety”. The things they seek in the name of AI safety always seem to be aligned with the path that will eliminate competition and give them maximum economic power. Thus, to disentangle what is sincere and what is ulterior, we have to look at the leadership’s character holistically. A ruthlessly unethical and cutthroat corporation that is also seeking unprecedented power doesn’t deserve the benefit of the doubt when it claims to be doing this for altruistic reasons.
2. You misstated what I wrote. My gripe is not that they have an enterprise sales process. It’s that in negotiations, they say “we’ll drop the safeguards if you agree to spend more”. I haven’t heard of any groundbreaking AI safety research concluding that spending more with Anthropic makes the models safer, but maybe Dario has a new blog post coming.
When someone says they are doing something to help you, but it really helps them, you have to choose if you trust what they say. One way to know if you can trust them is to watch how they behave.
(By the way, I have been very transparent on HN that I have an axe to grind, literally referring to it as “an axe to grind”. My axe is that I think the frontier labs are a symptom of a cancer on our society, and I personally wish to see them and their tactics fail.)
Yes, that’s obvious, and it’s leading you to some really specious logic.
Your simpler version still sidesteps the point that a trademark dispute has nothing to do with AI safety. Other than that you disagree with it, therefore they’re dishonest scammers, therefore AI safety is all bullshit?
A trademark dispute in isolation isn’t related. But as part of a broader course of conduct in which the pursuit of commercial advantage consistently trumps other values, it is. We can disagree on this.
What they believe now or care about is fundamentally not very relevant: allowing them a monopoly would be a big mistake. Google was supposed to do no evil and it probably started that way but nothing guarantees the future other than having alternatives.
> "Anthropic believes that they are the ones who should have final say over how Anthropic is used; given that they think only they should be developing leading edge AI, they by extension think that only they should have final say over AI generally. When you further combine this realization with the company’s pronouncements about AI’s ability to conduct all economic activity, you realize that Anthropic’s leadership effectively wants to have power over everything and everyone."