To be clear, I 100% support AI safety regulations. "Safety" to me means that a rogue AI shouldn't have access to launch nuclear missiles, or control over an army of factory robots without multiple redundant local and remote kill switches, or unfettered CLI access on a machine containing credentials which grant access to PII — not censorship of speech. Someone privately having thoughts or viewing genAI outputs we don't like won't cause Judgement Day, but distracting from real safety issues with safety theater might.
It is monkey see, monkey do with the political and monied sets. And to think they see themselves as more evolved than the "plebs", Gotta find the humor in it at least.
In China it just so happens that the people in power already have so much of it they don't have to pretend. They can just control the population through overt censorship.
The same people exist in the west! For various historical reasons (more focus on individuality, more privately owned guns guns, idk really), they don't have as much direct power at the moment and have to frame their struggle for more as protecting the children, fighting against terrorists, preventing money laundering, etc.
But this can change very quickly. Look how Hitler rose to power. Look how Trump is doing very similar things in the US. Look what historians are saying about it: https://acoup.blog/2024/10/25/new-acquisitions-1933-and-the-...
But the root cause is the same everywhere - a percentage of the population has anti-social personality traits (ASPD and NPD, mainly). They want power over others, they want worship, they think they're above the rules, some (but only some) of them even get pleasure from hurting others.
"For the children" isn't and has never been a convincing excuse to encroach on the personal freedom of legal adults. This push for AI censorship is no different than previous panics over violent video games and "satanic" music.
(I know this comment wasn't explicitly directed at me, but for the record, I don't necessarily believe that all or even most "AI 'safety'" advocacy is in bad faith. It's psychologically a lot easier to consider LLM output as indistinguishable from speech made on behalf of its provider, whereas search engine output is more clearly attributed to other entities. That being said, I do agree with the parent comment that it's driven in large part out of self-interest on the part of LLM providers.)
But that wasn't the topic being discussed. It is one thing to argue that the cost of these safety tools isn't worth the sacrifices that come along with them. The comment I was replying to was effectively saying "no one cares about kids so you're lying if you say 'for the children'".
Part of the reason these "for the children" arguments are so persistent is that lots of people do genuinely want these things "for the children". Pretending everyone has ulterior motives is counterproductive because it doesn't actually address the real concerns people have. It also reveals that the person saying it can't even fathom someone genuinely having this moral position.
I don't see that in the comment you replied to. They pointed out that LLM providers have a commercial interest in avoiding bad press, which is true. No one stops buying Fords or BMWs when someone drives one off a cliff or into a crowd of people, but LLMs are new and confusing and people might react in all sorts of illogical ways to stories involving LLMs.
> Part of the reason these "for the children" arguments are so persistent is that lots of people do genuinely want these things "for the children".
I'm sure that's true. People genuinely want lots of things that are awful ideas.
>When a model is censored for "AI safety", what they really mean is brand safety.
The equivalent analogy wouldn't be Fords and BMWs driving off a cliff, they effectively said that Ford and BMW only install safety features in their cars to protect their brand with the implication that no one at these companies actually cares about the safety of actual people. That is an incredibly cynical and amoral worldview and it appears to be the dominate view of people on HN.
Once again, you can say that specific AI safety features are stupid or aren't worth the tradeoff. I would have never replied if the original comment said that. I replied because the original comment dismissed the motivations behind these AI safety features.
Are you saying you're opposed to letting AI perform physical labor, or that you're opposed to requiring safeguards that allow humans to physically shut it off?
To the extent that a large corporation can be said to "believe" or "mean" anything, that seems like a fair statement to me. It's just a more specific case of pointing out that for-profit corporations as entities are ultimately motivated by profit, not public benefit (even if specific founders/employees/shareholders are individually motivated by certain ideals).
The larger an organization is, and the more bureaucratized it is, the less morality of individual people in it affects it overall operation.
Consequently, yes, it is absolutely true that Ford and BMW as a whole don't care about safety of actual people, regardless of what individual people working for them think.
Separately, the nature of progression in hierarchical organizations is basically a selection for sociopathy, so the people who rise to the top of large organizations can generally be assumed to not care about other people, regardless of what they claim in public.
This is really just the mirror image of what I was originally criticizing. Any decision made by a corporation is a decision made by a person. You don't get to ignore the morality of your decisions just because you're collecting a paycheck. If you're a moral person, the decisions you make at work should reflect that.
Executives are beholden to laws, regulations, and shareholder interests. They may also have teams of advisors and board members convincing them of the wisdom of decisions they wouldn't have arrived at on their own. They may not even have a strong opinion on a particular decision, but assent to one direction as a result of internal politics or shareholder/board pressure. Not everything is a clear-cut decision with one "moral" option and one "immoral" option.
Ultimately, this isn't strictly an issue specific to genAI. If a "script roulette" program that downloaded and executed random GitHub Gist files somehow became popular, or if someone created a web app that allowed anyone to anonymously pilot a fleet of robots, I'd suggest that those be subject to exactly the same types of safety regulations I proposed.
Any such regulations should be generically written, not narrowly targeted at AI algorithms. I'd still call that "AI safety", because in practice it's a much more useful definition of AI safety than the one being pushed today. "Non-determinism safety" doesn't really have the same ring to it.
Whenever any large organization takes a "think of the children" stance, it's almost always in service of another goal, with the trivial exception of single-issue organizations that specifically care about that issue. This doesn't preclude individuals, even within the organization, from caring about a given issue. But a company like OpenAI that is actively considering its own version of slop-tok almost certainly cares about profit more than children, and its senior members are in the business of making money for their investors, which, again, takes precedence over their own individual thoughts on child safety. It just so happens that in this case, child safety is a convenient argument for guard rails, which neatly avoids having to contend with advertisers, which is about the money.
Sure, products like character.ai and ChatGPT should be designed to avoid giving harmful advice or encouraging the user to form emotional attachments to the model. It may be impossible to build a product like character.ai without encouraging that behavior, in which case I'm inclined to think the product should not be built at all.
I'm not American, so I have no horse in the Trump race, but it seems clear to me that a significant chunk of the country elected the guy on the premise that he would do what he's currently doing. Whether or not you think he's Hitler or the savior of America almost certainly depends on your view of how well the system was working beforehand, and whether or not it needed to be torn down and rebuilt.
Which is to say, I don't know that historians will have much of relevance to say until the ink is dry and it's become history.
Basically the most difficult and most essential task became _how to structure the system so I can hand off power back to the people and it continues working_.
What I see Trump, Putin and Xi doing is not that - otherwise their core focus would be educating people in history, politics, logical reasoning, and psychology so they can rule themselves without another dictator taking over (by force or manipulation). They would also be making sure laws are based on consistent moral principles and are applied equally to everyone.
> I'm not American
Me neither, yet here we both are. We're in the sphere of influence of one of the major powers.
> elected the guy on the premise that he would do what he's currently doing
Yes, people (in the US) are angry so they elected a privileged rich guy who cosplays as angry. They don't realize somebody like him will never have their best interest in mind - the real solution (IMO?) is to give more political power to the people (potentially weighed by intelligence and knowledge of a given area) and make it more direct (people voting on laws directly if they choose to). Not to elect a dictator with NPD and lots of promises.
> Which is to say, I don't know that historians will have much of relevance to say until the ink is dry and it's become history.
The historian I linked to used 2 definitions of fascism and only Trump's own words to prove that he satisfies both definitions. That is very relevant and a very strong standard of proof from a highly intelligent person with lost of knowledge on the topic. We need more of this and we need to teach the general population to listen to people like this.
I don't know how though.
What I find extremely worrying is that all 3 individuals in the highest positions of power (I refuse to call them leaders) in the 3 major powers are very strongly authoritarian and have clear anti-social personality traits. IMO they all should be disqualified from any position of power for being mentally ill. But how many people have sufficient knowledge to recognize that or even know what it means?
The intelligence and education levels of the general population are perhaps not high enough to get better outcomes than what we have now.
---
Anyway, I looked through your comment history and you seem to have opinions similar to mine, I am happy to see someone reasonable and able to articulate these thought perhaps better than I can.
Here is a couple of real world AI issues that have already happened due to the lack of AI Safety.
- In the US if you were black you were flagged "high risk" for parole. If you were a white person living in farmland area then you were flagged "low risk" regardless of your crime.
- Being denied ICU because you are diabetic. (Thankfully that never went into production)
- Having your resume rejected because you are a woman.
- Having black people photos classified as "Gorilla". (Google couldn't fix at the time and just removed the classification)
- Radicalizing users by promoting extreme content for engagement.
- Denying prestige scholarships to black people who live in black neighbourhoods.
- Helping someone who is clearly suicidal to commit suicide. Explaining how to end their life and write the suicide note for them.
... and the list is huge!
And I think that's fine. I don't want a zero censorship libertarian free for all internet. I don't want a neutral search engine algorithm, not least of all because that would be even easier to game than the existing one.
I mean, just because you could kill a million people by hand doesn't mean that a pistol, or an automatic weapon, or nuclear weapons aren't an issue, just an irrelevant technology. Guns in a home make suicide more likely simply because they are a tool that allows for a split-second action. "If someone really wants to do X, they will find a way" just doesn't map onto reality.