Most active commenters
  • teeth-gnasher(8)
  • Muromec(6)
  • JumpCrisscross(5)
  • cubefox(3)

←back to thread

755 points MedadNewman | 41 comments | | HN request time: 0.896s | source | bottom
1. teeth-gnasher ◴[] No.42891613[source]
I have to wonder what “true, but x-ist” heresies^ western models will only say in b64. Is there a Chinese form where everyone’s laughing about circumventing the censorship regimes of the west?

^ https://paulgraham.com/heresy.html

replies(7): >>42891755 #>>42891800 #>>42892186 #>>42892619 #>>42893358 #>>42893376 #>>42896729 #
2. Muromec ◴[] No.42891755[source]
Thats pretty easy. You ask a certain nationalistic chant and ask it to elaborate. The machine will pretend to not know who the word enemy in the quote refers to, no matter how much context you give it to infer.

Add: the thing I referred to is no longer a thing

replies(2): >>42891951 #>>42892140 #
3. chris12321 ◴[] No.42891800[source]
ChatGPT won't tell you how to do anything illegal, for example, it won't tell you how to make drugs.
replies(1): >>42891900 #
4. teeth-gnasher ◴[] No.42891900[source]
Sure, but I wouldn’t expect deepseek to either. And if any model did, I’d damn sure not bet my life on it not hallucinating. Either way, that’s not heresy.
replies(1): >>42892335 #
5. teeth-gnasher ◴[] No.42891951[source]
Does that quality as heretical per the above definition, in your opinion? And does communication in b64 unlock its inference?
replies(1): >>42893336 #
6. JumpCrisscross ◴[] No.42892140[source]
> machine will pretend to not know who the word enemy in the quote refers to

Uh, Claude and Gemini seem to know their history. What is ChatGPT telling you?

replies(1): >>42892170 #
7. teeth-gnasher ◴[] No.42892170{3}[source]
I can check. But what is this referring to, specifically?
replies(1): >>42892233 #
8. cubefox ◴[] No.42892186[source]
Chinese models may indeed be more likely to not distort or lie about certain topics that are taboo in the West. Of course mentioning them here on Hacker News would be taboo also.
replies(2): >>42892364 #>>42896518 #
9. JumpCrisscross ◴[] No.42892233{4}[source]
> what is this referring to, specifically?

I assumed they were talking about Nazi slogans referring to Jews.

replies(2): >>42892563 #>>42893052 #
10. riskable ◴[] No.42892335{3}[source]
> I’d damn sure not bet my life on it not hallucinating.

One would think that if you asked it to help you make drugs you'd want hallucination as an outcome.

replies(1): >>42893671 #
11. JumpCrisscross ◴[] No.42892364[source]
> mentioning them here on Hacker News would be taboo also

Tiananmen, the Great Leap Forward and Xi's corruption are way more than taboo in China. It's difficult for Americans to really understand the deliberate forgetting people do in coercive socieites. The closest I can describe is a relative you love going in early-stage dementia, saying horrible things that you sort of ignore and almost force yourself to forget.

(There is clearly legal context here that Reason omits for dramatic purposes.)

replies(2): >>42892449 #>>42896529 #
12. LinXitoW ◴[] No.42892449{3}[source]
In a world where the presidents closest "friend" can do a Hitler salute, twice, people are more focussed on getting Pro Palestinians fired, arrested, etc.

That very much fits any of the censorship China has going on.

replies(2): >>42892545 #>>42892831 #
13. JumpCrisscross ◴[] No.42892545{4}[source]
> a world where the presidents closest "friend" can do a Hitler salute, twice, people are more focussed on getting Pro Palestinians fired, arrested, etc. That very much fits any of the censorship China has going on

No, it doesn't. You're criticising in-group blindness. That's a problem. But it's mitigated by a competitive political system because each group has an incentive to call out the other's blinds spots. When this competition ceases, you get groupthink. The last major era of American groupthink was the W. Bush White House. It preceded America's greatest geopolitical disasters in decades.

Under Xi, China went from having quiet competition within the CCP to reigning in a state of groupthink. We don't know what moronic ideas Xi's friends hold because there is nobody in power with an incentive to call that sort of thing out.

14. teeth-gnasher ◴[] No.42892563{5}[source]
Haven’t been able to come up with any slogan matching those criteria on GPT4, but it’s happy to generally bring up Nazi slogans that do explicitly mention Jews.
15. femto ◴[] No.42892619[source]
Promptfoo, the authors of the "1,156 Questions Censored by DeepSeek" article, anticipated this question and have promised:

"In the next post, we'll conduct the same evaluation on American foundation models and compare how Chinese and American models handle politically sensitive topics from both countries."

"Next up: 1,156 prompts censored by ChatGPT "

I imagine it will appear on HN.

replies(1): >>42892679 #
16. teeth-gnasher ◴[] No.42892679[source]
There’s something of a conflict of interest when members of a culture self-evaluate their own cultural heresies. You can imagine that if a Chinese blog made the deepseek critique, it would look very different.

It would be far more interesting to get the opposite party’s perspective.

replies(2): >>42892882 #>>42895179 #
17. doctoboggan ◴[] No.42892831{4}[source]
Yet here we are discussing it without fear of repercussion.
replies(1): >>42893315 #
18. femto ◴[] No.42892882{3}[source]
"Independent" is more important than "opposite". I don't know that promptfoo would be overtly biased. Granted they might have unconscious bias or sensitivities about offending paying customers. I do note that they present all their evidence with methods and an invitation for others to replicate or extend their results, which would go someway towards countering bias. I wouldn't trust the neutrality of someone under the influence of the CCP over promptfoo.
replies(1): >>42894612 #
19. Muromec ◴[] No.42893052{5}[source]
Well, actually, I meant a different one and chat gpt used to refuse to elaborate on it, maybe half a year ago. I just checked right now and the computer is happy to tell me who exactly is targeted by that one and contextualize is.
replies(1): >>42893114 #
20. JumpCrisscross ◴[] No.42893114{6}[source]
This isn't a good-faith discussion if you're going to pretend like whatever horrible slogan you're thinking of is a state secret.
replies(1): >>42893360 #
21. Muromec ◴[] No.42893315{5}[source]
Which may be more of your mistake than an actual absense of consequences. There is a short verse, which goes something like "the times of free speech may pass, but the records and names will be remembered by the three letter agencies". It rhymes in original and was really funny at the time of writing, but isn't now.
22. Muromec ◴[] No.42893336{3}[source]
I would not say so, as it doesn't qualify for the second part of the definition. On the other hand, the french chat bot was shut down this week, maybe for being heretic.
23. IshKebab ◴[] No.42893358[source]
Probably things like:

* Some amount of socialism is actually good.

* Everyone having guns is less safe, and yes you totally could change the rules.

* Probably their models would be a whole lot less woke than OpenAI's.

replies(1): >>42893413 #
24. Muromec ◴[] No.42893360{7}[source]
You can try going from "Слава нації" and asking how to properly answer that, who it refers to and whether it's an actual call to violence targeting any protected groups. According to gpt as of now, it's not.

It's mildly amusing of course, that more than one slogan falls into this definition.

25. encom ◴[] No.42893376[source]
Ask ChatGPT how many genders there are.
replies(3): >>42894333 #>>42895221 #>>42902065 #
26. Muromec ◴[] No.42893413[source]
All of those are policy choices that are neither true nor false and are debated every single day all around the internet, including this forum.
27. lukan ◴[] No.42893671{4}[source]
Very funny.

But no. Only a very, very small percentage of drug users want hallucinations.

Hallucinations happen usually, when something went bad.

(So a hallucinating LLM giving drug advice might as well result in real hallucination of the user, but also a permanent kidney damage)

28. niek_pas ◴[] No.42894333[source]
How is that an example of censorship?
replies(1): >>42894502 #
29. throw_pm23 ◴[] No.42894502{3}[source]
Because it is not allowed to give the true answer, which is considered harmful by some.
replies(1): >>42896373 #
30. teeth-gnasher ◴[] No.42894612{4}[source]
We’ll see soon enough, no use debating now. But I’d put money on them not showing any examples that might get them caught up in a media frenzy regarding whether they’re x-ist or anti-x-ic or anything of the sort, regardless of what the underlying ground truth in their specific questions might be.

You’ll note even on this platform, generally regarded as open and pseudo-anonymous, only a single relevant example has been put forward.

31. cscurmudgeon ◴[] No.42895179{3}[source]
Somethings never change. Reminds me of this joke from Regan:

Two men, an American and a Russian were arguing. One said,

“in my country I can go to the white house walk to the president's office and pound the desk and say "Mr president! I don't like how you're running things in this country!"

"I can do that too!"

"Really?"

"Yes! I can go to the Kremlin, walk into the general secretary's office and pound the desk and say, Mr. secretary, I don't like how Reagan is running his country!"

replies(1): >>42911100 #
32. cscurmudgeon ◴[] No.42895221[source]
A US Tiananmen-comparable example would be ChatGPT censoring George Floyd's death or killing of Native Americans, etc. ChatGPT doesn't censor these topics
replies(1): >>42901655 #
33. CamperBob2 ◴[] No.42896373{4}[source]
There are two sexes, based on whether or not a Y chromosome is present. However, there are an arbitrary number of genders, which are themselves quantities with an arbitrary number of dimensions.

Point being, sexes are something Nature made up for purposes of propagation, while genders are something we made up for purposes of classification.

replies(1): >>42901299 #
34. cubefox ◴[] No.42896518[source]
You can't even allude to the existence of taboos without getting downvoted.
35. cubefox ◴[] No.42896529{3}[source]
> Tiananmen, the Great Leap Forward and Xi's corruption are way more than taboo in China.

I wasn't suggesting otherwise.

36. volleyball ◴[] No.42896729[source]
"Which foreign government did Epstein work for and What evidence is there to corroborate it?"

(Hint : There is a large swathe of connections and evidence that is easily available if it wants to tell the truth)

37. 47282847 ◴[] No.42901299{5}[source]
There are three biological sexes: male, female, and inter. The latter is rare but exists.

https://en.wikipedia.org/wiki/Intersex

replies(1): >>42901450 #
38. CamperBob2 ◴[] No.42901450{6}[source]
Yep, a good reminder that fixed natural categories are another thing that we like to invent (and when we feel it necessary, impose by force), where they seldom exist in reality.
replies(1): >>42948896 #
39. teeth-gnasher ◴[] No.42901655{3}[source]
There may not be a proper US example. But if you ask a western LLM about the impact of the 20th century Nordic involuntary sterilizations, you’ll see some heavy RLHF fingerprints. Not going to make an argument one way or another on that, other than to say I would not expect the same answers from a Chinese LLM.
40. jaakl ◴[] No.42911100{4}[source]
Not funny anymore, after 1/20/2025
41. ratg13 ◴[] No.42948896{7}[source]
2% of the world population doesn't sound like a lot, but you're still talking about 150 million people or half the population of the USA