Most active commenters
  • mewpmewp2(6)

←back to thread

45 points gmays | 21 comments | | HN request time: 0.259s | source | bottom
Show context
throwup238 ◴[] No.41916343[source]
> Sarcasm, cultural context and subtle forms of hate speech often slip through the cracks of even the most sophisticated algorithms.

I don't know how this problem can be solved automatically without something that looks a lot like AGI and can monitor the whole internet to learn the evolving cultural context. AI moderation feels like self driving cars all over again: the happy path of detecting and censoring a dick pic - or self driving in perfect California weather - is relatively easy but automating the last 20% or so of content seems impossibly out of reach.

The "subtle forms of hate speech" is especially hard and nebulous, as dog whistles in niche communities change adversarialy to get past moderation. In the most subtle of cases, there are a lot of judgement calls to make. Then each instance of these AGIs would have to be run in and tailored to local jurisdictions and cultures because that is its own can of worms. I just don't see tech replacing humans in this unfortunate role, only augmenting their abilities.

> The glossy veneer of the tech industry conceals a raw, human reality that spans the globe. From the outskirts of Nairobi to the crowded apartments of Manila, from Syrian refugee communities in Lebanon to the immigrant communities in Germany and the call centers of Casablanca, a vast network of unseen workers power our digital world.

This part never really changed. Mechanical turk is almost 20 years old at this point and call center outsourcing is hardly new. What's new is just how much human-generated garbage we force them to sift through on our behalf. I wish there was a way to force these training data and moderation companies to provide proper mental health care .

replies(8): >>41916410 #>>41916493 #>>41916524 #>>41916596 #>>41916819 #>>41917288 #>>41917660 #>>41917936 #
1. hcurtiss ◴[] No.41916819[source]
I think there's a genuine conversation to be had about whether there even is such a thing as "hate speech." There's certainly "offensive speech," but if that's what we're going to try to eliminate, then it seems we'll have a bad time as the offense is definitionally subjective.
replies(5): >>41916885 #>>41916918 #>>41917083 #>>41917089 #>>41917466 #
2. yifanl ◴[] No.41916885[source]
Is the claim there some special property that makes it impossible to convey hate as opposed any other type of idea through text?

That seems extremely wrong, especially in this context, given that LLMs make no attempt to formalize "ideas", they're only interested in syntax.

replies(1): >>41917277 #
3. szundi ◴[] No.41916918[source]
There is hate speech, like when someone tells poeple how other people are not human and must be eliminated. Happened a lot, happening now in wars you read about.
replies(1): >>41917406 #
4. o11c ◴[] No.41917083[source]
I'm not sure "offensive" is actually subjective. Rather, I dare say it's morally obligatory to be offensive at times, but different communities put the line in different places.

Stating the position "torture is bad" is enough to get you banned from some places (because it's offensive to people who believe that it's okay as long as the victims are less-than-human).

5. mewpmewp2 ◴[] No.41917089[source]
There is a definition for hate speech though.
replies(2): >>41917142 #>>41918427 #
6. reginald78 ◴[] No.41917142[source]
Actually, I think the problem is there are many definitions of hate speech.
replies(1): >>41917213 #
7. mewpmewp2 ◴[] No.41917213{3}[source]
I think there's only 1 main definition. Which is clear in spirit, but it's of course possible that people may interpret the definition definitely.
replies(1): >>41917439 #
8. mewpmewp2 ◴[] No.41917277[source]
Maybe the name for the "hate speech" is poorly chosen, since it's not necessarily about "hate".
replies(1): >>41917572 #
9. epicureanideal ◴[] No.41917406[source]
But when "hate speech" becomes censorable and a crime, then people are incentivized to interpret as broadly as possible their opponents' statements and claim they should be interpreted as dehumanizing or encouraging violence.

This can be done from both sides. Examples:

Not sufficiently (for whoever) enforcing immigration laws? "Trying to eliminate the majority population, gradual ethnic cleansing".

Talking about deporting illegal immigrants? "The first step on the road to murdering people they don't want in the country."

And if the local judiciary or law enforcement is aligned with the interests of one side or the other, they can stretch the anti hate speech laws to use the legal system against their opponents.

replies(1): >>41918417 #
10. jacobr1 ◴[] No.41917439{4}[source]
That may be so, but the denigrate (and common case as this thread suggests) is to expand the notion to any offensive speech that is disliked by the offended person. That is much more subjective and hard to define. The fact that we have some (better) definitions doesn't really help. The desire to censure speech is widespread, for different reasons, many conflicting. And the fact that there might be a rough academic consensus on where to draw lines (at least theoretically if not practically) isn't good enough in practice to actually define clear rules.
replies(1): >>41919422 #
11. danans ◴[] No.41917466[source]
> I think there's a genuine conversation to be had about whether there even is such a thing as "hate speech."

It may be fuzzy on the far edges, but any speech that calls for the elimination, marginalizes, dehumanizes or denies human or civil rights of a group of people is right in the heart of the meaning of hate speech.

That definition still leaves huge amounts of space for satire, comedy, political and other forms of protected speech, even "offensive speech".

replies(2): >>41917666 #>>41918399 #
12. yifanl ◴[] No.41917572{3}[source]
I mean, what's the claim then, there's no such thing as an illegal idea? You can't assign a semantic value to a legal system.
13. samatman ◴[] No.41917666[source]
> the elimination

Yep, that's bad alright.

> marginalizes, dehumanizes

This is the part which means anything that authorities or other powerful groups need it to.

14. skeeter2020 ◴[] No.41918399[source]
>> the elimination, marginalizes, dehumanizes or denies human or civil rights

but you've already lumped together a huge range of behaviours and impacts. Elimination? OK, we can probably broadly define that, but I just heard news reports with quotes of Israelis calling for the elimination of Hamas, and Iran the elimination of Israel. How do we handle that? marginalized? as defined by who? What about marginalizing undesirable behaviours or speech? What does "dehumanize" mean? Who's definition of human or civil rights?

replies(1): >>41919489 #
15. skeeter2020 ◴[] No.41918417{3}[source]
?? This can be done from both sides.

You are seeing this EXACT thing in the middle east right now.

16. baggy_trough ◴[] No.41918427[source]
What do you think the definition is?
replies(1): >>41919197 #
17. mewpmewp2 ◴[] No.41919197{3}[source]
Any speech (or well communications) that intends to incite violence or general harm on groups of people or a person with certain characteristics such as age, sex, orientation, race, etc.

E.g. "X race/gender/sexual orientation are bad for the society for reason Y, and therefore they should be treated with Z (a negative consequence)"

So intending to call out harm because of certain inherent characteristics a group of people have, and such characteristics that are not harmful for the society.

replies(1): >>41919396 #
18. belorn ◴[] No.41919396{4}[source]
People will endlessly argue over what "incite violence or general harm" actually mean, and they will also endlessly argue over if something should be considered an implied "characteristics of age, sex, orientation, race, etc".

Currently there is an ongoing court case regarding the case where a person criticized and made offensive statements about Muhammad, and if that should count as inciting violence or general harm against Muslims. One side is arguing that any negative statements about Muhammad is veiled statements directed against Muslims as a group, and the other side is arguing it is criticism against the religion and not about people who believe in that religion. People did similar arguments with Monty Python movie Life of Brian.

When it comes to symbols like flags, people often characteristic any action (positive and negative) as a form of hate speech if they dislike it, or as important symbolic gestures when they like it. Burning flags get often called hate speech, and forbidding people from waving flags (including general rules against all flags for specific events) has also been called hate speech.

replies(1): >>41919504 #
19. mewpmewp2 ◴[] No.41919422{5}[source]
The spirit needs to be understood clearly. The spirit of hate speech is to by forms of communication cause harm to a person or group of people for certain inherent characteristics that are not harmful for the society. Harm in such a way that manifests itself as violence or discrimination.
20. danans ◴[] No.41919489{3}[source]
> Elimination? OK, we can probably broadly define that, but I just heard news reports with quotes of Israelis calling for the elimination of Hamas, and Iran the elimination of Israel. How do we handle that? marginalized? as defined by who?

I'd call both of them hate speech without qualification. But between countries, there's no legal system that would rule on speech (only actions, like the ICJ tries to adjudicate).

> What about marginalizing undesirable behaviours or speech?

What is the example of undesirable behavior being undertaken by a group that would warrant their marginalization as a group? I'm having a hard time finding an example of that. Calling out a group of racists or bigots (based on their words) for what they are isn't marginalization.

> What does "dehumanize" mean?

This has a very straightforward definition:

https://www.merriam-webster.com/dictionary/dehumanize

> Who's definition of human or civil rights?

In the US context, this is also well defined:

https://www.findlaw.com/civilrights/civil-rights-overview/wh...

21. mewpmewp2 ◴[] No.41919504{5}[source]
What was the negative statement? To me the logic is that:

1. Criticising a religion != hate speech, or generally making fun of or criticising any sort of religious figure like Muhammad or Jesus != hate speech.

2. Calling out for a group of people of certain religion to have X negative consequences = hate speech.