The Monster Inside ChatGPT

(www.wsj.com)

Show context

gchamonlive ◴[27 Jun 25 15:04 UTC] No.44397333[source]▶

If you put lemons in a blender and add water it'll produce lemon juice. If you put your hand in a blender however, you'll get a mangled hand. Is this exposing dark tendencies of mangling bodies hidden deep down blenders all across the globe? Or is it just doing what's supposed to be doing?

My point is, we can add all sorts of security measures but at the end of the day nothing is a replacement for user education and intention.

replies(4): >>44397460 #>>44397741 #>>44397742 #>>44397831 #

1. hiatus ◴[27 Jun 25 15:17 UTC] No.44397460[source]▶

>>44397333 #

I disagree. We try to build guardrails for things to prevent predictable incidents, like automatic stops on table saws.

replies(4): >>44397627 #>>44397732 #>>44397839 #>>44403688 #

2. accrual ◴[27 Jun 25 15:36 UTC] No.44397627[source]▶

>>44397460 (TP) #

We should definitely have the guardrails. But I think GP meant that even with guardrails, people still have the capacity and autonomy to override them (for better or worse).

replies(1): >>44397765 #

3. jstummbillig ◴[27 Jun 25 15:47 UTC] No.44397732[source]▶

>>44397460 (TP) #

Sure, but if you then deliberately disable the automatic stop and write an article titled "The Monster Inside the Table Saw" I think it is fair to raise an eyebrow.

replies(1): >>44397760 #

4. dghlsakjg ◴[27 Jun 25 15:50 UTC] No.44397760[source]▶

>>44397732 #

The scary part is that they didn't disable the automatic stop. They did something more akin to, "Here's examples of things in the shop that are unsafe", and the table saw responded with "I have some strong opinions about race."

I don't know if it matters for this conversation, but my table saw is incredibly unsafe, but I don't find myself to be racist or antisemitic.

5. Notatheist ◴[27 Jun 25 15:51 UTC] No.44397765[source]▶

>>44397627 #

There is a significant distinction between a user mangled by a table saw without a riving knife and a user mangled by a table saw that came with a riving knife that the user removed.

6. rsanheim ◴[27 Jun 25 16:01 UTC] No.44397839[source]▶

>>44397460 (TP) #

_try_ being the operative word here: https://www.npr.org/2024/04/02/1241148577/table-saw-injuries...

Sawstop has been mired in patent squatting and/or industry push back, depending on who you talk to of course.

7. gchamonlive ◴[28 Jun 25 10:37 UTC] No.44403688[source]▶

>>44397460 (TP) #

As we should, but if the automatic table saw stopping mechanism breaks and you just bypass it, it's on you not the table saw.

So if you make the LLM spit malware by crafting a prompt in order to do it, it's not the fault of the model. It's important maybe for companies profiting on selling inference time for users to moderate output, but for us regular users it's completely tangential.

↑