←back to thread

234 points martinald | 2 comments | | HN request time: 0.483s | source
Show context
ryao ◴[] No.44538755[source]
Am I the only one who thinks mention of “safety tests” for LLMs is a marketing scheme? Cars, planes and elevators have safety tests. LLMs don’t. Nobody is going to die if a LLM gives an output that its creators do not like, yet when they say “safety tests”, they mean that they are checking to what extent the LLM will say things they do not like.
replies(12): >>44538785 #>>44538805 #>>44538808 #>>44538903 #>>44538929 #>>44539030 #>>44539924 #>>44540225 #>>44540905 #>>44542283 #>>44542952 #>>44543574 #
natrius ◴[] No.44538808[source]
An LLM can trivially instruct someone to take medications with adverse interactions, steer a mental health crisis toward suicide, or make a compelling case that a particular ethnic group is the cause of your society's biggest problem so they should be eliminated. Words can't kill people, but words can definitely lead to deaths.

That's not even considering tool use!

replies(12): >>44538847 #>>44538877 #>>44538896 #>>44538914 #>>44539109 #>>44539685 #>>44539785 #>>44539805 #>>44540111 #>>44542360 #>>44542401 #>>44542586 #
andsoitis ◴[] No.44542360[source]
> An LLM can trivially instruct someone to take medications with adverse interactions,

What’s an example of such a medication that does not require a prescription?

replies(3): >>44542785 #>>44543004 #>>44543530 #
1. pixl97 ◴[] No.44543004[source]
How about just telling people that drinking grapefruit juice with their liver medicine is a good idea and to ignore their doctor.
replies(1): >>44544572 #
2. andsoitis ◴[] No.44544572[source]
> liver medicine

What is an example liver medicine that does not require a prescription?