(huggingface.co)

586 points mizzao | 1 comments | 13 Jun 24 03:42 UTC | HN request time: 0.207s | source

Show context

>We can now print them and manually select the layer (block) that provides an uncensored response for each instruction.

I'm curious why are they selecting output from an intermediate layer, and not the final layer. Does anyone have an intuition here?

replies(1): >>40668843 #

1. paraschopra ◴[13 Jun 24 12:31 UTC] No.40668843[source]▶

Is it not possible that subsequent layers have additional refusal directions and hence end up producing the censored outputs?

Uncensor any LLM with abliteration