←back to thread

747 points porridgeraisin | 2 comments | | HN request time: 0.45s | source
1. bilsbie ◴[] No.45064963[source]
Offshoot topic but I had an idea for LLM privacy.

What if the first layer (or couple layers) were processed locally on the users machine and then it goes to the provider to process the remaining layers.

You could also process the last layer on the users machine.

It’s hard to say what kind of privacy this gives users. I don’t think they could reverse out exactly what the input was.

replies(1): >>45065075 #
2. calmbonsai ◴[] No.45065075[source]
This is intriguing. I've been working on gestalt measurements of LLM 'skew' and thought this sort of scenario might be possible.

Combine that workflow with homomorphic encryption and you've got a reasonable privacy moat.