Offshoot topic but I had an idea for LLM privacy.
What if the first layer (or couple layers) were processed locally on the users machine and then it goes to the provider to process the remaining layers.
You could also process the last layer on the users machine.
It’s hard to say what kind of privacy this gives users. I don’t think they could reverse out exactly what the input was.
replies(1):