←back to thread

Let's talk about AI and end-to-end encryption

(blog.cryptographyengineering.com)
174 points chmaynard | 1 comments | 17 Jan 25 05:50 UTC | HN request time: 0.21s | source
Show context
lowbatt ◴[17 Jan 25 19:36 UTC] No.42742349[source]▶
Maybe a little off topic, but is there a way for a distributed app to connect to one of the LLM companies (OpenAI, etc.) without the unencrypted data hitting an in-between proxy server?

An app I'm building uses LLMs to process messages. I don’t want the unencrypted message to hit my server - and ideally I wouldn’t have the ability to decrypt it. But I can’t communicate directly from client -> LLM Service without leaking the API key.

replies(3): >>42742683 #>>42742892 #>>42743194 #
1. michaelmrose ◴[17 Jan 25 20:25 UTC] No.42742892[source]▶
Will such processing be cheap enough to be done by a box that plugs into a customers router to handle such? Would they buy them? Notably not just for this use case but others