12 points oogwayy | 1 comments | 20 Nov 24 15:42 UTC | HN request time: 0.21s | source

It seems an obvious idea but we cannot find anyone offering b2b local LLMs setup to corporations that doesn't want to use external ones & keep their data in-house.. ie airlines, governments, attorneys, accountants..

1. lunarcave ◴[20 Nov 24 17:39 UTC] No.42196343[source]▶

I think this is a the value prop for AWS Bedrock (no affiliation)

AFAIK You get a managed instance where the model data doesn’t get sent to the model provider, but you pay PAYG rates.

↑

Why do we see no companies offering to deploy local LLMs?