←back to thread

Why do we see no companies offering to deploy local LLMs?

12 points oogwayy | 1 comments | 20 Nov 24 15:42 UTC | HN request time: 0.21s | source

It seems an obvious idea but we cannot find anyone offering b2b local LLMs setup to corporations that doesn't want to use external ones & keep their data in-house.. ie airlines, governments, attorneys, accountants..
1. runjake ◴[20 Nov 24 17:38 UTC] No.42196325[source]▶

  > ie airlines, governments, attorneys, accountants..
Because it's easier and more productive to use private cloud LLMs, like Azure OpenAI and ChatGPT enterprise.

IMHO, local LLMs still can't compete on quality and speed.

https://azure.microsoft.com/en-us/products/ai-services/opena...

https://openai.com/index/introducing-chatgpt-enterprise/