←back to thread

Ask HN: What are some good APIs to interact with large language models?

16 points yangikan | 1 comments | 19 Oct 24 00:39 UTC | HN request time: 0.216s | source

I am looking to do simple things like image classification/text classification using APIs without running the LLMs in my local machine. What are some APIs that provide a uniform interface to access different LLMs?
1. emmanueloga_ ◴[19 Oct 24 13:38 UTC] No.41887706[source]▶
Going through middle layers has pros and cons. You'll likely find better docs and experience by going through the official APIs directly. Maybe start with OpenAI and/or Claude official libraries, both provide pretty good docs.

If you really must use a wrapper, a strategy I use is to look into open-source apps I like and see what they are using. Aider for instance seems to be using this "litellm" thing... If I were to need cross API support for AI, I would probably look into that [1]. llm uses opeanai directly [2]. Etc, etc.

--

1: https://github.com/Aider-AI/aider/blob/e76704e261647348fd7c1...

2: https://github.com/simonw/llm/blob/d654c9521235a737e59a4f1d7...