←back to thread

129 points ericciarla | 2 comments | | HN request time: 0s | source
Show context
laborcontract ◴[] No.40713024[source]
I really like the stuff coming from Cohere.

I know they're not considered the leader in the foundational model space, but their developer documentation is great, their api is really nice to use, and they have a set of products that really differentiate themselves from OpenAI and Anthropic and others. I'm rooting for the success of this company.

That said, we as an industry need to be moving away from langchain, not more deeply embedding ourselves in that monstrosity. It’s just way too much of its own thing now and you can totally start to see how the VC funding is shaping their incentives. They put everyone who uses it in a position of massive technical debt, create more abstractions like langgraph to lock people into their tools and then and then create paid tools on top of it to solve the problems that they created (langsmith).

replies(3): >>40713141 #>>40713385 #>>40714751 #
esafak ◴[] No.40713385[source]
Do you use another library instead?
replies(2): >>40714350 #>>40714608 #
1. laborcontract ◴[] No.40714350[source]
From the tooling perspective I’ve built my own.

Recently, I've been toying around with litellm which, so far, strikes me as the right level of abstraction. I like building my own stuff but writing api wrappers just suck.

I’ve also been toying around with Instructor for structured output as well. It’s incredibly convenient, but I haven’t used it for any production stuff because I don’t feel comfortable with the prompting aspect yet.

replies(1): >>40714969 #
2. vinhnx ◴[] No.40714969[source]
+1 for LiteLLM as well, I've been experimenting with LiteLLM for integrating multiple LLM providers and building my own AI chatbot, which is evolving into a multimodal AI chatbot. It's been a positive experience so far. [0]

On the other hand, I found Langchain less impressive. It feels somewhat vague and not very beginner-friendly, catering more to intermediate users.

[0] https://github.com/vinhnx/VT.ai