←back to thread

What to build instead of AI agents

(decodingml.substack.com)
233 points giuliomagnifico | 3 comments | | HN request time: 0.636s | source
Show context
transcriptase ◴[] No.44450515[source]
I love that there are somehow authorities on tech that realistically they could have 1-2 years experience with tops. It’s the reverse of the “seeking coder with 10 years of experience in a 2 year old language” meme.
replies(2): >>44450544 #>>44450763 #
noosphr ◴[] No.44450544[source]
I've been building what's called ai agents since gpt3 came out. There are plenty of other people who did the same thing. That's five years now. If you can't be an expert after 5 years then there is no such thing as experts.

Of course agents is now a buzzword that means nothing so there is that.

replies(7): >>44450574 #>>44450635 #>>44450669 #>>44451016 #>>44451590 #>>44452288 #>>44454512 #
Voloskaya ◴[] No.44452288[source]
“Agent” involves having agency. Calling the GPT-3 API and asking it to do some classification or whatever else your use case was, would not be considered agentic. Not only were there no tools back then to allow an LLM to carry out a plan of its own, even if you had developed your own, GPT-3 still sucked way too much to trust it with even basic tasks.

I have been working on LLMs since 2017, both training some of the biggest and then creating products around them and consider I have no experience with agents.

replies(2): >>44452529 #>>44453334 #
1. nunodonato ◴[] No.44453334[source]
In defense of the previous commenter, I also started with GPT3. I had tool calling and reasoning before chatgpt even came out. So yeah, there was a lot that could be done before the models started integrating it
replies(1): >>44453778 #
2. Voloskaya ◴[] No.44453778[source]
> I had tool calling and reasoning before chatgpt even came out.

Do you know of any kind of write up (by you or someone else) on this topic? Admittedly I never really spent too much time on this since I was working on pre-training, but I did try to do a few smart things with it and it pretty much failed at every thing, in big part because it wasn't even instruction tuned, so was very much still an autocomplete model.

So would be curious to learn more about how people got it to succeeed at agentic behaviors.

replies(1): >>44456677 #
3. nunodonato ◴[] No.44456677[source]
I used to vlog my experiments. Not really a very scientific write up on the topic, mostly just ramblings while experimenting cool stuff