←back to thread

Recent AI model progress feels mostly like bullshit

(www.lesswrong.com)
579 points paulpauper | 3 comments | 06 Apr 25 18:01 UTC | HN request time: 0s | source
Show context
maccard ◴[06 Apr 25 19:12 UTC] No.43604081[source]▶
My experience as someone who uses LLMs and a coding assist plugin (sometimes), but is somewhat bearish on AI is that GPT/Claude and friends have gotten worse in the last 12 months or so, and local LLMs have gone from useless to borderline functional but still not really usable for day to day.

Personally, I think the models are “good enough” that we need to start seeing the improvements in tooling and applications that come with them now. I think MCP is a good step in the right direction, but I’m sceptical on the whole thing (and have been since the beginning, despite being a user of the tech).

replies(1): >>43612021 #
sksxihve ◴[07 Apr 25 14:36 UTC] No.43612021[source]▶
The whole MCP hype really shows how much of AI is bullshit. These LLMs have consumed more API documentation than possible for a single human and still need software engineers to write glue layers so they can use the APIs.
replies(2): >>43612217 #>>43613458 #
1. machiaweliczny ◴[07 Apr 25 14:53 UTC] No.43612217[source]▶
Because it’s lossy compression. I also consumed a lot of books and even more movies and I don’t have good memory of it all. But some core facts and intuition from it.
replies(1): >>43612364 #
2. sksxihve ◴[07 Apr 25 15:04 UTC] No.43612364[source]▶
AI is far better at regurgitating facts than me even if it's lossy compression but if someone gives me an api doc I can figure out how to use it without them writing a wrapper library around the parts that I need to use to solve whatever problem I'm working on.
replies(1): >>43613589 #
3. maccard ◴[07 Apr 25 17:02 UTC] No.43613589[source]▶
> but if someone gives me an api doc I can figure out how to use it without them writing a wrapper library around the parts that I need to use to solve whatever problem I'm working on.

I think this is where AI is faling short hugely. AI _should_ be able to integrate with IDEs and tooling (e.g. LSP, Treesitter, Editorconfig) to make sure that it's contextually doing the right thin.

But it's not.