←back to thread

214 points Brajeshwar | 1 comments | | HN request time: 0.204s | source
Show context
Rochus ◴[] No.45090991[source]
The article claims, that senior developers with over 10 years of experience are more than twice as likely to heavily rely on AI tools compared to their junior counterparts. No p-values or statistical significance tests are reported in either The Register article or Fastly's original blog post.

I have over 30 years of experience and recently used Claude Opus 4.1 (via browser and claude.ai) to generate an ECMA-335 and an LLVM code generator for a compiler, and a Qt adapter for the Mono soft debugging protocol. Each task resulted in 2-3kLOC of C++.

The Claude experience was mixed; there is a high probability that the system doesn't respond or just quickly shows an overloaded message and does nothing. If it generates code, I quckly run in some output limitation and have to manually press "continue", and then often the result gets scrambled (i.e. the order of the generated code fragments gets mixed up, which requires another round with Claude to fix).

After this process, the resulting code then compiled immediately, which impressed me. But it is full of omissions and logical errors. I am still testing and correcting. All in all, I can't say at this point that Claude has really taken any work off my hands. In order to understand the code and assess the correctness of the intermediate results, I need to know exactly how to implement the problem myself. And you have to test everything in detail and do a lot of redesigning and correcting. Some implementations are just stubs, and even after several attempts, there was still no implementation.

In my opinion, what is currently available (via my $20 subscription) is impressive, but it neither replaces experience nor does it really save time.

So yes, now I'm one of the 30% seniors who used AI tools, but I didn't really benefit from them in these specific tasks. Not surprisingly, also the original blog states, that nearly 30% of senior developers report "editing AI output enough to offset most of the time savings". So not really a success so far. But all in all I'm still impressed.

replies(5): >>45091343 #>>45091757 #>>45092344 #>>45092985 #>>45099223 #
epolanski ◴[] No.45092344[source]
Imho your post summarizes 90% of the posts I see about AI coding on HN: not understanding the tools, not understanding their strenghts and weaknesses, not being good at prompting or context management yet forming strong(ish) opinions.

If you don't know what they are good at and how to use them of course you may end up with mixed results and yes, you may waste time.

That's a criticism I have also towards AI super enthusiasts (especially vibe coders, albeit you won't find much here), they often confuse the fact that LLMs often one shot 80% of the solutions with the idea that LLMs are 80% there, whereas the Pareto principle well applies to software development where it's the hardest 20% that's gonna prove difficult.

replies(4): >>45092402 #>>45092707 #>>45099984 #>>45137386 #
1. Sebalf ◴[] No.45137386[source]
Vibe coder that reads hacker news chiming in here. I think that the true usefullness of LLMs for coding is often lost on the usual audience of this website, because most people here have extremely high standards of what they expect LLMs to accomplish.

But take people like me, I am an MD who was always into computers, but that just ended up going down a separate series of life decision, and could never find the time or energy to actually learn to code. When GPT-4 arrived, I started trying out using it for a medically-related coding hobby project, which eventually escalated into an ongoing PhD. Now, the fact is that this whole thing would just never have happened without LLMs. I would have never even thought of starting such a project, and if I did I wouldn't have had the time, and would have never made any progress even if I did. Vibe coding enabled me to do something entirely outside the scope of my previous capabilities. And the reality is that if I hadn't been able to do everything myself (down to the point of installing hardware managing the servers I am using), the project as a whole just wouldn't have happened.

The code I produce isn't going into production anywhere, it is only used for my particular purposes, it is not exposed to the web in any way, and so typical LLM issues like security etc. are a non-issue. And while my understanding of what my code is actually doing is pretty rudimentary (for instance, basic syntax conventions is something I just never bothered to learn), this doesn't really matter in practice. If it works it works.