←back to thread

425 points sfarshid | 2 comments | | HN request time: 0s | source
Show context
bwestergard ◴[] No.45005722[source]
There are always two major results from any software development process: a change in the code and a change in cognition for the people who wrote the code (whether they did so directly or with an LLM).

Python and Typescript are elaborate formal languages that emerged from a lengthy process of development involving thousands of people around the world over many years. They are non-trivially different, and it's neat that we can port a library from one to the other quasi-automatically.

The difficulty, from an economic perspective, is that the "agent" workflow dramatically alters the cognitive demands during the initial development process. It is plain to see that the developers who prompted an LLM to generate this library will not have the same familiarity with the resulting code that they would have had they written it directly.

For some economic purposes, this altering of cognitive effort, and the dramatic diminution of its duration, probably doesn't matter.

But my hunch is that most of the economic value of code is contingent on there being a set of human beings familiar with the code in a manner that requires writing having written it directly.

Denial of this basic reality was an economic problem even before LLMs: how often did churn in a development team result in a codebase that no one could maintain, undermining the long-term prospects of a firm?

replies(7): >>45008527 #>>45008857 #>>45009017 #>>45010970 #>>45011357 #>>45012926 #>>45013799 #
doug_durham ◴[] No.45009017[source]
I wonder though. One of the superpowers of LLMs is code reading. I say the tools are better and reading than writing. It is very easy to get comprehensive documentation for any code base and get understanding by asking questions. At that point does it matter that there is a living developer who understands the code? If an arbitrary person with knowledge of the technology stack can get up to speed quickly is it important to have the original developers around any more?
replies(5): >>45009530 #>>45010194 #>>45011428 #>>45014861 #>>45017628 #
gf000 ◴[] No.45011428[source]
Well, according to the recently linked Naur paper, the mental model for a codebase includes just as much what code wasn't written, as much what was - e.g. a decision to do this design over another, etc. This is not recoverable by AI without every meeting note and interaction between the devs/clients/etc.
replies(1): >>45012517 #
1. lordnacho ◴[] No.45012517[source]
Not for an old project, but if you've talked AI through building something, you've also told it "nah let's not change the interface" and similar decisions, which will sit in the context.
replies(1): >>45017718 #
2. closeparen ◴[] No.45017718[source]
The transcript of LLM interactions that generated code changes are not normally checked in with the code. Perhaps they should be!