←back to thread

358 points andrewstetsenko | 4 comments | | HN request time: 3.229s | source
Show context
taysix ◴[] No.44360808[source]
I had a fun result the other day from Claude. I opened a script in Zed and asked it to "fix the error on line 71". Claude happily went and fixed the error on line 91....

1. There was no error on line 91, it did some inconsequential formatting on that line 2. More importantly, it just ignored the very specific line I told it to go to. It's like I was playing telephone with the LLM which felt so strange with text-based communication.

This was me trying to get better at using the LLM while coding and seeing if I could "one-shot" some very simple things. Of course me doing this _very_ tiny fix myself would have been faster. Just felt weird and reinforces this idea that the LLM isn't actually thinking at all.

replies(4): >>44360819 #>>44360879 #>>44360917 #>>44363593 #
klysm ◴[] No.44360819[source]
LLMs probably have bad awareness of line numbers
replies(4): >>44360870 #>>44362858 #>>44368342 #>>44375001 #
1. mcintyre1994 ◴[] No.44360870[source]
I suspect if OP highlighted line 71 and added it to chat and said fix the error, they’d get a much better response. I assume Cursor could create a tool to help it interpret line numbers, but that’s not how they expect you to use it really.
replies(1): >>44361092 #
2. recursive ◴[] No.44361092[source]
How is this better from just using a formal language again?
replies(1): >>44361793 #
3. svachalek ◴[] No.44361793[source]
Who said it's better? It's a design choice. Someone can easily write an agent that takes instructions in any language you like.
replies(1): >>44362395 #
4. recursive ◴[] No.44362395{3}[source]
The current batch of AI marketing.