←back to thread

169 points mattmarcus | 1 comments | | HN request time: 0.289s | source
Show context
sega_sai ◴[] No.43613291[source]
One thing that is exciting in the text is an attempt to go away from describing whether LLM 'understands' which I would argue an ill posed question, but instead rephrase it in terms of something that can actually be measured.

It would be good to list a few possible ways of interpreting 'understanding of code'. It could possibly include: 1) Type inference for the result 2) nullability 3) runtime asymptotics 4) What the code does

replies(2): >>43613930 #>>43613939 #
1. kazinator ◴[] No.43613930[source]
5) predicting a bunch of language tokens from the compressed database of knowledge encoded as weights, calculated out of numerous examples that exploit nullability in code and talk about it in accompanying text.