←back to thread

LLMs understand nullability

(dmodel.ai)
169 points mattmarcus | 1 comments | 07 Apr 25 14:52 UTC | HN request time: 0s | source
Show context
plaineyjaney ◴[07 Apr 25 16:11 UTC] No.43613063[source]▶
This is really interesting! Intuitively it's hard to grasp that you can just subtract two average states and get a direction describing the model's perception of nullability.
replies(1): >>43613461 #
1. nick__m ◴[07 Apr 25 16:52 UTC] No.43613461[source]▶
The original word2vec example might be easier to understand:

  vec(King) - vec(Man) + vec(Woman) = vec(Queen)