←back to thread

189 points docmechanic | 4 comments | | HN request time: 2.364s | source
1. WalterBright ◴[] No.43657035[source]
> One core block is syntax, where meaningful units are combined into longer sequences, like words into sentences.

I would think that syntax is a structure to the sequence of symbols, not just a sequence in any order. For example:

    Thag ate Fish
    Fish ate Thag
have different meanings.
replies(2): >>43657113 #>>43657889 #
2. HarHarVeryFunny ◴[] No.43657113[source]
Syntax is hierarchical, and not as much sequential as you may think. LLMs are based on these two facts.
replies(1): >>43661661 #
3. somenameforme ◴[] No.43661661[source]
I think your sentence would be much more accurate if you replace hierarchical with recursive.
replies(1): >>43663666 #
4. HarHarVeryFunny ◴[] No.43663666{3}[source]
True, at least conceptually (does brain actually do recursion?) - I was really thinking of linguist's hierarchical sentence parse trees, which are a nice visual representation of how different parts of sentence are syntactically unrelated and can therefore be processed in parallel, with levels of the "hierarchy" then corresponding to layers of the LLM.