←back to thread

LLM Visualization

(bbycroft.net)
638 points gmays | 1 comments | | HN request time: 0.206s | source
Show context
its-kostya ◴[] No.45134378[source]
Fascinating visualization. To think, we can visualize the entire* process but cannot understand the inner workings of a model with regards to decision making. This was true last I looked into it a year or so ago, not aware on any advancements in that aspect.
replies(1): >>45136373 #
xwolfi ◴[] No.45136373[source]
We completely understand the inner workings and can see the emerging result, but it's hard for us to accept that it took no decision and just chose a nice word to complete a sentence, time after time, and sounds intelligent. Then it says Strawberry has two r, and you're like ok, it's just a huge statistical matrix with zero value.
replies(1): >>45136767 #
baq ◴[] No.45136767[source]
Hammers have zero value when you’re trying to cook food with them, too.
replies(2): >>45136912 #>>45139452 #