LLM Visualization

I wish n-gate was still around. He would note the high vote to comment ratio. When HN has little to say, it's always a sign of a high quality very technical article.

On a more serious note, this highlights a deeper issue with HN, similar sites and the attention economy. When an article takes a lot of time to read:

- The only people commenting at first have no read it.

- By the time you are done reading it, it's no longer visible on the front page so new people are not coming in anymore and the discussion appears dead. This discourages people who read it from making thoughtful comments because few people will read it.

- There are people who wait for the discussion to die down so they can read it without missing the later thoughtful comments but they are discouraged from participating earlier while the discussion is alive because then they'd have to wade through the constantly changing discussion and separate what they have already seen from what they haven't.

---

Back on topic, I'd love to see this with weights from an actual working model and a customizable input text so we could see how both the seed and input affects the output. And also a way to explore vectors representing "meanings" the way 3blue1brown did in his LLM videos.

With weights on an actual model:

https://youtu.be/KSovbSkARYw

"Adding numbers. the green line are the weights.

At the top: the red circle indicates an incorrect answer. the green circle indicates a correct answer.

As the NN learns, the weights adjust and the green circle appears more often. "