←back to thread

LLM Visualization

(bbycroft.net)
638 points gmays | 1 comments | 04 Sep 25 18:06 UTC | HN request time: 0.203s | source
Show context
southp ◴[05 Sep 25 08:20 UTC] No.45136237[source]▶
It's fascinating, even though my knowledge to LLM is so limited that I don't really understand what's happening. I'm curious how the examples are plotted and how much resemblance they are to the real models, though. If one day we could reliably plot a LLM into modules like this using an algorithm, does that mean we would be able to turn LLMs into chips, rather than data centers?
replies(5): >>45136340 #>>45136985 #>>45136988 #>>45137239 #>>45166151 #
1. southp ◴[08 Sep 25 09:12 UTC] No.45166151[source]▶
I'm new in this area and I've learned a lot from the replies. Thanks for sharing, folks :) Just to clarify, when I said "to turn LLMs into chips", I didn't mean to run it on CPU/GPU/TPU or any general purpose computing units, but to hardwire the entire LLM as a chip. Rethinking about it, the answer is likely yes since it's serializable. However, given how fast the models are evolving, the business value might be quite dim at the moment.