←back to thread

LLM Visualization

(bbycroft.net)
638 points gmays | 1 comments | 04 Sep 25 18:06 UTC | HN request time: 0s | source
Show context
weego ◴[05 Sep 25 12:23 UTC] No.45137701[source]▶
I have a related question I guess, it relates to how I can visualise the foundations of this beyond just a code implementation.

Where does this come from in abstract/math? Did we not have it before, or did we just not consider it an avenue to go into? Or is it just simply the idea of scraping the entirety of human knowledge was just not considered until someone said "well, we could just scrape everything?"

Were there recent breakthroughs from what we've understood about ML that have lead to this current explosion of research and pattern discovery and refinement?

replies(2): >>45137929 #>>45140309 #
1. blahgeek ◴[05 Sep 25 16:20 UTC] No.45140309[source]▶
I think it’s two fold: the evolution of hardware (GPUs) that give us enough compute power, and the invention of novel algorithms (transformer) that can effectively consume and understand all these data.