I highly recommend playing with embeddings in order to get a stronger intuitive sense of this. It really starts to click that it's a representation of high dimensional space when you can actually see their positions within that space.
replies(1):
You mean that LLMs are more than just the matmuls they're made up of, or that that is exactly what they are and how great that is?
It's been a wake up call for me to see how many people in the tech space have such strong emotional reactions to any notions of trying to bring discourse about LLMs down from the clouds.
The campaigns by the big AI labs have been quite successful.
But let me substantiate before you (rightly) accuse me of just posting a shallow dismissal.
> They don't want to.
Who's they? How could you possibly know? Are you a mind reader? Worse, a mind reader of the masses?
> It seems a lot of people are uncomfortable and defensive about anything that may demystify LLMs.
That "it seems" is doing some serious work over there. You may perceive and describe many people's comments as "uncomfortable and defensive", but that's entirely your own head cannon. All it takes is for someone to simply disagree. It's worthless.
Have you thought about other possible perspectives? Maybe people have strong opinions because they consider what things present as more important than what they are? [0] Maybe people have strong opinions because they're borrowing from other facets of their personal philosophies, which is what they actually feel strongly about? [1] Surely you can appreciate that there's more to a person than what equivalent-presenting "uncomfortable and defensive" comments allow you to surmise? This is such a blatant textbook kneejerk reaction. "They're doing the thing I wanted to think they do anyways, so clearly they do it for the reasons I assume. Oh how correct I am."
> to any notions of trying to bring discourse about LLMs down from the clouds
(according to you)
> The campaigns by the big AI labs have been quite successful.
(((according to you)))
"It's all the big AI labs having successfully manipulated the dumb sheep which I don't belong to!" Come on... Is this topic really reaching political grifting kind of levels?
[0] tangent: if a feature exists but even after you put an earnest effort into finding it you still couldn't, does that feature really exist?
[1] philosophy is at least kind of a thing https://en.wikipedia.org/wiki/Wikipedia:Getting_to_Philosoph...
Was just confusing because your phrasing implied different.
Your antagonistic attitude is not productive nor playful. Lighten up, friend.
I'm sure there are people who can always reliably respond with kindness despite being handed condescension. As you can probably tell by now, I'm not one of those.