I highly recommend playing with embeddings in order to get a stronger intuitive sense of this. It really starts to click that it's a representation of high dimensional space when you can actually see their positions within that space.
replies(1):
You mean that LLMs are more than just the matmuls they're made up of, or that that is exactly what they are and how great that is?
Was just confusing because your phrasing implied different.
Your antagonistic attitude is not productive nor playful. Lighten up, friend.
I'm sure there are people who can always reliably respond with kindness despite being handed condescension. As you can probably tell by now, I'm not one of those.