←back to thread

216 points Philpax | 1 comments | | HN request time: 0.258s | source
1. espadrine ◴[] No.42171106[source]
> Furthermore, by rotating the vector, we have absolutely zero impact on the norm of the vector, which encodes the semantic information of our token.

Doesn’t the angle encode semantic information? Cosine similarity works for embeddings after all.