←back to thread

Embeddings are underrated (2024)

(technicalwriting.dev)
484 points jxmorris12 | 1 comments | 12 May 25 15:05 UTC | HN request time: 0.196s | source
Show context
minimaxir ◴[12 May 25 16:29 UTC] No.43964828[source]▶
> I don’t know. After the model has been created (trained), I’m pretty sure that generating embeddings is much less computationally intensive than generating text.

An embedding is generated after a single pass through the model, so functionally it's the equivalent of generating a single token from an text generation model.

replies(2): >>43965007 #>>43969096 #
1. kaycebasques ◴[13 May 25 02:02 UTC] No.43969096[source]▶
Will update the post to capture that interesting tidbit, thanks

And also, thanks for this post! https://minimaxir.com/2025/02/embeddings-parquet/