←back to thread

Production RAG: what I learned from processing 5M+ documents

(blog.abdellatif.io)
548 points tifa2up | 1 comments | 20 Oct 25 15:55 UTC | HN request time: 0.494s | source
Show context
leetharris ◴[20 Oct 25 17:05 UTC] No.45646303[source]▶
Embedding based RAG will always just be OK at best. It is useful for little parts of a chain or tech demos, but in real life use it will always falter.
replies(6): >>45646470 #>>45646482 #>>45646495 #>>45646758 #>>45646892 #>>45656450 #
1. DSingularity ◴[21 Oct 25 14:43 UTC] No.45656450[source]▶
Super useful for grounding which is often the only way to robustly protect against hallucinations.