←back to thread

276 points Fendy | 7 comments | | HN request time: 0s | source | bottom
Show context
resters ◴[] No.45170203[source]
By hosting the vectors themselves, AWS can meta-optimize its cloud based on content characteristics. It may seem like not a major optimization, but at AWS scale it is billions of dollars per year. It also makes it easier for AWS to comply with censorship requirements.
replies(3): >>45170388 #>>45170758 #>>45173752 #
barbazoo ◴[] No.45170388[source]
> It also makes it easier for AWS to comply with censorship requirements.

Does it, how? Why would it be the vector store that would make it easier for them to censor the content? Why not censor the documents in S3 directly, or the entries in the relational database. What is different about censoring those vs a vector store?

replies(1): >>45170514 #
1. resters ◴[] No.45170514[source]
Once a vector has been generated (and someone has paid for it) it can be searched for and relevant content can be identified without AWS incurring any additional cost to create its own separate censorship-oriented index, etc. AWS can also add additional bits to the vector that benefit its internal goals (scalability, censorship, etc.)

Not to mention there is lock-in once you've gone to the trouble of using a specific embedding model on a bunch of content. Ideally we'd converge on backwards-compatible, open source approaches, but cloud vendors want to offer "value" by offering "better" embedding models that are not open source.

replies(4): >>45170544 #>>45170605 #>>45170776 #>>45173764 #
2. barbazoo ◴[] No.45170544[source]
And that doesn't apply to any other database/search technology AWS offers?
replies(1): >>45170705 #
3. simonw ◴[] No.45170605[source]
Why would they do that? Doesn't sound like something that would attract further paying customers.

Are there laws on the books that would force them to apply the technology in this way?

replies(1): >>45170716 #
4. resters ◴[] No.45170705[source]
It does to some but not to most of it, which is why Azure and GCP offer nearly the exact same core services.
5. resters ◴[] No.45170716[source]
Not official laws that we can read, but things like that are already in place per the Snowden revelations.
6. whakim ◴[] No.45170776[source]
Regardless of the merits of this argument, dedicated vector databases are all running on top of AWS/GCP/Azure infrastructure anyways.
7. ◴[] No.45173764[source]