←back to thread

276 points Fendy | 1 comments | | HN request time: 0.247s | source
Show context
janalsncm ◴[] No.45172507[source]
S3 vectors has a topK limit of 30, and if you add filters it may be less than that. So if you need something with higher topK you’ll need to 1) look elsewhere or 2) shard your dataset into N shards to get NxK results, which you query in parallel and merge afterwards.

I also didn’t see any latency info on their docs page https://docs.aws.amazon.com/AmazonS3/latest/API/API_S3Vector...

replies(2): >>45173951 #>>45178012 #
1. catlifeonmars ◴[] No.45178012[source]
3) ask TAM for a service quota increase