Comment Comment by EffCompute Quick update:I've been iterating on the approach and managed to push the coarse search further.Currently seeing ~100M vectors scanned in ~10ms on a single RTX 3090 (binary stage only).Still experimenting with trade-offs between speed and recall, but it's interesting how far this can go on consumer hardware.Curious what kind of numbers others are seeing for large-scale vector search on GPUs. parent EffCompute 7 months ago
I've been iterating on the approach and managed to push the coarse search further.
Currently seeing ~100M vectors scanned in ~10ms on a single RTX 3090 (binary stage only).
Still experimenting with trade-offs between speed and recall, but it's interesting how far this can go on consumer hardware.
Curious what kind of numbers others are seeing for large-scale vector search on GPUs.