generall

Joined 6 years ago

Karma
59
Submissions
33
Member since
Feb 15
Hi, it's Andrey

I'm a Machine Learning Engineer. I prefer practical over theoretical, working demo over arXiv paper.

View on Hacker News

Recent submissions

Comment · 1 year ago
In this scenario posting list have to share all the same attributes as each element inside the list.
Comment · 1 year ago
In IVF you can start checking conditions only in the final bucket. There are no guarantees if the bucket has any acceptable value, and there are no procedures to find the bucket which has acceptable values before scanning it.
Comment · 1 year ago
IVF, unfortunately, is barely compatible with filtered search. It have to rely on post-filtering and retrieve more and more candidates if the result set is not big enough. If the query is in some form correlated with the filter, this approach quickly degrades to brute-force.

Surprised that the article doesn't mention filtering use-case at all.

Comment · 2 years ago
https://qdrant.tech/articles/dedicated-service/ - we have some arguments on this
Comment · 3 years ago
This article contains a lot of inaccuracies.

Based on your statements, like

> Qdrant stores both the vectors and the metadata in a sqlite database.

It looks like you have benchmarked local mode of qdrant. It doesn't even use vector indexes and is not designed for any kind of production usage.

For anyone reading this article, I urge you to do your own benchmarks and not rely on claims that do not have open source code attached to them to replicate the results

Comment · 3 years ago
With a few optimization tricks, TL;DR: - ONNX inference in Rust - Embeddings cache & lookup - Parallel & Batch requests - hybrid search with full-text filtering + vector re-scoring
Comment · 3 years ago
I would say that text text and vector search are orthogonal. Some scenarios are better with one, others with combination. But fitting vector search into the interface designed for text is limiting vector search potential
Comment · 3 years ago
Benchmark is open source - https://github.com/qdrant/vector-db-benchmark You are welcome to fork it and make your own measurements, if you suspect something.

Benchmarks like https://big-ann-benchmarks.com/index.html#organizers are good for comparing algorithms, but not engines. They are focused on a single use scenario and do not cover variety of possible applications. Like, for example, how filtering affect the performance.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton