Comment Comment by opwizardx I did similar tests on my own corpus when was considering whether to keep semantic search in default path for pond.On 3 months of my own sessions I’ve seen that BM25 search was finding the correct answer in ~61%, where semantic had shown only ~37% of success.After that it was easy for me to make the decision.Got all info on how I did evals in here, if interested: https://github.com/tenequm/pond/tree/main/docs/researches/26... parent opwizardx 1 month ago
On 3 months of my own sessions I’ve seen that BM25 search was finding the correct answer in ~61%, where semantic had shown only ~37% of success.
After that it was easy for me to make the decision.
Got all info on how I did evals in here, if interested: https://github.com/tenequm/pond/tree/main/docs/researches/26...