the guide linked in the Readme is comprehensive and a good read - also gives instructions on who to scale and distribute load.
If the author can answer: how big did the fulltext table became for x entries on wiby.me - and what is a common response time on N amount of searches per minute for this dataset?
Would you offer a /traffic or /stats page within about/ ? duckduckgo shows traffic, not index stats though.
I don't see it in the windex schema yet, but would be interesting what the actual hitrate is on a search corpus, how many clickthroughs there are for any used search term. Answering these kind of questions adds computation and record keeping though.
Thanks for open sourcing, it's an interesting mix of languages and tools!
If the author can answer: how big did the fulltext table became for x entries on wiby.me - and what is a common response time on N amount of searches per minute for this dataset?
Would you offer a /traffic or /stats page within about/ ? duckduckgo shows traffic, not index stats though.
I don't see it in the windex schema yet, but would be interesting what the actual hitrate is on a search corpus, how many clickthroughs there are for any used search term. Answering these kind of questions adds computation and record keeping though.
Thanks for open sourcing, it's an interesting mix of languages and tools!