> has been upwards of 15 queries per second from bots
What type of queries are they generating? For what purpose are querying Marginalia? Scraping and filling internal search engines?
> If anyone could go ahead and find a solution to this mess
I would maybe trying to investigate why are querying your search engine. Is for the search results? Maybe from there you can create and sell an API service. Is for the wiki? Is for research purpose?
I would love to see some data, raw or with some behavior derived from it.
What type of queries are they generating? For what purpose are querying Marginalia? Scraping and filling internal search engines?
> If anyone could go ahead and find a solution to this mess
I would maybe trying to investigate why are querying your search engine. Is for the search results? Maybe from there you can create and sell an API service. Is for the wiki? Is for research purpose?
I would love to see some data, raw or with some behavior derived from it.