Comment

Comment by jetrink

> We’ve indexed over 100 million pages

> [W]e’re crawling up to a million pages a day, as you can see on our stats page.

> Given that Mwmbl is still relatively unknown, it seems plausible that we can reach our target of crawling three billion pages a day, to refresh the entire index in one month.

I think this is supposed to read "it seems plausible that we can reach our target of crawling three million pages a day."

parent jetrink 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton