Comment Comment by toomuchtodo Could they not run webhooks where my site can call to them when to do a full or partial crawl? PubSub for web crawling, if you will. parent toomuchtodo 13 years ago