Comment by ServerHunter

Custom crawlers, API implementations and lots of automation. Like most search engines, it's not flawless, but it's getting better every day. :)