Ask HN: how to ban aggressive web crawlers

They don't respect robot.txt. They have hundreds of different IP addresses. Sometimes they hit our server heavily, so it's easy to spot. But most of the time they maintain a well designed crawling speed such that they won't be easily detected.

Are there any solutions to ban bad bots?