Comment by PatchRequest

I manually blacklisted .gov from being crawled on my side. felt like it wasn't worth the potential trouble