Comment by selfhoster11

Please add Internet Archive's bot to your auto-allows, at least. Their bot is presumably well behaved, and for public benefit.