Comment by shakna

I may have a system in place that starts the pipeline for fetching a very, very large file (16TB, text file designed for testing). Not hosted by myself, except the first shard.

A surprising number of agents try to download the whole thing.