Comment Comment by DarkLinkXXXX Agreed. Do you think maybe these datasets should include checksums so that they might be recovered with more certainty, from less obvious sources?P.S.: Also, archive.org retroactively removes (or delists?) site content when blocked by robots.txt, as domain parkers often do, so I could see that causing trouble down the line. https://archive.org/post/1019415/retroactive-robotstxt-remov... parent DarkLinkXXXX 10 years ago
P.S.: Also, archive.org retroactively removes (or delists?) site content when blocked by robots.txt, as domain parkers often do, so I could see that causing trouble down the line. https://archive.org/post/1019415/retroactive-robotstxt-remov...