suramya_tomar
Joined 9 years ago
Joined 9 years ago
I found https://github.com/ArchiveBox/ArchiveBox/ which is a self hosted web archiving system. It covers most of my usecases (and I can extend it for additional functionality) so I am going to set this up and try it out.
Thanks all for the help.
I wanted something that I could kick-off as a daily cron job.
There is no alert etc generated just a message in the interface that sync is not complete.
Reminded me of: https://iea.org.uk/wp-content/uploads/2021/12/mister-gotcha-...
In this case it is addressing a large chunk of the problems. Once that is done we can always revisit other ways folks are spamming the system.
Actually, you don't need to manage certificates when we access sites over https as that is done on the server side. You just need to ensure that you are using the latest version of the SSL libraries when compiling systems.
Even then, most certificate providers give you ways to update certificates quickly and easily. If you do it correctly then you would only need to update them once a year. (you can set this to a longer duration)
- Suramya
They didn't randomly pickup dirt from the base of the pyramid and date it as you seem to be implying, they used the standard method of taking core samples at various depths to find the dates of the various layers of the pyramid. Based on that they made the claim.
I have been using it to sync photos and other data from Phone -> Desktop for a few years now and it works fantastically.
Personally, I think storing data on an external Harddrive is the most stable option. You can keep upgrading the setup as required and the bit rot is minimal.
I backup my data on multiple drives, along with redundant copies stored in multiple locations.
I have heard good things about Tapes as well but have no personal experience with them.
You can switch between the two if you want, and can configure it to be the default.
wget --mirror --convert-links --adjust-extension --page-requisites --no-parent https://site-to-download.com
So not sure what you mean by there are no tools available to mirror a website.
From the outside, it seems like an easy problem to solve but with all the multiple domains and the way federation itself works there is no quick/easy fix that doesn't bring other assorted problems into play
I do have to search for the account on my local instance to start following them instead of being able to click follow right there, but that is a minor annoyance
My blog (http://www.suramya.com/blog) is more frequently updated.