Useful archiving efforts and other projects to help out with:HIGH priority (If you don't help archive these automatically, the data will probably be lost forever):1. http://warrior.archiveteam.org/Help out automatically archive things being shut down right now by running ArchiveTeam Warrior program (or specific containers) in the background:Requirements: Few GB of space, some bandwidth and small amount of CPU power, more info: https://wiki.archiveteam.org/index.php/ArchiveTeam_WarriorIf you learn that a site or any online data is in danger of shutting down, read through this page and contact ArchiveTeam on their IRC if required in order to have it archived: https://wiki.archiveteam.org/index.php/Projects2. Help out automatically forward URLs you browse that are not archived on https://archive.org to them for archival with a browser extension:https://github.com/internetarchive/wayback-machine-webextension
MEDIUM priority (Important overall)3. Seed torrents for as long as possible, rare data forever. Make sure to look up a guide for your router to PORT FORWARD your torrent client port, to substantially increase your upload (and your download) speed. In low population torrent swarms, if no one is port forwarded then you might not be able to connect to each other at all and exchange any data despite having it.Requirements: As much or as little bandwitdh you want (you can set the limits if you need to)https://github.com/qbittorrent/qBittorrent (Recommended client, especially to replace uTorrent)4. Archive web pages you want to have a local copy of with a "Web Extension for saving a faithful copy of a complete web page in a single HTML file with a single click"https://github.com/gildas-lormeau/SingleFile5. Archive videos with "GUI front-end for youtube-dl, yt-dlp and other compatible video downloaders"https://github.com/axcore/tartube6. "Capture or record any area of your screen and share it with a single press of a key"https://github.com/ShareX/ShareX7. Archive entire websites you want to have a local copy ofhttps://www.httrack.com/ (not sure if there is anything better than this)8. Publish the data that you have archived that isn't easily or at all available online. The easiest way is uploading it to https://archive.org. Once uploaded and edited to what you want, you can download the .torrent file archive.org will automatically always create for all items. This torrent can then be seeded and shared with a magnet link anywhere.You can also just create torrents yourself in your torrent client and, as long as DHT (Distributed Hash Table, decentralized way to share torrents without the need for any specific tracker) is enabled in settings (on by default), your files will be searchable on DHT by DHT crawlers, local or online (for example https://btdig.com/, where you can actually also search for FILE NAMES within all DHT torrents)
OTHER useful things:- In your torrent client settings add the best trackers to be automatically added for all of your newly added torrents (helps more easily connect to peers, especially in obscure torrents):https://github.com/ngosang/trackerslist- Look into running a node for I2P (anonymous private network within the global internet):Requirements: Mostly bandwidth, more info: https://geti2p.net/en/faqhttps://geti2p.net/- Look into running Tor/Hyphanet(Freenet)/IPFS nodes.- "A self-hosted BitTorrent indexer, DHT crawler, content classifier and torrent search engine with web UI"https://github.com/bitmagnet-io/bitmagnet- "ArchiveBox is a powerful, self-hosted internet archiving solution to collect, save, and view websites offline"https://github.com/ArchiveBox/ArchiveBox - Look into donating your PC resources to be used more intensively in projects:BOINC (Berkeley Open Infrastructure for Network Computing: https://boinc.berkeley.edu/projects.phpGIMPS (Great Internet Mersenne Prime Search): https://www.mersenne.org/- Additional tools: https://github.com/iipc/awesome-web-archiving
- Additional links to archiving and similar communities:https://wiki.archiveteam.org/index.php/Archiveteam:IRChttps://www.reddit.com/r/Archiveteamhttps://www.reddit.com/r/lostmediahttps://www.reddit.com/r/DataHoarderhttps://www.reddit.com/r/GamePreservationistshttps://www.reddit.com/r/torrentshttps://www.reddit.com/r/qBittorrenthttps://boards.4chan.org/tWhat are you archiving or want to archive?Do you have or know anyone who has some rare interesting data or media not available online?
am i retarded for not capable of finding torrent download link for individual book in annas-archive?. they just keeps giving me slow ass direct download link unless i pay up. unlike in libgen i can copy the magnets right away.it really makes me question my decision few months back to use about 4TB of my seedbox to seed their torrents.
>>101377266>torrent download link for individual bookSeems quite inefficient (costly) to share every book as separate torrent by default.For most books that aren't too obscure you can find other links in external downloads, including to libgen sometimes.>makes me question my decision few months back to use about 4TB of my seedbox to seed their torrentsThey can either save hundreds of terabytes of data for everyone and be able to much more easily archive all of the books and share the archive, or they can make each book easily and separately downloadable, so compressing things heavily for archiving makes sense here.Most of the books are either available in many other places so it's not a problem to get them rather easily or they are very obscure in which case even "wasting" a few GB to download a specific archive torrent they are in shouldn't be too big of a deal.A solid resource here is also https://btdig.com/ where you can search for file names within all DHT torrents.
Bump, I love initiatives like these. I've been hoarding data here and there. BUMP
>>101376437>>101376438Tartube has to be the best thing ever holy shit
>>101378198yeah i guess i have to copy the book md5 then put it in libgen to get the single magnet link.annas-archive has the book collection / personal list and i've been hooked with that feature