[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip / qa] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: 1712832518851588.png (337 KB, 1497x936)
337 KB
337 KB PNG
Useful archiving efforts and other projects to help out with:

HIGH priority (If you don't help archive these automatically, the data will probably be lost forever):

1. http://warrior.archiveteam.org/
Help out automatically archive things being shut down right now by running ArchiveTeam Warrior program (or specific containers) in the background:
Requirements: Few GB of space, some bandwidth and small amount of CPU power, more info: https://wiki.archiveteam.org/index.php/ArchiveTeam_Warrior

If you learn that a site or any online data is in danger of shutting down, read through this page and contact ArchiveTeam on their IRC if required in order to have it archived: https://wiki.archiveteam.org/index.php/Projects

2. Help out automatically forward URLs you browse that are not archived on https://archive.org to them for archival with a browser extension:
https://github.com/internetarchive/wayback-machine-webextension
>>
MEDIUM priority (Important overall)

3. Seed torrents for as long as possible, rare data forever. Make sure to look up a guide for your router to PORT FORWARD your torrent client port, to substantially increase your upload (and your download) speed. In low population torrent swarms, if no one is port forwarded then you might not be able to connect to each other at all and exchange any data despite having it.
Requirements: As much or as little bandwitdh you want (you can set the limits if you need to)
https://github.com/qbittorrent/qBittorrent (Recommended client, especially to replace uTorrent)

4. Archive web pages you want to have a local copy of with a "Web Extension for saving a faithful copy of a complete web page in a single HTML file with a single click"
https://github.com/gildas-lormeau/SingleFile

5. Archive videos with "GUI front-end for youtube-dl, yt-dlp and other compatible video downloaders"
https://github.com/axcore/tartube

6. "Capture or record any area of your screen and share it with a single press of a key"
https://github.com/ShareX/ShareX

7. Archive entire websites you want to have a local copy of
https://www.httrack.com/ (not sure if there is anything better than this)

8. Publish the data that you have archived that isn't easily or at all available online. The easiest way is uploading it to https://archive.org. Once uploaded and edited to what you want, you can download the .torrent file archive.org will automatically always create for all items. This torrent can then be seeded and shared with a magnet link anywhere.
You can also just create torrents yourself in your torrent client and, as long as DHT (Distributed Hash Table, decentralized way to share torrents without the need for any specific tracker) is enabled in settings (on by default), your files will be searchable on DHT by DHT crawlers, local or online (for example https://btdig.com/, where you can actually also search for FILE NAMES within all DHT torrents)
>>
OTHER useful things:

- In your torrent client settings add the best trackers to be automatically added for all of your newly added torrents (helps more easily connect to peers, especially in obscure torrents):
https://github.com/ngosang/trackerslist

- Look into running a node for I2P (anonymous private network within the global internet):
Requirements: Mostly bandwidth, more info: https://geti2p.net/en/faq
https://geti2p.net/

- Look into running Tor/Hyphanet(Freenet)/IPFS nodes.

- "A self-hosted BitTorrent indexer, DHT crawler, content classifier and torrent search engine with web UI"
https://github.com/bitmagnet-io/bitmagnet

- "ArchiveBox is a powerful, self-hosted internet archiving solution to collect, save, and view websites offline"
https://github.com/ArchiveBox/ArchiveBox

- Look into donating your PC resources to be used more intensively in projects:
BOINC (Berkeley Open Infrastructure for Network Computing: https://boinc.berkeley.edu/projects.php
GIMPS (Great Internet Mersenne Prime Search): https://www.mersenne.org/

- Additional tools: https://github.com/iipc/awesome-web-archiving
>>
- Additional links to archiving and similar communities:
https://wiki.archiveteam.org/index.php/Archiveteam:IRC
https://www.reddit.com/r/Archiveteam
https://www.reddit.com/r/lostmedia
https://www.reddit.com/r/DataHoarder
https://www.reddit.com/r/GamePreservationists
https://www.reddit.com/r/torrents
https://www.reddit.com/r/qBittorrent
https://boards.4chan.org/t

What are you archiving or want to archive?
Do you have or know anyone who has some rare interesting data or media not available online?
>>
File: 1720778889708.jpg (131 KB, 828x770)
131 KB
131 KB JPG
am i retarded for not capable of finding torrent download link for individual book in annas-archive?. they just keeps giving me slow ass direct download link unless i pay up. unlike in libgen i can copy the magnets right away.
it really makes me question my decision few months back to use about 4TB of my seedbox to seed their torrents.
>>
File: 1708533300659499.png (8 KB, 357x96)
8 KB
8 KB PNG
>>101377266
>torrent download link for individual book
Seems quite inefficient (costly) to share every book as separate torrent by default.

For most books that aren't too obscure you can find other links in external downloads, including to libgen sometimes.

>makes me question my decision few months back to use about 4TB of my seedbox to seed their torrents
They can either save hundreds of terabytes of data for everyone and be able to much more easily archive all of the books and share the archive, or they can make each book easily and separately downloadable, so compressing things heavily for archiving makes sense here.

Most of the books are either available in many other places so it's not a problem to get them rather easily or they are very obscure in which case even "wasting" a few GB to download a specific archive torrent they are in shouldn't be too big of a deal.

A solid resource here is also https://btdig.com/ where you can search for file names within all DHT torrents.
>>
File: irisu.png (52 KB, 250x250)
52 KB
52 KB PNG
Bump, I love initiatives like these. I've been hoarding data here and there. BUMP
>>
>>101376437
>>101376438
Tartube has to be the best thing ever holy shit
>>
File: 1720798540374.jpg (198 KB, 1080x729)
198 KB
198 KB JPG
>>101378198
yeah i guess i have to copy the book md5 then put it in libgen to get the single magnet link.
annas-archive has the book collection / personal list and i've been hooked with that feature



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.