[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip / qa] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: 1720260432156330.png (337 KB, 1497x936)
337 KB
337 KB PNG
Useful archiving efforts and other projects to help out with for people new to and interested in archiving:

HIGH priority (If you don't help archive these automatically, the data will probably be lost forever):

1. http://warrior.archiveteam.org/
Help out automatically archive things being shut down right now by running ArchiveTeam Warrior program (or specific containers) in the background:
Requirements: Few GB of space, some bandwidth and small amount of CPU power, more info: https://wiki.archiveteam.org/index.php/ArchiveTeam_Warrior

If you learn that a site or any online data is in danger of shutting down, read through this page and contact ArchiveTeam on their IRC if required in order to have it archived: https://wiki.archiveteam.org/index.php/Projects

2. Help out automatically forward URLs you browse that are not archived on https://archive.org to them for archival with a browser extension:
https://github.com/internetarchive/wayback-machine-webextension
>>
MEDIUM priority (Important overall)

3. Seed torrents for as long as possible, rare data forever. Make sure to look up a guide for your router to PORT FORWARD your torrent client port, to substantially increase your upload (and your download) speed. In low population torrent swarms, if no one is port forwarded then you might not be able to connect to each other at all and exchange any data despite having it.
Requirements: As much or as little bandwitdh you want (you can set the limits if you need to)
https://github.com/qbittorrent/qBittorrent (Recommended client, especially to replace uTorrent)

4. Archive web pages you want to have a local copy of with a "Web Extension for saving a faithful copy of a complete web page in a single HTML file with a single click"
https://github.com/gildas-lormeau/SingleFile

5. Archive videos with "GUI front-end for youtube-dl, yt-dlp and other compatible video downloaders"
https://github.com/axcore/tartube

6. "Capture or record any area of your screen and share it with a single press of a key"
https://github.com/ShareX/ShareX

7. Archive entire websites you want to have a local copy of
https://www.httrack.com/ (not sure if there is anything better than this)

8. Publish the data that you have archived that isn't easily or at all available online. You can easily create torrents yourself in your torrent client and then share the magnet link to it anywhere online for anyone to access and, as long as DHT (Distributed Hash Table, decentralized way to share torrents without the need for any specific tracker) is enabled in settings (on by default), your files will be searchable on DHT by DHT crawlers, local or online (for example https://btdig.com/, where you can actually also search for FILE NAMES within all DHT torrents)
(archive.org also creates torrents for all uploads automatically but some have complained that their torrents do not reliably mirror the exact current content of the archive.org item so they should not be relied on)
>>
OTHER useful things:

- In your torrent client settings add the best trackers to be automatically added for all of your newly added torrents (helps more easily connect to peers, especially in obscure torrents):
https://github.com/ngosang/trackerslist

- Look into running a node for I2P (anonymous private network within the global internet):
Requirements: Mostly bandwidth, more info: https://geti2p.net/en/faq
https://geti2p.net/

- Look into running Tor/Hyphanet(Freenet)/IPFS nodes.

- "A self-hosted BitTorrent indexer, DHT crawler, content classifier and torrent search engine with web UI"
https://github.com/bitmagnet-io/bitmagnet

- "ArchiveBox is a powerful, self-hosted internet archiving solution to collect, save, and view websites offline"
https://github.com/ArchiveBox/ArchiveBox

- Look into donating your PC resources to be used more intensively in projects:
BOINC (Berkeley Open Infrastructure for Network Computing: https://boinc.berkeley.edu/projects.php
GIMPS (Great Internet Mersenne Prime Search): https://www.mersenne.org/

- Additional archiving tools: https://github.com/iipc/awesome-web-archiving
>>
- Additional links to archiving and similar communities:
https://wiki.archiveteam.org/index.php/Archiveteam:IRC
https://www.reddit.com/r/Archiveteam
https://www.reddit.com/r/DataHoarder/wiki/index/ - Hardware and software for data hoarding FAQ
https://www.reddit.com/r/DataHoarder
https://www.reddit.com/r/lostmedia
https://www.reddit.com/r/GamePreservationists
https://www.reddit.com/r/torrents
https://www.reddit.com/r/qBittorrent
https://boards.4chan.org/t
https://annas-archive.se/torrents

What are you archiving or want to archive?
Do you have or know anyone who has some rare interesting data or media not available online?
>>
>>102448873
On early Internet there was some Japanese music (group?) called Aroasfoo. They made some images for Gainax top page (the images used to change periodically). Their site had a bunch of cool art, some were illustrations for (music CDs?) covers others I dunno, just some cool art? It used to be available on the internet archive but last time I checked most of it was lost. pic is one of the images made for Gainax but they had many non-Gainax images on their site.
>>
>>102448852
Are we allowed to make a request regarding archiving all the videos of a bitchute channel?
>>
>>102448852
If we are allowed to make a request, I'd like to request that every video on this channel be backed up please, thanks in advance. https://www.bitchute.com/channel/J8jRLfRYewto , especially all the Joe Bob stuff
>>
>>102451832
Do it yourself, nigga
>>
>>102451832
You can just use yt-dlp and upload all the videos downloaded directly to the Internet Archive as a single item yourself.
>>
Is it true that Internet Archive is shutting down?
>>
>Roblox comments
Those just 10 yrs old kid copypasta
>>
Saw this post made in /co/ and got archived later on.

https://desuarchive.org/co/thread/145273113/
>>
>>102453233
No, although how they lend books will change/not be possible anymore.
>>
>>102453310
He spams this post almost daily here
>>
>>102453664
I'm sorry you are so upset
>>
what's a REALLY good extension or application that can help me organize my tens of thousands of browser bookmarks? I have tons of obscure jap websites i'd love to archive but i know a chunk of them are NOT sorted for me to find easily in my rats nest of ancient bookmarks.
>>
>>102453757
im sorry you have no argument after being exposed for being a low iq retard, cope
>>
>>102453831
>>102453757
>>
File: 1695665609128627.jpg (175 KB, 1360x868)
175 KB
175 KB JPG
>>102453840
embarrassing
>>
>>102453865
>>102453757
>>
>>102453776
At that point somehow export the bookmarks and use something else to process the exported URL list, ask an AI to create a quick script to process them in the way that you want given that it should be a simple script.
>>
>>102453776
I've been meaning to investigate this myself as I have similar issues, but I haven't had the chance yet.
https://techwiser.com/bookmark-organizer-firefox/



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.