Guess what I'm working on, dear 4friends?There is the concrete possibility that the internet will go down soon due to some AI fuckery... are you ready to browse the archives offline?>there's already code for it on githubAlright but I want to do it myself from scratch, as an exercise, with the functionalities that I desire. I will have an AI optimize it later.
I'm navigating the real Matrix.
>>544805714sounds gay fuck you idc
It works boys... just needs some fine-tuning.For some reason the time must be set to UTC+6 to work... I'll change that later.Next step is to output HTML files with hyperlinks and all the fancy stuff.
>>544805782your mother is gay pajeet
>>544805714Use Claude Code, it will have this idea done in under 30 minutes and claude will have to read/store all 9000 times I said the word nigger
>>544805962I'm only asking Qwen for suggestions with niche code... the rest is from my own cheatsheets.9000 N's is a good personal score, have a look at the first ~4 months of the dataset from december 2013 to march 2014.The word "nigger" appears 87368 times already.
>>544805714>the internet will go down soon>there's already code for it on github>but I want to do it myself from scratch,what if the internet goes down before you've finished your project? ever thought about that mountain jew?
>>544806378It's already functional, just needs some more work to output HTMLs. I have offline books, university course material and an AI on LM studio, even if the internet goes out I can code.I'm good, but I made this thread for you.The 4plebs datasets are more than an encyclopedia, they are pure unfiltered reality, just as we frens like it.
I think I solved what that 2013 post was complaining about.Interesting, the word "Trump" appeared only 144 times from december 2013 to march 2014.The zeitgeist was completely different.
You can already feel the soul of /pol/ from the first 10 threads in the dataset.Where we're going there's no censorship.
Some more code for the ones who are strong enough to accept the challenge... the rest is an exercise up to you, it's not that hard.Make Europa proud, lads.
Another example how you can use the archives to gather useful information in the era of automated censorship.The code also works for archives of other boards, of course (maybe with just a few small changes if the result is not perfect).
Hello? Is there any individual with IQ above 70 left?BUMP THE THREAD YOU DUMB NIGGERS
>>544805714>Pressed F12>Takes random cropped screenshots of page source >>BEHOLD 4CHANNERS! I, THE KING OF REDDIT, IS A LEET HAXOR!! I WILL BE YOUR SAVING GRACE, YOUR MESSIAH, I WILL BE YOUR ARCHIVER!!suck the cut end of a hot 240v power cord, be the an hero we need, Sukdeep.
>I will be immortalized Wonderful!
>>544808760yea and so will everyone clowning on you
looks cool swissanon i hoep u succeed
>>544808852No one "clowns" on me is it can be chalked up to professional jealousy.
>>544805714>internet downOMG
Make an executable app that scrapes a video from a site and asks "which board would you like to post this to" then it compresses it to board size or sound on/off.
>>544805714I bought 2 old cars a couple years ago I have been meaning to work on anyway
>>544808760>>544808852>>544808965Not only you will be immortalized, your brain structures will be reproduced into AIs trained on 13+ years of /pol/ and other boards.Yannic Kilcher's GPT-4chan will look like a toy compared to it.Jewish censorship will never win.
>>544809164>BreakAIWonderful. I can move onto better things than arguing with incels all the time.
>>544809041Noice, but have you saved 10+ TB of mixed media, manuals, textbooks, games, chan archives, wikipedia / grokipedia, etc?The sky is the limit.
>>544808875Try to make a reader yourself with python, you can also vibecode it with a small ollama or LM studio AI.That's how Europe wins.
>>544805714Bump
>>544809494Thanks fren.In the pre-Terry era the word glownigger wasn't yet used.If you search for "PRISM" tho, you get hundreds of results in just 4 months.The Zeitgeist exploration power is limitless.Will you accept the (easy) challenge?
>>544810874I literally had a shirt in 1991 that read I TRUSTED THE GOVERNMENT NOW I GLOW IN THE DARK
>>544810874>If you search for "PRISM" tho, you get hundreds of results in just 4 monthsIts a great album by Katy Perry.
>>544811020Oh don't worry that isn't what was on /pol/'s mind in early 2014...
>>544808196It sounds very cool, anon. I use 4plebs almost daily. Thank you for your service.How much space would be needed to host a local copy of the archives, though? And would the search function in your version offer benefits not found on 4plebs?Personally, searching for images while not knowing the exact filename they had is almost hopeless.
Can you just download a 4chan archive db?
>>544811255>How much space would be needed to host a local copy of the archives, though?dec 2013-2017 is only 19.7G compressed, 25G uncompressed.dec 2013-2026 goes up to 89.5G compressed, probably about 100G uncompressed.Start with the small ones:archive.org/details/4plebs-org-data-dump-2017-01
>>544811409Yes.>>544811424
>>544811479Any archive dumps that go pre-2013 though? I want to read comfy early 4chan in my retirement. Would unironically burn this onto m discs
>>544805714neat idea
>>544805714>Alright but I want to do it myself from scratch, as an exercise, with the functionalities that I desire. I will have an AI optimize it later.Very based. The flexibility of a custom solution always pays off, and when it doesn't the journey was the pay off all long.I once did something like this. Are you doing some data analysis on /biz/ posts to see crypto discussion trends?
>>544805714I don't care anymore. If anything trannies and niggers losing their access to social media would be worth sacrificing the entire internet at this point.
>>544805714why would i want to read old useless posts offline? the point of this website is the interaction.
>>544805714I've been thinking of trying to learn how to make something similar. Can you post the github with the code you're referring to?
>>544811611There's something but sparse and archived with variable quality. Just ask an AI to go get them for you.https://archive.org/details/studionyami-com_penfifteen-2012-03-05https://archive.org/details/a_20240905_202409There's also the Bibliotheca Anonoma guys doing God's work.
>>544811760If you can't understand why a huge, uncensored, searchable database with hundreds of millions of posts would be useful, this thread is beyond your intellectual capabilities.
>>544811664>I once did something like this. Are you doing some data analysis on /biz/ posts to see crypto discussion trends?Not yet but could be an idea.
>>544811974I didn't test these, just search "4plebs" or "4chan" on GitHub and there are like 20 results. However, doing it from scratch allows you to customize everything. You can even vibe code it starting from my screenshots.
>>544812221Thanks, anon. Yeah I'm gonna do it from scratch just to feel some accomplishment.
>>544805714Godspeed, anon.
>>544805714your crush is currently being plowed by 3 black men and this is what you spend your time with?
>>544805714I’m not entirely clear on the specifics of what you’re building—is it an online or offline parser for web pages? / I actually worked on something similar—extracting data from the IMDb database to build an offline version of sites like Trakt. It operated in several modes, combining online and offline functionality, and I developed it in conjunction with a web browser extension...For personal use.
>>544813444Offline database parser.Everything offline once you have the big csv or similar.
>>544806366>have a look at the first ~4 months of the dataset from december 2013 to march 2014.>The word "nigger" appears 87368 times already.kek
>>544813505It looks like we’re building a piece of the future autonomous internet... once my project is completely polished, I’ll put it up on GitHub too.----------At the top, you can see a folder named "Cinematorium EXT"—this is an extension that works in tandem with the application when its "online mode" is enabled. Once active, you simply need to click a dedicated button—added to the page where a movie or TV series is displayed (on supported sites)—and it will parse the relevant details into the database and automatically download the poster.
>>544805714bumperino>ITT best in years >TY Anon.
>>544805714>the internet will go down soon due to some AI fuckeryOh no guess I'll do something else
>>544805714It's a shame stickied threads are fucked in the archives. The thread for chucks coronation was great.
>>544805714download books bro shitposts are not worth the memory space
>>544814276Thanks to you bro.This is how we fight bots, shills and glowniggers.They can't beat a selective search function that goes straight through the noise multidimensionally years in the past.
>>544811760Because there are important historical things like the covid scam that have been wiped out everywhere else. As we all know NPCs have the memory of goldfish.
>idiot only knows about the clearnetyawn>not communicating with people in bbs that can be accessed with LoRa
>>544814723Anon, thanks for wanting us to be a part of your civilizational collapse experience and all, but I don't know that you will have the time to devote to it when it all goes down.
>>544809164>Not only you will be immortalized, your brain structures will be reproduced into AIs trained on 13+ years of /pol/ and other boards.Oh, so that's why they are going to kill us all.
>>544805782Fuck you and kill yourself nigger.OP is not gay for once.
>>544805714Claude code can do this in an hour. You will spend a month.
>>544817109Nah just a couple days
