I have set up a python script to scrape every /pol/ post so I can properly assess shilling on this board. I have put together an interface so i can see who talks about what the most any time something interesting happens, like if some new epstein files drop suddenly a bunch of indians make BBC threads or something. This is just the data collection stage at the moment, i intend to get averages of who talks about what each day over months and then compare it to averages of discussions when something happens. Each scrape is 2mb and about 10,000 posts, I have it running 24/7 and it takes scrapes every 25 minutes, I have it on a 2TB hdd at the moment and estimate about 40gb a month, so I should be able to get a years worth to allow me enough data for a proper statistical investigation.Its obvious this board is shilled to fuck, i would like to both quaify why and quantify to what extent. I will keep you posted.
>>524144593thanks bro, keep up the good work
bump for interest. Only interesting thread on this shit site, honestly
>>524144593God’s work
>>524144593thanks, and this time, DO keep us posted
>>524144593Thanks anonIll assist your efforts if you decide to open source
I wish I was this smart. Thanks, anon. Looking forward to reading your findings.
Good use of free will. Godspeed anon.
>>524144593Based. Keep us updated.
>>524144593Bump
I shill for the US taxpayer. Here's my contribution:Rand Paul Abolish IORB hearing Dec 11, 2025Oversight hearing to examine the Federal Reserve's big bank welfare program, focusing on the IORB regime.US Homeland Security and Government Affairs Committeehttps://www.congress.gov/event/119th-congress/senate-event/337732
>>524144593Good luck, OP! Maybe set up a wiki so we can see your updates right away.
Please continue to update us with results. Also you should obviously include >womenas there is a constant and continual attack on women and the push to keep anons from having children couldn’t be more clear and obvious on this board. In fact you should add>christand >christian and>christcucksince those are spammed here daily by jews and poos
>>524144593>proper statistical investigation.you have nothing unless you can ID individual users
>>524144593(You've mentioned it) but it might be smart to try and group basically categories of topics by frequency. You'd probably need to account for rate of posts for dead periods
lolalso, waitresses and plumbers aren't destroying coding, coders arewhy does ego and greed eventually destroy the credibility of every field?
>>524144593Thank you, instead of filtering 40 threads now i filter 125, that's a bad thing, but that's how bad things really are, sad.
>FUCKING
>>524144593Shills are so lazy they copy 1:1 the same post with the same image. It was clearly visible in pajeet threads.
>>524144593You're doing the lords work.
>>524144593That is dumb as fuck; there are already several sites archiving this board with included search functions.
I'll save you time. /pol/ determines the current culture. They are aware of this. Their thought process. . . "disrupt /pol/ making it unusable, problem solved" They killed their containment board. Now everywhere is /pol/ every social media site, every comment section, every opinion from every person, even the gov officials are /pol/ GGz
>>524144593Neat.
>>524144593>Finland has 1/30th the population of Russia but posts here moreWhy is Finland interfering in our democracy?
>>524148156True. The JQ is spreading to normies at a rapid pace because these retards thought disrupting the containment board was a good idea kek
>>524144593Bless
>>524146084>Nooo don't make fun my kike on a stick cult Shut the fuck up, golem
>>524144593>averages of discussions when something happensnothing ever happens>the population>shillokscraping every /pol/ post needlessly overloads the servers. there is already more than enough data in the archived 4plebs data dumps, from sep2015 to jan 2024. All you have to do is analyze that existing dataset, containing all posts. define every time instance when there is a "happening" and then do your averages again with set time spans. the benefit of your current method is that you can manipulate the data to fit your narrative more easily, so it becomes more subjective and you can sensationalize it, by choosing arbitrary time points. so have fun being a nigger.
>>524148729Shut the fuck up, kike
>>524148822Sorry.
>>524148822He's right, nigger. Imagine scraping 4chan for retarded /pol/ posts that are already archived within minutes instead of scraping /gif/ and /d/ for porn.
>>524144593Most of the threads that include the words woman/women/female in the OP are also done by shills.
>>524147810They are not cryptographically secure and they often only show x of y resultsCase is search for posts from the dprk flag, some may remember those, no longer findable
>>524144593don white fucking shit jews fuck nigger trump need never right off money war niggers
>>524144593Act Blue paid shills make up the most with Israel coming in second with it's outsourcing to India.
>>524144593Based thread have a bumperino
>>524149403did it ever occur to you that users of other boards come here to shit on your safe space?
>>524144593>have set up a python script to scrape every /pol/ post so I can properly assess shilling on this board.show the negative sentiment toward anons exposing the TV people using Gematria in their news stories
bump
>>524144593good job nigly wigly and supremely based. niggers tongue my anus
also OP i thought scrapers weren't allowed herepic rel
>>524151663It is, hence why OP is blakkk. he's giga scraping
>>524144593thank you sir I appreciate that
>>524152055i think OP is full of shit
There was a leaf bro that did something similar recently, wish I'd have bookmarked it.
>>524152159nah, just delusional like everyone in this thread and website, including myself
>>524152254It had a quantification of the antisemitism level of /pol/ and stuff for other boards too. Was pretty neat
>>524144593Excellent initiative brother anon!
>>524144593Cool dashboard, I did something similar pre-AI. Include n-grams instead of just unigrams, you'll actually be able to trace linguistic trends over time--useful for detecting inorganic shilling (i.e., this new meme phrase pops up randomly out of the fucking blue promoted mostly by memeflags).
like all hobbies, it's a waste of time. nothing changes.
>>524144593N word shows up in singular and plural form. Seems pretty legit to me.
>>524144593oh no the mutts are shilling themselves into insanity, thats very sads. i guess the "israel" shills this board to toast is off the plate you stupid shits.whats the next cope.
>>524144593You don’t need to scrape the data just sit here for half an hour and you’ll know what’s being shilled. The shilling has a pattern that changes about 4 times per day
>>524144593for what you make your stupid fucking database and waste all your life on it with 170 iq you see it just like that. thats interesting now is it not.coping code monkey golem. the absolute state.now we allow you all to die.here i found your husband dancing on the street.
>>524144593Nice work, I would love to see what you find.
>>524144593would you mind opensourcing it so people can contribute ideas as code to you? You could keep a public repo and a private one which you actually use, and let people play around with the public one and when you see a good idea you take it and use it on your private repo. Have you shared this on /g/?
>>524144593Normally I disdain tripfags but I suggest making a trip or a general thread name so I can search archive. I am not as terminally online as I once was and I would be interested in following up on this later. If you do decide to keep us posted please let me know in this thread so I can note it down for later.
>>524144593>India paying faggot Trump fucking the population
>Anons in this thread did not put together the fact that OP is 1 of the professional shills, and the PAC / government entity he works for devoted their time and resources to program this software to follow organic users of the website.
>>524144593
>>524144593nice work!
