I'm making an index of sites Google won't index but I can't find them because Google won't index them.It can be vibecoded, but only post if YOU uploaded it or FTPed it or whatever.
bold strategy OP, let's see if it pays off
>>110293834Will this result in my websites being trawled by a bunch of bots? I've already spent a great deal of effort mitigating that without needing to use CloudFlare. I don't want my websites abused.It seems like every time I share my websites here, there is a lot more bot activity and then it eventually dies down after a week of the bots failing to pass my barriers.I'm also concerned about people abusing this and giving you websites that serve malware.This is a great idea in theory, but I don't know about the integrity and morals of the people who are willing to participate.I would consider vetting the websites first before adding them to your index. And also consider allowing people to add their websites to the index themselves. But they need to sign up with an account. Make it a walled garden. Only allow access through invites.
So a webring? That is faggottry
>>110293914i wish zoomers would kill themselves
>>110294019No, the concept of web ring is different from a search index. A web ring usually takes on a certain theme and everybody agrees with each other. They are a small cluster of tinkerers. Now, compare that to something like Google or something that allows you to find websites with anything you want to information about.
>>110293834Okay bitch I will help you. Start at 0.0.0.0 and work your way up to 255.255.255.255 and like record all the sites and then manually Google them all, and the ones Google doesn't find are the ones Google doesn't find so now you know.
>>110293834>>110293967>>110294019>>110294076>>110294111Things are really this bleak, huh? She's never coming back, is she? Ol' Webby.
>>110294111Wouldn't it be easier to download the DNS records and start from there?
>>110294370I'd actually just consider making my own local index by looking at website shared on the site through the archives and also going through all the programming documentation and hacker news posts and comments, keeping only what looks interesting or useful. But it really depends what kind of information you're after. Of course, you can just look at other sources, but I wouldn't depend on people sharing their websites to create, oh my god, there's a nigga outside my window. Oh fuck. oh my god, there's a nigga outside my window. Oh fuck.
>>110294402Yes maybe.What's a DNS record?
>>110294541>And you want to scrape the internet?
Does anybody else have anything else to say on this topic? I want more information, regards the person who typed the most in this thread.
>>110293834I have my own website, it's just a static site made with 11ty but it's pretty niceYou'd have to be a retard to share anything even tangentially related to yourself here though, I already had to range ban India and China, I'm considering making it accessible only from countries where you can drink the tapwater
>>110295785This is what I did and I haven't regretted it at all, because even if I travel to another shit hole, I can just be in into my server and reach my website that way. I only have Canada and America whitelisted.
zumper
>>110293834I'll bitememereich.com
>>110293834webjeet thread
