>although the common opinion among programmers seems to be that it's a sin to block archive.org, I believe it's fine to do that if you don't want old versions of your site floating around
>>101439295people that allow archive dot org, archive dot moe, search engines etc. to scrape and index their sites are fucking retards.> seems to be that it's a sin to block archive.orgnever happened.
>>101439339I will scrap your site and steal your shit and there is nothing you can do.
>>101439339this is why people should auto save websites with mostly static content
>>101439593save it locally to your hard drive. i don't want my sites archived by faggots. >>101439392> there is nothing you can do.plenty i can do, seething real life wojack.
i don't trust any website that excludes itself from archival services
>>101439339I'm just going to ignore your robots.txt LOL
I'm scraping a porn site right now! I have been doing it for the last 6 years, every week. The owner doesn't like, he already mention about "people stealing" content, but he's powerless. Cuck.
>>101439295if I own the data I have a right to not have it posted elsewhere simple as
>>101439859This is only happening in that troubled head of yours.
>https://archive.today/2017.05.13-142949/https://danluu.com/googlebot-monopoly/There WILL be old versions of your website floating around.
>>101439392based>>101439645>plenty i can do0 things you can do, as is the reason why you couldn't list 1
>>101439392- Google 2024
