Web Scraping GeneralAnti-kike revolution editionQOTD: What's your greatest scraping achievement?FAQ: rentry co/t6237g7x> Captcha serviceshttps://2captcha.com/https://www.capsolver.com/https://anti-captcha.com/> Proxieshttps://hproxy.com/ (no blacklist) (recommended, owned by friend of /wsg/)https://infiniteproxies.com/ (no blacklist)https://www.thunderproxies.com/http://proxies.fo/ (not recommended)> Network analysishttps://mitmproxy.org/https://portswigger.net/burp> Scraping toolshttps://beautiful-soup-4.readthedocs.io/en/latest/https://www.selenium.dev/documentation/https://playwright.dev/docs/codegenhttps://github.com/lwthiker/curl-impersonatehttps://github.com/yifeikong/curl_cffiOfficial Telegram: @scrapistsLast thread: >>101151145
>>101177514bunp
>>101177514faggot shill thread
>>101177614Seethe API cuck
'mp
Any good iPhone emulators? I need to intercept some app's requests and it's a mess on Android
>>101184724https://www.reddit.com/r/EmulationOniOS/comments/1c5kxyo/available_ios_emulators_megathread/Can't vouch for any of these, they all seem trash desu.
>>101178587Nobody can take your thread seriously. Honestly have you ever scraped anything in your life? I can count the instances I've been forced to parse html on one hand. Almost everything has an API, that's literally how the sites and apps work. Most of the time there's no authentication, you can get all the data not just what's rendered, return more data at once, and so on.