[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
▼ Settings Mobile Home
/wsr/ - Worksafe Requests

Name
Options
Comment
Verification
4chan Pass users can bypass this verification. [Learn More] [Login]
File
  • Please read the Rules and FAQ before posting.

08/21/20New boards added: /vrpg/, /vmg/, /vst/ and /vm/
05/04/17New trial board added: /bant/ - International/Random
10/04/16New board for 4chan Pass users: /vip/ - Very Important Posts
[Hide] [Show All]


[Advertise on 4chan]


What's the "right" way to automatically archive feet threads on /gif/?

I'd like to make a script that runs ~once a day that saves vids to a folder without repeats, or if anyone's made a tool for this type of work
>>
>>1578520
>archive feet threads
dhtiyurhhfjdkdjdkflfkdsdv dnggljfdujfjfdhjdfjjfhdjdjfkfdhhsjdjdkffjevvefvhkohysfsnfgklyhdshfhkhjfdhdbgkgmfjhdjfgmmghfdghdkgkgdhdhkfjffn
>>
>>1578520
>I'd like to make a script
What language? Python? Bash script?
>>
Why should I help you scrape things to train your AI lol?
>>
>>1578527
Bash and jq (for the json api). No 4chan archive site seems to care about saving files from /gif/ so I'll just do it myself if no helps out

>>1578528
Training my cumshots to bust all over those soles
>>
>>1578530
>json api
Unbelievable gay, my dude. Real men scrape HTML. This thing should work, it could use some improvement like taking an argument to know where the files will be saved, right now I left it as hardcoded configuration at the top of the file. Tell me if it there are any problems with it because It Works on my Machine (tm)

https://pastebin.com/fcnd4yaW
>>
>>1578535
Actually you know what, I couldn't live with it and had to go back to fix the script. Now the files are by default saved to /board/thread/ unless you specify a folder name in the config at the top

https://pastebin.com/G4M3PLZZ



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.