>>1310539
Active torrents from the previous threads:
>FullTimeCryBaby
eb373d1d3a41e77d4ae395aae04409d6a522888d
f642071fb8747cc0d21ce9012cfb6e7169045b54
>CarryKey
d8d5c2ca059d24876b9bc8b18b926cb190a7f3d6
>Nora Fawn
0fa4d9cc160649f9e9d0f73d7397860f35758ea3
>Momokun
3e4a3b12031c2508a73184baaf02fcb1fb078194
>Cosplay Collection (Misc videos)
c613dd9c14c5d8750df21d924b70a5c506a92ed2
>Disharmonica
2ae5dc022aa39153ae0decbb578208d4f66ed20d
6e6ef0c2589542c8ddba068ad7a96bcc7c34b13b (94%)
>Virtual Geisha
58ab0c2ec3167eba10836f85ca327d2d10d25c26 (93%)
>MyCherryCrush
8bcdb2b83ad7dd82bedf7df6658c6c229db3f68c (90%)
>BuniBun
6429d3243f418d0e0fbd8c0cf9140a8635922367 (69%)
>Peachmilky
ea92979918b0cf900339f56f321f0918f8716a9a
>princess berpl
e4ad4d68c99fd23af65fe4e0aca9c9190cda2c5f
>nonsummerjack
ad5fdc5fec791d3f45aca8688900d568b0bbe142

reposting this from the last thread for convenience sake:

small update on the library, update 2 is on the way i have done the first deduping pass and it seems i have more than enough new content already so i'll start sorting stuff up this weekend, it will probably be very similar to update 1 in terms of content distribution, maybe a few more higher quality versions of old sets

in what appears to be a recurring problem i think i'll have to leave some cosplayers out because they will likely require a full refactor and would probably take a full update or more just by themselves while not adding that many fully new sets, i'll probably leave those for a potential V3 or some sort of special torrent with only refactored cosplayers, to be clear when i talk about refactored cosplayers i'm only referring to large cosplayers that would have all or most of their sets replaced for higher quality ones, i'll still be adding some higher quality versions of galleries on the regular updates as long as the aren't too many as mentioned above

>>1310539
>New Cosplay_Megapack
i don't think anyone is seeding these anymore, so not worth adding it to the OP
i'll probably make a new new cosplay_megapack torrent in the same style as your library (several parts) someday, just been too busy to think about it recently and really I want to go through and hand-scrub the entire thing before uploading to remoce all dupes and low-res stuff and have a 100% consistant heirachy across all folders
right now it's pretty messy and i run into issues with that due to filenames having illegal characters, inconsistant set names, the list goes on.

one day.
i hope.

Thanks again anon for all your hard work. I love these sets.

Does the Peachmilky one have sets from the last few months?

>>1311212
i think the latest one is from march, also it's more cumbersome to download but the photo library has more than double the sets from her and about to be triple in the next update

Is there an update to the Hidori one? Loving the look of her new Hancock set

Anyone got AeryTiefling's Frieren videos and/or LittleEmoKitten's Megumin videos?

>>1311242
so... while looking for that set i noticed that the scrapers in charge of gathering newly released sets have been stopped for at least two weeks, as a result after catching up i'm sitting on over 380gb of updates alone (after deduping) meaning update 3 will only have updates, no new cosplayers other than stridescribe (i remember someone asking for her stuff on the previous thread) and update 4 will probably have a disproportionate amount of new cosplayers, it's way too early to tell but i'd say about a hundred

to actually respond the question 15 new sets including a boa hancock one

>>1311903
could you integrate the striederscribe from the cosplay_megapack? i didn't have much in there but that would at least be a start on merging the two, ie I can drop her from my next release

File: spike-spiegel-pepe-the-fr(...).png (290 KB, 2500x2328)

290 KB PNG

>>1311903
feelsbadanon. But still thanks for all the hard work.

Forgot to say anon but do you want me to create one large torrent with all the updates so far?

I will wait for update 2 if I do.

>>1311948
sure, no problem
>>1311955
i'm afraid that will require a long answer:

the technical side:
the original releases of the library even before V1 were split on 500gb parts instead of 300gb (the discussion should be 2-3 threads back) and turned out that most people were not able to download it, later i narrowed the problem down to the amount of files per torrent being so large that some torrent clients struggled to cope with the metadata so merging updates would be problematic

the practical side:
having multiple versions of the same set of files would split the seeders, people seeding the 300gb updates won't help people trying to download the hypothetical merged ones and vice-versa, there is a way around it if people seed both at the same time using the same files but i don't expect that to happen, in fact based on previous experiences i think most people would just get confused as to what to download

challenges and current plans to streamline the library:
the current model of updates is not ideal, right now to download all of the content for a specific cosplayer you'd have to grab the main part where she's featured and then check each individual update for additional sets meaning by the time update X rolls out you'd have to partially download up to X+1 torrents, that's due to the limitations of the torrentV1 protocol, it can't retroactively modify torrents to either add or update content which clashes with the very concept of the library

to mitigate this i think the only somewhat viable option right now is to periodically merge the library into a new major version so the plan is to at some point make a library V3 also in 300gb parts that merges everything to date and includes a large number of quality upgrades, this will also cause some confusion but i hope people will eventually catch on to what's happening, that type of thing is the main reason why i started including all of the readmes

File: cherryneko_kuronekobikini_008.jpg (1.81 MB, 4000x6000)

1.81 MB JPG

>>1312032
I understand anon but having so many 200GB+ torrents will become a bigger problem. Like what you said people will not want to download 8+ separate torrents for the sets they want. However large torrents will scare people off. But which one is more undesirable….

Now if you made a zip per set that'll drastically lower the amount of files in the torrent. But.. that'll also double the storage you need on hand. If you want to keep the ease of finding dups.

>>1312110
putting zips in torrents is literally always a bad idea
1: you need 2x the storage to seed
2: can't preview files or download select files
3: force users to redownload everything if you ever make an update
4: makes cross-seeding (seeding across multiple trackers/hashes if theres a matched file) impossible
all to solve users being scared on big numbers/multiple torrents and an issue that was solved in libtorrent years ago and libtransmission decades ago.

i say if some retard with a 2003 copy of utorrent doesn't want to/can't download your pack, fuck em. update your client and stop being an ignorant lazy retard. don't make your pack worse for everyone else just to cater to the literal lowest denominator. how the library has veen done is fine, as long as there isn't new versions every month it'll be fine. just save all your big updates for a new thread, which tends to be like 3-6 months, and that way people only ever see the latest version

>>1312116
1: not if your only have the one big torrent.
2: you can download selected sets but yeah no previews
3: Just recheck and overwrite? You will only have to redownload individual sets if updated.
4: lets be real who is cross seeding and to what amount.

But still going with qBittorrent the #1 nowadays does not handle torrents with alot of files. It downloads them just fine but trying to check off things that where it goes to die. Well at lest for qbittorrent-nox

to be honest i didn't really consider any of those points while making the original library, back then i asked if people preferred loose images or a zip per gallery and the overwhelming majority preferred the former so i went with that but here's my point of view

>loose images
+ i think people would be more likely to seed after downloading a torrent with loose images because they can easily browse the images as is
+ (this is rather scummy) more frequent releases means more opportunities for people to find about it
- the large amount of torrents might confuse people and my only solution to that is including a readme which, let's face it, most people can't or won't read, i might try to introduce some translations at some point but i can only do 2 languages manually, the others would be MTL (the big problem would be japanese going by the peer list)
>zips
+ i can probably fit them on one or two torrents
- i expect most people to just decompress the files and delete the zips
- there is a natural distrust of compressed files on torrents since some or all of them could be passworded or contain something malicious, currently i make a point of just using image, torrent and plain text files

i'm not particularly concerned about storage space and with the way i do things cross seeding is not really a problem since most changes i make are at a gallery level not at an image level

bear in mind that i'm posting this on public trackers for a reason, my main concern is to get the torrent as wide a distribution as possible so the torrents stay alive no matter what happens, i'll go with whatever people are more likely to find, download and ideally seed rather than with the more technically appropriate or convenient and while on a pure technical level zips would absolutely be the way to go, loose images have enough (admittedly speculative) advantages for me to want to go with that , i might try a beta with 500gb parts again on v3, just in case it works to reach a middle ground

>>1312279
>the way i do things cross seeding is not really a problem since most changes i make are at a gallery level not at an image level
my bad, what i wanted to say is that file compatiblity going from one version to the other would remain roughly the same, there's no need to even considering even cross seed with images since all torrents contain completely different content, if i zip everything each time i make an update some people will stay on the previous versions, i might be misunderstanding something so here's a scenario of what i'm picturing:

>1-2 zipped torrents
-user A downloads the aery tiefling sets from v1
-v2 releases but user A doesn't realize/don't update and keeps seeding v1
-user B downloads update 1, user A still seeding V1 doesn't help
>current model
-user A downloads the aery tiefling sets from part 1
-update 1 releases but user A doesn't realize and keeps seeding only v1 not getting the new sets from update 1
-user B downloads part 1 and update 1, user A can seed the sets from part 1

the only way to make this situation not matter would be to only make major updates every year or two which is too much of a time span for most people, with more frequent releases i'd expect more people to keep up with the news since it will be more active and with much less radio silence

File: Capture.png (61 KB, 545x699)

61 KB PNG

how can i help with the PeachMilky pack?, i have 100 extra zips that can be added to the current archive

Anyone got up to date folders of Bishoujomom and Momokun?

>>1312669
the easiest thing to do would be to make a new torrent including all of her stuff to replace the current one, i could also merge the images into the library later on if you don't mind
>>1312817
these might not be useful since are fairly easy to find but are the largest ones i scraped for both that are somewhat recent and still active, it might be good to have them in the thread anyway
>momokun (53GB) latest video from late 2022
3e4a3b12031c2508a73184baaf02fcb1fb078194
>bishoujomom (30GB) latest video from late 2023
abf42a2c8c596cc0de93807f900691573dc90840

what torrent clients are recommended , i use an older bittorrent one but it suicides after about 100gb

>>1312923
qbittorrent
transmission
deluge

in that particular order

File: ll.png (1000 KB, 970x586)

1000 KB PNG

Is there any torrents of Lana Luv? She has a fuckton of videos but can barely find any of them around.

>>1312923
Tixati. Ugly, but works very well.

Update 2 of the library is pretty much ready to go, all that's left to do is making some final checks, making the backup and building the torrent so i'll probably post it within the next couple of days

in the end it's going to have 1 new and 141 updated cosplayers, the number looks relatively low because i had to remove about 180 updates from the original version to get the torrent to fit in under 300GB (all of the removed updates had only 3 sets or less), this will be a "boring" update mostly featuring recent sets from fairly well known cosplayers so nothing particularly rare i think

>2024
>nonsummerjack still hasn't shown her nipples
Ffs even Saku is doing it frequently nowadays

>>1313899
I will be checking everyday looking to upload it to nyaa(fap).

>>1314165
you won't have to wait for long, i just started making the torrent, after that i'll just hashcheck the backup and update the rentry before posting so i'm guessing update 2 will be out in around 4-6 hours

by the way there were a couple of minor tweaks made since the last status update
- the final cosplayer count is 146 updates + 1 new cosplayer, i ended up taking out peachmilky's updates just in case >>1312669 gets posted and replacing them with some of the ones i originally took out
- starting this update there will be an HTML version of the docs alongside the usual txt/org version since it has come to my attention that the txt has very poor readability on most plain text editors

Nora Fawn 21.7 GiB

https://files.catbox.moe/84uo3w.torrent

or you can use the magnet:

magnet:?xt=urn:btih:DE37052072C87313933764D5211FF2A0DADEFA6F&dn=Nora%20Fawn&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Fopen.demonii.com%3A1337%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fexodus.desync.com%3A6969%2Fannounce&tr=https%3A%2F%2Ftracker.renfei.net%3A443%2Fannounce&tr=http%3A%2F%2Ftracker.renfei.net%3A8080%2Fannounce&tr=udp%3A%2F%2Fopentracker.io%3A6969%2Fannounce&tr=udp%3A%2F%2Fnew-line.net%3A6969%2Fannounce&tr=udp%3A%2F%2Fmoonburrow.club%3A6969%2Fannounce&tr=udp%3A%2F%2Fexplodie.org%3A6969%2Fannounce&tr=https%3A%2F%2Ftracker.tamersunion.org%3A443%2Fannounce&tr=udp%3A%2F%2Ftracker.theoks.net%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.0x7c0.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftamas3.ynh.fr%3A6969%2Fannounce&tr=udp%3A%2F%2Fretracker01-msk-virt.corbina.net%3A80%2Fannounce&tr=udp%3A%2F%2Fp4p.arenabg.com%3A1337%2Fannounce&tr=udp%3A%2F%2Fepider.me%3A6969%2Fannounce&tr=udp%3A%2F%2Fbt2.archive.org%3A6969%2Fannounce&tr=udp%3A%2F%2Fbt1.archive.org%3A6969%2Fannounce

File: update2.jpg (2.82 MB, 4672x7008)

2.82 MB JPG

COSPLAY_PHOTO_LIBRARY V2 - Update 2 (146 cosplayer updates + 1 new cosplayer - 298.85GiB)
>info:
https://rentry.org/coslibraryv2
>preview (a bot that posts one random image from the library every hour, should give a decent cross section of the library):
https://bae.st/users/cosplaybot
>magnet link:
magnet:?xt=urn:btih:77f4f453f8dd55fff55e2cf1ec5bc5c983c06809&dn=cosplay_photo_library&tr=http://sukebei.tracker.wf:8888/announce&tr=udp://open.demonii.com:1337/announce&tr=udp://open.stealth.si:80/announce&tr=udp://tracker.opentrackr.org:1337/announce&tr=udp://explodie.org:6969&tr=udp://tracker.torrent.eu.org:451/announce
>.torrent file (for the people having problems fetching the metadata):
https://files.catbox.moe/diy27p.torrent

>>1314215
https://sukebei.nyaa.si/view/4134507

>>1314168
>starting this update there will be an HTML version of the docs alongside the usual txt/org version since it has come to my attention that the txt has very poor readability on most plain text editors
could just make an md formatted file, it's nice and clear in text readers weather they do or don't support md

>>1314215
anon can you add Coser@西瓜少女 / Xi Gua Shao Nu

link to a site that has her: https://girldreamy.com/tag/Xi-Gua-Shao-Nu/

Also cosplay anon do you know of misskon.com?

>>1314232
even though i gave it a txt extension the documentation is technically written in org which has a very similar syntax to markdown, in the particular case of the library docs all i'd have to do to convert it to md would be changing * to # for the headers, my guess is that the issue is probably text wrapping so i just figured out that if i'm gonna use a markup language might as well just use HTML with a bit of css to rice it up a bit, i'll keep including a plain text version in case people are not comfortable with the HTML but i wrote it manually on an IDE to make sure it doesn't have any weird calls or anything, it's a very simple document so it's easy to check

but yeah, i'll probably change the format from org to md, org is very niche and i'm not really using any of its features anyway

>>1314265
interesting, i'll use the webpage as a reference to look for new cosplayers, the issue with those sites is that the images displayed are heavily compressed and scraping from file hosts like rapidgator is a pain in the ass plus i'd need to make accounts, (i should be able to deal with most image hosts though)

i wasn't aware of 西瓜少女 but after running a query turns out i did have a couple of her sets already and i think i can find enough full res sets to include her on the next update

>>1314227
that was quick, i'll add it to the rentry

>>1314215
God bless your soul

-the striderscribe guy last thread

its a little messy but it i left the organization to the archiver
magnet:?xt=urn:btih:ee2805f3a470595dbf594d05d7886f7c15fd2c0e&xt=urn:btmh:12204b35ff89fc74f3940ad026ac8a3730717d9cf3eb776bd2a52891a90c58edf5dd&dn=PeachMilky%20Cosplay

okay so update 3 might be coming sooner than expected, essentially once i finish downloading >>1314598 things will look like this:

peachmilky -> at least a 24gb upgrade
西瓜少女 ( >>1314265 ) -> 30-50 gb
Momokun (mentioned on the previous thread) -> 30-60gb
cosplayer updates that didn't fit on update 2 -> 52gb (already deduped and organized)
new cosplayers -> 80-140 gb (only partially deduped)

so that's 192-302 gb of stuff that will only need minimal intervention to get organized, i had plans to start organizing some the shitton of random asian cosplayers i have in the backlog for update 3 but i guess that will have to wait, by the way even though i already have enough sets i'll probably still wait a few weeks before i start working on update 3 to give some time for update 2 to propagate

>>1314745
Thanks for the hard work anon

File: hidorirose_boahancock_020.jpg (1.87 MB, 2160x2880)

1.87 MB JPG

>>1314745
I noticed the new Hidori folders don't have videos in them, are those coming in the next update?

>>1315740
i'm not including any videos by design, a version of the library with videos would be nearly impossible to manage considering that the current size of it is just over 3TB also there might be some confusion over this, the cosplay megapack and the cosplay photo library are two distinct projects (detailed in the OP)

cosplay megapack -> 100ish cosplayers - ≃700GB - photos+videos (https://sukebei.nyaa.si/view/3913627)
cosplay photo library -> 600ish cosplayers - ≃ 3TB - only photos (https://rentry.org/coslibraryv2)

on a somewhat related note a couple more major cosplayers will need a full overhaul so a V3 of the library is going to be a thing for sure, i'll probably make a few more updates to V2 before that though

>>1315903
do you actually have any of the videos or do your scrapers ignore them? I'd be interested in a cosplay_video_library as a companion to the photo library

>>1315942
the scrapers grab anything that has cosplayer names on it and send it to the download queue but i have a script that "unticks" everything that's not an image or archive file from the torrents every few hours and later on during the cleaning process all archive files get decompressed and all resulting files that are not images get deleted so technically speaking videos get scraped it's just that they don't make it very far down the pipeline

a comprehensive video library would be nice but it would also be a massive undertaking, as an example i think last thread it was mentioned that hidori rose alone has at least 400gb on videos, that said a more modular approach could work if anyone wants to give it a try for individual cosplayers i have my hands (and a couple of drives) full with the images alone

>>1315950
well eventually (i feel like I say this too much) I plan to revamp the megapack, merging with your library to provide a delta. I haven't been scraping for months though as I do it manually to help it be a little more curated. I could absolutrly undertake the videos, but it wouldn't be for all 800 cosplayers or whatever you're up to now. my personal collection is around 200 and about 80-100 of them don't do videos anyway outside of short gifs or 1-5 second clips from twitter. anyway hidori is a bit of an exception because she has like 8 years of hardcore porn from PH and xVids before onlyfans and all that, so she has liie 2-3x the next biggest (I think hane ame who has only short videos, but just an outrageous amount of high-res photos per set, seriously good value for money compared to some girls...)
could be worse, tweetney exclusively uploads in uncompressed h.264 4k 16bit footage and her fans hate any kind of compression or mux, you get like 100GB per hour of footage

anyway it'll be quite some time before I have a real update, my spare time is evaporating before my eyes lately.
I do monitor this thread regularly though and keep note of all suggestions just in case

>>1315954
at this point i have the whole process of doing the deltas for images pretty much fully automated so i can take care of that part myself and fold it into the library if you prefer, when it comes to videos i think your approach of manually curating them is the most viable solution but honestly i don't know enough about most of the cosplayers to help with that

the number of cosplayers that need an overhaul is increasing faster than expected so V2 of the library will only go up to update 3 or maybe 4 before moving on to V3, the main reasons i'm not going to V3 directly is that i want to leave some warnings about what's happening on the docs so people that find the torrents randomly can find out about it and to give me some more time in case i manage to get some more overhauls

it might be a bit of a fool's errand but i'm trying to format the library in a way that makes it easy to query and extend so it can serve as a skeleton of sorts for people who want to share stuff, that way they have the option of just making a torrent with the delta and the rest can be downloaded for the library which is already fairly well seeded significantly reducing the strain on their end of things plus if i (of someone else) is still around making big updates the new stuff can be folded into the "main branch" taking the strain off completely, to that end i'd appreciate any suggestions for changes of format from V2 to V3 that would make that easier, be it naming of files/dirs, approach to documentation or something else

by the way for now the plan is to keep everything it as is but i'll try increasing the part size to 500gb and put copies of the docs on more places in case the rentry goes down for whatever reason

>>1317025
you sir are a visionary

i think ideally I'd just run a curated (so not e-hentai, that shits a mess) DDL site with both torrents and zips, but mitaku.net already exists and it's basically where I scrape 50% of my stuff from

Cosplayer: Ruber-Vulpis

https://www.instagram.com/ruber_vulpis/

Posts almost everyhting to deviantart

https://www.deviantart.com/ruber-vulpis

Some sources with a lot of scrapable content.

https://forum.lewdweb.net/
https://hentai-cosplays.com/
https://e-hentai.org/?&f_cats=959

Source: https://cgcosplay.org/

Kawaii Queentsun

(And perhaps many other cosplayers too)

https://sexyforums.com/threads/kq-kawaii_queentsun-emily-something.43545/page-1

Uyuy had some new sets leak, you can find them here https://mitaku.net/tag/uy-uy/ if you wanna update the cosplay megapack
I'm too lazy to download it now

is there a striderscribe compilation with all her stuff except the one in New_Cosplay_Megapack?

>>1317628
>>1317640

here
>>1314215

Alright cosplay anon how would I get ahold of you vs just here? I am the anon who uploads your torrents to sukebei.

So I would like to help on getting things updated. Like getting rid of those low res stuff with better ones. Or at lest provide torrents directly to you for future updates.

some of the websites listed above look promising and i'll keep an eye on them, unfortunately for now i think pretty much everything there is already on the library, the kawaii queentsun might have some new sets but i'll have to check more thoroughly
>>1317628
one of those was missing from the library (i actually found a couple of new sets still not on that site), uyuy is one of the cosplayers that will require a major overhaul though so i don't plan on updating her until V3
>>1317640
as pointed out here >>1317651 the only new cosplayer added to update 2 was striderscribe, there are a lot more sets than in the original megapack but i'm not sure about how it compares to the new megapack
>>1317988
i should be reachable through here or the account i set up as owner of cosplaybot (look in the description of https://bae.st/users/cosplaybot) or any of it's alts, you should be able to send messages to that account through any federated instance like mstdn.jp for example, other means can be setup later if necessary

i just finished re-scraping everything, i still have about 700gb to dedupe but there's already over 300 gb on updates and potentially up to 150 new cosplayers, probably it will end up being much less but still this is more than anticipated so depending on how things go i might just start with V3 directly without bothering with another V2 update

Some extras that might be interesting.

https://pastebin.com/9yEiNNAi

Looking forward to V3!

Is there any sort of tagged-system for the various cosplayers? To give an idea, for example, of which of them do PG content and which go all the way?

>>1318346
I used to have a 5-point rating system where 1 was no nudity whatsoever and 5 was full on penetration but it was a bit of a pain to verify, as it depends on the set and the tier etc
queenie chuppy used to do full nudity under the name QQuren, and then after three or four name changes she doesn't do anything more than gravure now, so it's just hard to track unless you go set by set and that gets old pretty quick. even then one set might be nude or not depending on tier and the nude tiers can cost tripple the regular price so it's rare to see them

plus, personally I don't care if they do nudity or not. some of these chicks with rocking bodies have mangled pussies so you're better off left guessing anyway. the mystery or whatever can be just as enticing IMO.
don't go looking for treasure and be disapointed when you don't find any, instead just have an adventure and be surprised when you find treasure.

>>1318064
there's an interesting situation with the shirogane pack, it doesn't have that many new sets but there are a lot of upscaled versions of the current ones, my current position on this is to leave the originals in the library even if they are technically lower res

I've started setting up for V3, considering that there are a lot of heavy hitters that will be overhauled (tokar, peachmilky, fantasyfactory, aninnyan, nekokoyoshi, hoshilily and nonsummerjack to name a few), 50ish new cosplayerrs (a couple of them 50+gb) plus the usual updates i'm expecting it to land somewhere around 3.5TB, i plan on keeping the naming convention the same so there should be significant file compatibility with V2 and i'll try to up the part size to around 500gb, as for the timeline, once i start working on it the deduping and renaming process of the new stuff should be done within a weekend or two at most but i plan on going through the current sets to try and make some names a bit more descriptive than "2b 2" or "jk17" and catch as many sets with wrong character names as i can so i don't really know when V3 is going to be ready

if anyone notices any errors in the current version that would help

>>1318533
>my current position on this is to leave the originals in the library even if they are technically lower res
good, most of those upscales have artifacts and look noticably worse. baffles me why people do upscaling at all when it's still so far away from being usable tech.

>>1318571
Well then make sure it's not a upscale.

>>1318533
original resolution, even if low resolution, is a thousand times better than all the upscale crap - upscale technology is constantly evolving, if I have the original, I can use something better myself at some point - if I want to.
but if i only have the upscale, i already have all the artifacts.
anyone who upscales something and uploads it because he thinks he's a patron should be put up against the wall and shot

>>1318533
Hm, looking at what you are trying to do, I would go as far as suggesting using something like https://github.com/rektbuildr/shafs for a reason.
If you have a map of file, paths and hashes you will be able to create delta of previous and current states. Which in turn can be used to generate move, copy and cleanup scripts.
Could probably even be used for V2 > V3 migration, hash V2, create V3, hash V3, generate a script that moves and renames file as needed. That way it is just a quick check and downloading of missing data, instead of manually trying to figure out what goes where or redownloading whole ass 3.5TB.

Anyone have an up-to-date torrent for uyuy2907?

>>1319825
i'm doing something similar, currently i'm using digikam, which stores the file paths, metadata, thumbnails and perceptual hashes of all images into two separate mariadb databases, i had to migrate from sqlite because i started to have issues roughly when the library reached a million images, for migrating from one version to other internally and doing backups i'm using rsync which only copies missing or changed data so that's not an issue, the reason i had to re-download everything is because i knew that the scrapers had missed a significant amount of sets (there was a bug where sometimes they would report success but didn't actually send the torrent to the download queue) the issue is that i can't really check whether i already have a specific imageset or not until i actually have downloaded it so i was forced to redownload everything in order to do the perceptual hash checks

some bad news, my workstation's mobo gave up a few days ago and took a disk array with it, specifically the one that had the work in progress V3, i keep backups of most of the cosplayers that are going to be overhauled, the full library (V2) and the more unusual stuff i found randomly but i lost the sets released since update 2, all the cosplayers with less than 10 sets and about 3TB of unknown sets, fortunately all of that should be easy to find again so this is an inconvenience rather than an irrecoverable situation

i'm already getting everything back up (the scrapers are already online) but to get to the point where i was this past weekend i'll need to scrape everything again so i'll push back the plans for V3 for now and focus on re-scraping all of the sets released since the 20th of june in order to make an update 3 for the cosplay library V2

>>1319953
>took a disk array with it

Time to use software raid next time. But if it was software you should be able to recover the array.

>>1319955
not that kind of array, i use my workstation mostly for fucking around and leave the reasonable setup for the homeserver, in this case the main storage partition on the workstation was running an encrypted btrfs filesystem using raid0 so as dangerous as you can get for both data preserving and data recovery, i was unlucky in that the thing blew up really badly and at the worst possible moment just a few days before making my next major backup but i absolutely had it coming

in any case the drives are already formatted and i'm currently in the process pulling the backup stuff from my homeserver so it's too late now

>raid0 strikes again
>"just unlucky"
the 0 in raid0 stands for how many use cases it has

>>1318346
look up stash app
you could download everything,do your sort and distribute the database with it

>>1320003
stash won't tag it for him, he will still need to either download tags someone else has made or tag it himself, and anyway the extent of auto-tagging is by path/filename as i don't believe stash does hash-based tagging of galleries or images (even if it did images who the fuck is tagging every single pic). hardly any of these onlyfans or whatever chicks are on any real database with api access, and since TPDB shut down theres been no real way to get good tags without doxxing yourself to discord, joining their gay little circle and begging for an invite to stashbox. and that won't tell you who does nudes vs lewds anyway, as I said earlier that's also hard to define unless you go set by set.

maybe, MAYBE, hydrus can help, if there happens to be a cosplay-booru of some sort you can scrape tags from - but at that point why aren't you just scraping images that booru instead of torrenting.

>>1320008
fuck hydrus its a god damn mess trying to do so many things and only implementing 10% an moving on

>>1320009
hydrus is without a doubt one of if not the worst piece of software I have ever used (and I have to use MYOB and royalTS daily)
if all you want to do is download everything from a booru and only have some massive database of booru images, it does that I guess
but you could also just run a booru clone out of nginx or something, which takes about 64GB less ram and doesn't need half a terrabyte of disk space to store metadata for 300GB of images

>>1319979
I'll be real, it's retarded that you did "-d raid0 -m raid0" on btrfs. At least go with "-d raid0 -m raid1" or better yet, "-d single -m raid1" on multiple devices. If you want that type of setup. Do a "btrfs balance start -mconvert=raid1" if your meta is raid0.
And do me a favor, create a cronjob for your backups, since it sounds to be an additive backup.
>for migrating from one version to other internally and doing backups i'm using rsync
The part I was talking about is for the peeps downloading the torrents. For users to be able to restructure the already downloaded data to a "new layout", or whatever you come up with. Or if you intend to change the layout in the future.

>>1320442
> -d single -m raid1
yeah, i just have the habit of calling any filesystem that spans multiple drives without redundancy raid0, the disks were fairly full and i couldn't even decrypt one of them so i figured it would be easier for me to just start from scratch than to work around a partial set of files that might be corrupted to some degree so i decided to declare the array dead, most importantly after wasting an off day on building and setting up a new pc i really wasn't in the best of moods and the data was replaceable anyway so i said "fuck it, i'll just do it again", formatted the drives and went to bed, reflecting on it after the fact i think i should have at least tried to salvage something but it's too late for that now

i can't really use a cronjob for this stuff, there is a lot of bulk renaming and moving of files going on while i work on a new update, if i was to set up automatic backups i would be transferring the update several times over and we are talking about somewhere between 300gb and a tb of data, that's why so far i've been only making backups once the naming and structure of the files is mostly settled

a migration script sounds like a good idea if i ever change the naming scheme, it shouldn't be hard to log any filename or path changes i make

>>1320471
rsnapshotd won't help, since you are moving files back and forth between folders. restic and borg are... they will backup and dedupe things properly, but accessing the data might be a tad bit of an effort. Actually, now that I think about it.
Actally, 3TB at 1gbit would be ~8hr of transfer time. And 300g would take less than an hour. I've got a simpler suggestion for you. If the data on your pc is just an updated version of data on your storage, then "rclone copy" hourly and once you reach some milestone(or start running out of storage), "rclone sync".
>inb4 I lost ALL of my data
Your nas does snapshots, right?

>>1318533
Is there any place to get the most recent shirogane stuff? I can't find any of her new posts on kemono.

>>1320482
i don't ever work directly on the library itself, updates are kept separate until they are released and only get fully integrated into the library when i confirm there are no shenanigans going on, once integrated all files are set to read-only to prevent accidental mishaps, another important point is that i have to use perceptual hashes, regular hashes are pretty much useless for finding image dupes

this is a more detailed breakdown of how i manage the data relevant to the library
1 - raw automatically scraped data -> single copy, workstation - up to 2tb (depends on how much time has passed since last update)
2 - manually obtained or difficult to find raw data -> two copies, workstation and homeserver (raid1) - roughly 1tb x 3
3 - partially processed data -> single copy (workstation) - 4-5tb (this accounts for the cosplayers that don't make the cut yet and a bunch of unidentified sets)
4 - WIP update -> single copy (workstation) - 300gb to 2tb (starts at around 2tb and gets smaller after deduping)
5 - released data -> two copies, workstation and homeserver (non redundant filesystem) - 3tb x 2

my reasoning for using that particular scheme is that the automated stuff can always be replaced and if for some reason i lose the released data i can just torrent it back so as long as i have the rare stuff i can recover from most eventualities within a few weeks of running mostly automated processes, sure i could also backup 1, 3, 4 but i would need at least an extra 10 tb (more as i expand the library), adding snapshots and automated backups on top of it would drastically increase the storage needs (snapshots) and saturate my network and IO for significant periods of time (automated backups) and that's not even considering using raid1

>>1320504
any examples of sets you want?, i might have some of them but i don't know which ones are the most recent

>>1320622
I mostly asked because she recently advertised some asuka x mari pictures on her twitter, and when I checked on kemono I saw there hasn't been any new uploads on there since february, so I am genuinely just curious what is missing on there.
I see that on the torrent there isnt any Ryouka (kill la kill) or her shadowheart set either, but if you could somehow get this new one that would be amazing.
Link : https://x.com/shirogane__sama/status/1817274306151465202

File: 262B144A-3DBF-49FA-A4C5-1(...).jpg (1.32 MB, 5472x3078)

1.32 MB JPG

>>1314215
>>1314215
can you add yuumeilyn anon from this site
https://simpcity.su/threads/linhi_cute-yuumeilyn.98479/page-2

https://fantia.jp/fanclubs/70459

anyone know where to find stuff from this girl?

>>1320628
i don't have the asuka x mari set but i think the other two are on the library already, i don't know which part specifically but probably one of the updates
>>1320916
sure, doing some digging on her it seems that very few of her image sets have leaked but i think that between that page and what i already had it should be enough to put her on the next update
>>1321265
you should be able to find a couple of her sets if you look for "moumoku", there's not a lot of her stuff floating around the internet though

File: GEY2GbHXYAEs9m6.jpg (222 KB, 1000x1500)

222 KB JPG

So the content megapack isn't working at all anymore? Damn. Does anyone have shaeunderscore content?

>>1322043
Never mind, I'm retarded, it was working but I was fucking things up.
I have noticed that all of her elf stuff is missing from this collection, though, including in the recent updates.

Any content of this lady besides the official sources (insta, twitter, etc)?

https://x.com/puutin_cos

>>1322068
there are a few new sets slated for the next update, at least 4-5 from what i can see but i don't think i have the elf ones yet
>>1322456
there's only a set that i could find floating around, i've set a query for her on the crawler just in case but asian stuff is fairly difficult to find, at least she's not chinese so it could be worse but it's not looking good

i'll start deduping the first few TB of crawled stuff this week, from what i remember there should be about 250gigs of updates and probably another hundred on new cosplayers adding that to the couple hundred gigs of new sets (not including overhauls) from the stuff that survived from the array fail i should have enough to start blocking the next update or two

>>1323279
So, will the be an additive update on top of all the other releases? Or are you cooking a completely new release?

>>1310539
anything with Eula or fuck off

File: elycosplay_eula_003.jpg (1.36 MB, 1365x2048)

1.36 MB JPG

>>1323281
for now i plan on working on it as if it was preparing additive updates, the most likely scenario is that i'll make a last additive update and then a full rework but it could be two additive updates and full rework or full rework right off the bat, i'll decide what to do depending on where the crawlers are once i've finished sorting the current batch
>>1320628
turns out i had the mari x asuka set, it was just merged with a different a couple of other sets and mislabeled

Are all Cosplay_Megapack seeders dead? Half of the torrents are stuck a 99% missing just few kbs..

Very large torrents like the cosplay megapack sections absolutely destroy my client (qbit in a docker container, webui). I gave it a ton of resources, any tips or do i just need to use something else to browse it?

>>1324412
i meant the cosplay_photo_library, not megapack. derp

>>1324412
unfortunately theres nothing you can do, this is a limitation of bittorrent and all it's implimentations. libtransmission (used by, well, transmission) can handle larger files better than libtorrent (used by qbit and most others) but both suffer massively with high file counts
bittorrent 2 was supposed to help, and it did, but you gotta remember every file has a SHA-1 hash, meaning your client has to decode a hash for every file. I'm not super familiar with the deeper inner workings of tge protocol, but I can say it suffers greatly with high file counts.

the solutions are:
>1 - split the torrent up into smaller chunks
this has issues with distrobution, updates, and seeder distrobution. just look at >>1324022 or the photo library anon's thoughts on updates to his packs. but this is the best solution so far
>2 - zip/flatten files
terrible for seeding as you need to store two copies, one flattened and one unpacked, thus doubling space requirements. also prevents people from cross-seeding as easily, and makes it hard to preview
>3 - make a better protocol
actually I think increasing the piece size would help a lot but then some clients can struggle with larger pieces. I think I made the megapack with 16MB pieces, but you can go up to i think 512MB which reduces the total number of pieces, but this makes the traffic rape your network bandwidth and increases the chances of corruption

gotta remember bittorrent is like a 30 year old protocol and even v2 is like 15 years old and was never designed for high file counts. it was almost literally made for linux ISOs.

>>1324458
if you're using qbittorrent from webUI, try VueTorrent as a GUI, it absolutely handles big torrent files without problems. The problem is not the lib but the actual webui trying to load all of the content in a single call. VueTorrent as a gui doesn't have this problem.

>>1324487

Appreciate the guidance from both of you. I think i explained myself poorly but >>1324499 figured out what I meant. Still learned a few things!

>>1324499
>>1324504
ah, gotcha. any chance you know a good webUI for transmission, as flood has a similar issue but at least runs fast until I go to the files tab of a given torrent

in fairness the libs also struggle, especially libtransmission which is STILL single fucking threaded for move/copy operations meaning any move/copy stalls your entire client for the entire duration, not relevant to this discussion so much but i'll bitch until it's fixed

but also older versions libtorrent fall over adding torrents with over 10MB of metadata, and newer ones only increase that to about 50MB. good webui or not, 10,000,000 files will destroy any torrent client

>download megapack
>see hidori rose
>'damn that's a name I haven't seen in a while, I wonder what she's up to now?'
>Check OF
>Fake tits
>Botoxed as all hell lips
Well, at least I can enjoy everything shy of the past two years.

I recommend "Mio" and "Ayame" those cosplayer
https://x.com/_AyameAyame?t=5dZigW71CQ3BpFvlk61Xyw&s=09

https://x.com/Miooooooorin?t=JhuKmEO4cAdhtdSDUg5CEg&s=09

>>1324548
personally whenever i use transmission i like to connect to it through transgui, mostly because its a very similar ui to qbittorrent and it's very performant but i haven't really tried it with torrrents as large as the library, on a sidenote transmission has mostly remote UIs as opposed to webUIs doesn't really matter that much but could help you look for them

update on the library:

things went way smoother than expected, currently i have 400 gigs of updated cosplayers and 200gigs of new cosplayers ready to post (completely deduped and formatted), that said the crawlers have stopped finding new old sets so i'm now in a position where i can start working on a full overhaul (aka V3) so i think i'm gonna jump directly to that, basically what's left to do is integrate some major cosplayer overhauls where most of the sets of certain cosplayers would be replaced with higher quality versions and dedupe the current gallery against itself (removing the low res sets that have hires versions available) plus trying to fix some issues like fragmented sets, badly formatted sets and other minor mistakes

i'm guessing this V3 would be around 3.5-4tb in size and i'll try dividing it on 500gb parts, other than that i plan on keeping the format of the current library unless there are any better suggestions on the matter

>>1324941
So, update 3 will be skipped in favor of V3?

As long as there are upgrading instruction to reuse the previous files instead of requiring a full redownload, this sounds good.

File: bukkit (2).jpg (585 KB, 2449x3265)

585 KB JPG

>>1310539
whore is bukkit brown? i cna find her in the library
does the old magnet from archive works?

>>1324979
she's a bit of an interesting case, it seems that there were a bunch of torrents of her but they're all dead, i've had them on queue for months

>>1324952
while i'm not planning on explicitly making V3 files compatible with V2 they should still be largely compatible, the only difference is that there will be name clashes (some files on V3 will have the same name as different files on V2), here's a method that would work for migrating the compatible files from V2 to V3, i've used it before several times:
(this method is very hacky and relies on quirks specific to qbittorrent, might not work for other clients)
1 - stop seeding V2
2 - add the V3 torrents on the same folder as V2, qbittorrent will start checking files, wait until it finishes checking, be patient, will take a while
3 - right click on the torrent -> torrent options -> change the save path to a different directory WITHIN THE SAME DRIVE
4 - at this point the compatible files will be moved to the new directory, leaving the non compatible files in the old one
5 - repeat for all parts of the V3
6 - delete the remaining non-compatible files on the old directory, move the V3 files back to the old directory if desired

everything is merged and deduped, i'll start checking everything this weekend, in the end it seems that V3 is gonna be 3.6TB in size and feature 660 cosplayers but i might push it to 666 just for the meme if i get the time

>>1325471
if you're overwriting shit no one is going to use this shit much less seed it
You'd do best to rename them or make a new folder or something because if i spent a month downloading this and suddenly you say you're going to overwrite it
i aint seeding shit

>>1325719
i don't really care either way, if i just add the better quality stuff i have without overwriting there will be easily about 300-400 gb of duplicate files but if people prefer having that instead of a new version with trimmed fat i can do that too, it's also way more convenient for me

that said if i roll back the changes and go back to creating new parts for v2 now i won't be doing a v3 at any point, the project is way too big already to do a full refactor and at this point the only reason i was going to make v3 is because i had already started by the time i noticed how much manual work it would take (i only noticed around the time i made the last post) and it's only going to get worse as the library grows

>>1325730
There is a difference between telling me you're going to spill shit all over the torrents i just spent a month downloading and have been seeding
and replacing them with better stuff in direct place of the old file and not renaming folders /files and spilling shit everywhere

>>1325731
oh, yeah, the files being replaced would be replaced for higher quality versions of themselves, roughly 90% of files would remain the same, it's just that until now if i had a new higher quality version of a set i just named it like this in order for every torrent to remain 100% compatible

"/cosplayer/set"
"/cosplayer/set hires"

the idea was to delete "/cosplayer/set" and rename "/cosplayer/set hires" to "cosplayer/set", there would also be some side effects from fixing things like some cosplayers that were divided in two folders like 爱老师 - 爱老师_phd and wildhoney - wildhoney423

the reason i frame it as a new, incompatible version of the library is that as far as i know the only client that would be able to work as usual is qbittorrent since it just overwrites a file when it doesn't match (transmission throws an error if there is a file with the same name but different hash) so it might be less confusing that way

in any case i'll leave it alone for a while to see whats the general opinion, at this point i can still revert back to V2 pretty easily so i could either post V2 update 3 or V3 part 1 within a couple of days

honestly i'm starting to think that just making V2 update 3 would be way less problematic, 300gb of dupes sounds like a lot but in the end it's less than 10% of the total and i don't really trust the people over at nyaa to realize what's going on

anon I vote for the original plan. I see a future where we will have a solution to the torrent issue.

But in the meantime full V3 is a must. I still hope it's still in the plan for this weekend.

Also to the reeeing people don't download it. It's that simple.


As the sukebei poster I will let the nyaa lads know.

>>1325741
>It's that simple.
It isnt
If you're replacing things verbaitm with higher quality, go for it
If you're spilling new files that are higher quality in the same folder and now i have dual copies
fuck off
If i cant point v3 at v2 and have it fill in then whats the point in using torrents or having a mega collection if everything is going to be in disaray causing me hours of manually going through random folders looking for new copies of files?

Send v3 but dont spill shit
It's simple.

>>1325742
there's not much to do either way, if i go with v3 i just need to merge/rename the last 264 sets which is a matter of minutes and write the new docs, if i go back to v2 it's a matter of syncing the backup copy so this is not a big delay

i can see merits on both approaches, V2 would be the most straightforward thing to do and would be much cleaner, just because there is a V3 V2 will not just disappear from the internet and will probably cause confusion to people stumbling upon it potentially for years, also even if i make V3 and delete all the dupes that there are now in a few months time the library will probably be on the same situation and a major move like transitioning to V3 could end up in a situation similar to the new version of the megapack or the latest version of the graphis megapack that is being worked on on another thread (no relation to me), the more popular version could remain V2 because of a larger number of seeders and V3 could just die, at that point picking V2 back up again would be a lot harder

on the other hand staying on V2 means a lot of useless files being shared unnecessarily translating to a significant amount of bandwidth/storage wasted but since all of this is very theoretical and my only point of contact with any of the people seeding is this thread i'll wait a while and extrapolate from what i hear here, i'd rather get this right in 4-5 days than wrong tomorrow

>>1325741
there would be some cleanup needed but not manual necessarily, if you are using qbittorrent (i know i'm repeating myself), you'd point V3 to V2, download the 10% delta or whatever between the two and then do >>1325730 all the files corresponding to V3 will now be on the new folder and the spilled shit would remain on the old one and in any case even if you don't bother with that the spilled shit would be smaller than what there is now on the library, maybe a few low res dupes at the end of some sets as opposed to having low res dupes on their own folder

can you just post a changelog of the two options and then run a strawpoll

i'd rather kill my unfinished V2 and download a trimmed V3 than finish V2, manually clean it up and add more uodates

the previous post is probably confusing, me fucking up the links probably didn't help either, i meant >>1325471

let me put it on more specific terms, if you were to point the hypothetical V3 to the files of V2 you'd get a series of torrents about 80%-90% complete, once that remaining 10-20% is downloaded as you mention you'd have some "junk files", those would be the folders containing the string "hires" and some files that might not have been overwritten, for example in case that a hires set had less images than its low res version (usually due to a frontpage or some random edited files) the last couple of images would be remains from V2, since the torrent client does not keep track of those junk files you can just move the torrent from the torrent client as mentioned here >>1325471 effectively separating the junk from the new stuff

>>1325754
sure, i'll look into it tomorrow but that shit is easily spoofed so i wouldn't necessarily trust it more than what is being discussed here

i'll do a more detailed changelog later but here are some simple stats i can quickly get
currently there are 178 "hires" sets on the library
there are 264 "hires sets" slated for the next two updates (assuming i continue with V2)
not sure about how many other higher quality dupes there are on the cosplayers that i consider full refactor but i'd guess about 100 (way less than i thought originally)

so making a V3 would only trim about 550 sets out of about 30k in total IRC, it translates to a relatively high percentage of HDD space because some of those lower res files were still pretty large

>>1325758
Okay honestly I would prefer not to have an hires folder with duplicates of photos at an higher res.

Because at that point I'd write a script for moving those back to the original folder and removing the dupes, that would throw off qbittorrent and suddenly I'm not seeding this anymore.

As low dupes as possible is probably the most important thing for me, alongside having a clear folder structure (that I can then navigate and filter using a regex).

Would you lads want a bash script that deletes all the untracked files from a torrent?

So you can simply download over it?

Actually, it's pretty simple to handle stuff like this. I asked ChatGPT to make a Python script to list the files in a torrent file. Then just simply do a diff between the current files and the torrent. then delete the extra files.

>>1325747
The above solution makes that a non-problem. You can easily clean up what was left behind.

>>1325782
>You can easily clean up what was left behind.
i shouldnt have too is the point
If im going to be seeding something this large for a long time i dont want to have stray shit

>>1325777
absofuckinglutly

>>1325777
>>1325840
that could be a solution as well, just a word of caution there are well over a million files across all torrents so be careful about how you do the matching, i'm just hesitant to make an executable file that would delete files (plus i don't know how i would handle it for windows users), another approach if you're on linux is to just run a find command to delete all directories with "hires" on the name, that would take care of most stuff and it's a one liner, as i mention before currently on V2 the shit is already spilled to continue with the analogy, there are currently 178 redundant galleries and would grow up to over 500 in the next couple of updates

after thinking on it for a while the main reason i'm hesitating to go forward with v3 are:
- V2 has an average of about 20 seeds already across all parts, V3 is not really that much of an upgrade so i could see a lot of people not noticing, not upgrading because it's a very large and complex series of torrents or choosing to download V2 over V3 because of a higher number of seeders
- even if i trim the sets i have duplicate now presumably within the next few updates i'll have new duplicates and at that point we'll be on this situation again
- after making V3, V2 will still be roaming around the internet and there's no way of distinguishing between them without looking at the docs, considering point two if i keep making new versions as dupes increase we could end up in a situation where the DHT network gets flooded with a bunch of torrents containing mostly the same stuff
- if someone makes some sort of side torrent, for example a video addition that would add videos for some cosplayers while adhering to the library structure i would be fucking them over by changing said structure even slightly

so how about this: i keep the V2 structure for now and maybe in the future once i get bored of updating it we could consider finishing things with a bang by making a definitive V3 version

>>1325846
anon you talking about the issue torrents had since forever. There's no changing that. Also worrying about seeds is pointless as over time with the flow of users, it's the nature of the internet. Some will have more downloads/seeds than others and that will be a fact. Also remember we can easily solve the untracked files with a python script so people will not be scared of running an exe.

But anyways anon, I just put the torrents on nyaa. It’s your torrent, it's up to you.

Just want to know any cosplayer focused on feet? I remember it being a thing several years ago and stopped seeing as many.

>>1325901
i think i'm going to go with >>1325846 , continue regular updates to V2 whenever i decide to stop i'll end up with a big cleanup, if i make v3 now i'll have to make v4 in a few months to keep consistency, then V5... and this would end up being a clustefuck, even in an ideal case where people upgrade every time shit would be messy and confusing after a couple of cycles

whenever i make V3 i can also include a txt with all the relative paths to all the removed/changed directories, that would trivialize making the scripts, btw i'm not sure about this but don't think python comes preinstalled on windows so i'd probably go with a bat for windows users and a shellscript (or python) for *nix users to cover all bases

>>1325950
do you remember anything specific about any of those cosplayers?, at this point i've at least skimmed through sets from probably over a thousand of them and i don't remember seeing anyone particularly focused on feet, most of them will randomly have some relevant images scattered around a few of their sets though

also, maybe not exactly what you're looking for but i've noticed that chinese cosplayers are generally very leg focused, lots of heels/pantyhose stuff

>>1325965
Keep the same naming scheme and dont fuck with old content and you can release v3 now and have new people download it as a standalone and seeders grab it as an update and copy it over their existing folder with no problems. Remove the torrent t hen add the new torrent to the old folder,run a check and continue on

>>1325965
Honestly it's been a while i wouldn't say 100% feet but they would show a good amount it and yeah very leg focused might be better way to put it, with and with pantyhose off and on depending on cosplay and stuff.

File: noshiro.jpg (3.01 MB, 4096x6141)

3.01 MB JPG

>>1325978
well... i've finished building both versions and done a delta, turns out that there's not that much of a difference

current library -> 2.8tb
new stuff -> 848.2gib
V2 total -> 3.65tb
V3 total -> 3.59tb

so i'll be going ahead as described here >>1325965

for some context my previous calculation was skewed because for some of the full cosplayer overhauls i was considering the new files as the originals while i usually consider the library files as the originals so a lot of galleries were unnecessarily marked as changed, the main ones bloating the numbers were hoshilily (61.3gb), nekokoyoshi (51gb), siao ding (80.7gb) and qiuhe keji (56.7gb)

so going for a v3 at this point might have been an overreaction anyways, i also expect to be getting less low quality versions of sets from now on, most of the newer stuff is on high quality from the beginning

>>1326057
in that case i'd say most of the asian cosplayers fit the bill, especially chinese ones but a lot of the japanese too

>>1326069
Any you would recommend just due to lack of space? But fair fair

>>1326079
i know the one in the photo is mime弥美 but i don't really have a good mental map of the asian cosplayers (mostly because i can't read their names), i made a bot in tandem with the cosplay library https://bae.st/users/cosplaybot that posts random images together with the cosplayer name as a way for people to have a preview and maybe find new cosplayers they might be interested in, looking at that might help

>>1326081
Oh cool will look into and will look into the bot

Thanks

Any chance we can get a github of the scrapers used?

>>1326145
the crawlers themselves are all custom coded for specific sites and my specific workflow, software i use, etc, they're simple enough that i'm not even bundling them on a project or commenting the code so they wouldn't be particularly helpful, essentially i treat them like disposable scripts

if you want to build your own i'm using a combination of scrapy and playwright, usually you can get away with scrapy alone but some sites might require playwright and you can link them together if you want through a package called scrapy-playwright (it's on the scrapy documentation), for reference scrapers are usually only about 150-300 LOC and half of that is for keeping track of stuff and writing metadata on text files for use later on when i'm formatting the library or other related miscellaneous tasks, oh and for crawling the DHT network i use a piece of software called bitmagnet

i already have some stats of update 3, it will be 299.3 gb in size and contain 22 new cosplayers and 170 updated ones, due to the way i structured update 2 this time a lot of the updates will either only add a couple of sets or a lot of them (one has 71 new sets) but not a lot of in-between, i still have do some final manual checks, cleanup and other misc tasks but i'll probably be posting it at some point this week

so, did someone get that "Golden Birthday" video of Mikomi Hokina? Where she did get fully naked, with masturbation etc?

Does anyone know any cosplay photoshoot with female chastity belt? Would be so hot to see 2B from nier automata belted

>>1323823
>turns out i had the mari x asuka set
Oh shit that's awesome, I'm assuming it will be included in the v3. Looking forward to its release.

>>1326659
i forgot about that so i slated for update 4, i'll move it up to update 3 and rehash it, should be posted in a few hours

in the end it will be a regular update (cosplay_photo_library V2 - update 3) and will have 22 new cosplayers and 171 updates for a total size of 299.7gb

File: v2u3.jpg (2.41 MB, 4000x6000)

2.41 MB JPG

COSPLAY_PHOTO_LIBRARY V2 - Update 3 (171 cosplayer updates + 22 new cosplayers - 299.7GiB)
>info:
https://rentry.org/coslibraryv2
>preview (a bot that posts one random image from the library every hour, should give a decent cross section of the library):
https://bae.st/users/cosplaybot
>magnet link:
magnet:?xt=urn:btih:819eda8266c150595b2f2ced724c55e6c6bad83d&dn=cosplay_photo_library&tr=http://sukebei.tracker.wf:8888/announce&tr=udp://open.demonii.com:1337/announce&tr=udp://open.stealth.si:80/announce&tr=udp://tracker.opentrackr.org:1337/announce&tr=udp://explodie.org:6969&tr=udp://tracker.torrent.eu.org:451/announce
>.torrent file (for the people having problems fetching the metadata):
https://files.catbox.moe/hqjn5g.torrent

>>1326810
i just noticed the torrent file linked through catbox in the previous post doesn't have trackers, this shouldn't matter at all as long as you have DHT enabled but here's a version with trackers just in case https://files.catbox.moe/lplojn.torrent

>>1326810
>https://rentry.org/coslibraryv2
https://sukebei.nyaa.si/view/4168148

>>1326810
Cosplay anon what premium file host would you make the most out of?

>>1327208
Just use a debrid agent

>>1326810
Peachmilky is not part of this?

>>1327227
anon that's not what I meant. I was talking about sites that have sets on them.

>>1327291
nvm anon I never new what a debrid was. Kinda cool however does not support everything. My question still stands tho.

>>1327208
you can try bunkr but i don't know of any site specific for cosplay that has direct download links premium or otherwise, there are some random forums around the internet with some cosplay sets mixed in but they normally use different hosts and it's not nearly as complete, convenient or at this point fast as the library (admittedly i'm biased on this regard), you might find some more recent sets there though, i'm usually behind by a few months since i'm not a primary source, i'm just compiling stuff

>>1327286
no, i had to split what i had in two parts and i just divided the content randomly, she'll be on the next one, i think de delta is about 18gb but i just added some more stuff from the crawlers and i need to dedupe again so it might be less

not a particularly important update but bae is closing down in about a month so the bot for the previews (https://bae.st/users/cosplaybot) will be moved relatively soon, i'll probably take this chance to improve some of it's code and maybe add some new feature, i'll start seriously looking for a new instance after that

File: file.png (2.57 MB, 1620x1080)

2.57 MB PNG

>>1326810
Going through some galleries and "cosplay_photo_library/软软趴在床单上/软软趴在床单上 - casual 7" appears to be broken? 60% of files corrupted.
Mate, is it possible that you had corruption on your drive even before the last fuckup?

>>1327757
+1 same on my end

>>1327757
yeah,there are some corrupted files, i mention it here https://rentry.org/coslibraryv2
> The original library had a substantial amount of duplicates as well as some formatting errors and corrupted images this issues have been largely taken care of on v2

you can probably find more if you check the asian cosplayers especially since a lot of those came out of fairly sketchy torrents, usually second or third generation and only partially seeded and while i delete as many corrupted files as i can find some make it through due to sheer numbers alone, to give some further insight on my QC process i use a script to view the first image of a set to check if the character and name matches and modify it if necessary, after that i also check for inconsistencies on file sizes and file names and make some random sample checking before posting an update

long story short i'm aware that there are some corrupted files but i can't really check them all so i only make partial visual checks and automated checks based on file properties

oh, a little caveat since i noticed the first image of the mentioned set is corrupted, the image i check for the script mentioned above is not necessarily the first one you see on the set, i use alphabetical sorting to check the original files but natural sorting for renaming them before posting (it's an OS thing)

File: 1638884553921.jpg (1.11 MB, 2000x3000)

1.11 MB JPG

I believe, the lady named blacqkl is missing some sets that should be identifiable by the names:
白莉爱吃巧克力 - 安琪拉
白莉爱吃巧克力 - 宵宫
白莉爱吃巧克力 - 甘雨
白莉爱吃巧克力 - 香奈乎

ShaeUnderscore is missing "Seras Victoria" set
Danielle Beaulieu is missing "Charlie" set

I also would really appreciate an update for the ladies: Pudding Desu (aka Puddingu), Victoria Lirell, Djarii, Dzikan and mercury_lamp (do not mix up with the trap mercurylamp who is already in a set).

File: fangs.jpg (1.52 MB, 4000x6000)

1.52 MB JPG

>>1327875
> blacql
good catch, the name threw me off
> seras victoria
i think it's on the library as "fangs", it probably didn't get picked by the autorenamer (picrel) and i didn't recognize the character visually
> charlie set, victoria lirell
already slated for the next update
> Puddingu, Djarii, Dzikan
i don't have enough of their sets to include them for now (i'm trying to include cosplayers with 10+ sets), i'l set up some specific scrapers for them but from what i can tell there are very limited sources for those cosplayers, puddingu and dzikan in particular only get relevant returns on ehtracker which is never a good sign, it means there's a very small amount of their content around
> mercury_lamp vs mercurylamp
that's gonna be a hard one to deal with

> i think it's on the library as "fangs"

Correct, thank you.

> already slated for the next update

Cheers

> i don't have enough of their sets to include them for now

Understandable. I've got four of each and could share if there is any point.

> that's gonna be a hard one to deal with

Apparently it is also a character's name, so it is rather next to impossible (being automated at least)

>>1327444
for now i've moved the bot to https://mstdn.jp/@cosplaybot , it's far from ideal since that instance only allows bots to make unlisted posts so it won't be a vector for people to find about the library anymore but should provide the same functionality as the other one as long as you are aware of its existence

i'll wait for a bit before updating the docs in case i move it again

Does Hane Ame actually show nipples and vagina?
If not I don't see a reason to download.

>>1328415
i guess this is update updated link

https://varishangout.net/users/cosplaybot

>>1328431
At this point I am convinced I have seen every inch of her breast's surface over the course of her wearing various bikini's that only cover a certain portion at any given time. This is to say I am absolutely certain she has had her nipples out for several cosplays she ahs done and then just photoshopped over them.

But to answer your question, no.

>>1328431
>Does my dick actually go inside her pussy?
>If not I see no reason to cum

This is a childish mentality only held by retards. Beauty and sex appeal goes far beyond 0.02cm of flesh shown on camera

>>1328548
>>1328415
yeah, in the end i decided to put the bot on https://varishangout.net/users/cosplaybot

in addition to the "only unlisted posts" limitation of mstdn.jp turns out that mastodon (or the version mstdn.jp is running at least) heavily compresses images, i'm talking not only a very significant quality reduction but also a downscaling to a maximum of 1764x1764 and that really messes up with images, especially when dealing with very large ones also if the image is large enough the API just throws an error so in the end i just decided to move the whole thing to a pleroma instance

i've also made a bunch of bugfixes to the bot's cosplay request system, should be far more consistent now

File: 1716315514250002.jpg (469 KB, 1461x2122)

469 KB JPG

Can someone share Ringo Mitsuki - Nian ROM? This was removed from her Fantia
https://fantia.jp/products/558917

Anybody have PityKitty's Xenoblade videos?

File: GXBE2oWbsAAuUC0.jpg (377 KB, 1194x2048)

377 KB JPG

Anybody got that video or a torrent with Anniie_d stuff with the gwen cosplay ?

i'm on the last stages of getting update 4 of the library ready so i'll be posting that soon, i'm having trouble gauging the actual seeders/leechers situation but update 3 it isn't pulling very hard anymore so it's probably time, it will include the peachmily updates and the 西瓜少女 stuff, i'm still waiting on some bukkit brown sets but at this rate i think she'll be on update 5 (i already have more than 10 sets but i think i can get more)

in theory i still have enough stuff remaining to make update 5 but i might wait until i have some more stuff so i can balance it better in terms of number of cosplayers and new sets per cosplayer

File: Screenshot_2024-09-12-13-(...).jpg (30 KB, 440x224)

30 KB JPG

I hope people like my seeding.

>>1329285
anon u alright?

>>1330830
yeah, i got sidetracked with other stuff but i still check the thread from time to time

some updates on the library:

update 4 is pretty much ready to go, it only needs some final touches and a final inspection, it should contain 8 new and 257 updated cosplayers for a total of 298.2gb, i will probably post it before the end of the week

i have enough stuff for update 5 but there are 4 cosplayers with 30-50gb of new/updated sets each so i'll probably wait a bit and spread them between updates 5 and 6 to avoid dedicating half an update to just 4 cosplayers (even then i might still have enough stuff already for update 5 at least but we'll see)

>>1330992
thanks for the update anon. I was just Concerned.

Any Newbnika/BVeronica/Nikachu18/Newbveronika torrents?

File: okitarinka_shiroganenoelb(...).jpg (3.67 MB, 4672x7008)

3.67 MB JPG

COSPLAY_PHOTO_LIBRARY V2 - Update 4 (257 cosplayer updates + 8 new cosplayers - 298.16GiB)
>info:
https://rentry.org/coslibraryv2
>preview (a bot that posts one random image from the library every hour, should give a decent cross section of the library):
https://varishangout.net/users/cosplaybot
>magnet link:
magnet:?xt=urn:btih:d6351b83269d773f6091ad2751e8da8a3b00bca7&dn=cosplay_photo_library&tr=http://sukebei.tracker.wf:8888/announce&tr=udp://open.demonii.com:1337/announce&tr=udp://open.stealth.si:80/announce&tr=udp://tracker.opentrackr.org:1337/announce&tr=udp://explodie.org:6969&tr=udp://tracker.torrent.eu.org:451/announce
>.torrent file (for the people having problems fetching the metadata):
https://files.catbox.moe/txck69.torrent

>>1331394
Thanks, I think there are some new ones from peachmilky on the simpcity forum that are missing

>>1331394
https://sukebei.nyaa.si/view/4179576

Kind of unrelated but does anyone have cosplay blueprint/pattern torrents? Like stuff from Tiffany Gordon? No way I'm paying $6 for each items pattern

I follow a russian telegram channel that publishes a bunch of high quality cosplay sets of onlyfans girls, I can't find many of the girls in the collection :>
would be nice if <10 sets were also included, there are probably a lot of pearls that i just miss out on

>>1331637
share the channel URL anon.

>>1329260
bump for whoever this is

>>1331482
yeah, i will always be a few weeks/months behind the newest stuff, in this case i don't think i have those sets yet i'll look further into it if the crawlers don't pick them automatically within the next few days
>>1331637
well.. it was a bit of a balancing act, currently there are somewhere between 600 and 700 cosplayers with less than 10 sets but most of them are not great, i'm operating on the assumption that the good ones will eventually put out more sets and go over the 10 set limit (i'ts not like there's a lack of content anyway)

n regards to missing cosplayers it usually comes down to the number of leaks, i have a massive folder with cosplay stuff that couldn't be automatically attributed to any cosplayer my scripts know about so i just scroll through it from time to time looking for any name i see repeated a few times and add it manually to the "known cosplayer" list

i also check the thread from time to time in case someone mentions a new cosplayer but usually i don't find any leaks on those

>>1331699
setup a discord or irc channel or something
people will throw stuff at you and can organize in mass vs one person

>>1331751
I second this.

>>1331751
+1 for irc, they are based and comfy. hell make an slsk room and that solves the torrent update problem as people can just ddl from there (obviously not as fast/reliable as a swarm though)

-1 for discord, centralised mass surveilance BS that acts as malware

anyone have petra.fyed sets

>>1331844
do you think the NSA is interested in the weebs who send cosplayer sets to each other?
if you ever run for US president no one will blackmail you because you collected japanese tits with pasties in a costume

>>1332321
that is an incredibly dated fear
the new reason to avoid mass surveilance like this is to avoid having your entire life tailored by corperations because they know everything you do and can scientifically distill your actions into ways to exploit you for profit. everything you see and hear is foverned for you, and what you see and hear determines yiur point of view on the world around you. by only showing you what they want you to hear, you become their slave. and by tracking every minor thing you do, from the messages you send on discord to the food you buy at wallmart and so on, they can make this (for lack of a better term) brainwashing entirely invisible.

they already know how you will react because they know everything about you. you won't agree with anything I say about this either, because they are so good at seemlessly blending it into your life. but you can see it at work so easily - look at the chinese social credit system, that's ine way to do it. look at the american insurance system, that's another way to do it. look at gambling, or video games and how they lure people into spending just enough to he comfortable. There are patents on systems that track player engagement and offer reward systems for spending money or discounts/payouts if a player is likely to quit. they do this by tracking your every miniscule move. why do you think "AI" exists at all? from you.

please excuse the sperg, i've been wanting to write this down for a while, i'm not just having a fit because >discord mentioned. it's just a good catalyst to spergdump this post. feel free to do whatever

>>1332362
i understand you, i think it's stupid too. i'd also like my internet back from 30 years ago. the point is, it can't be completely avoided unless you unplug your router, forever.

instead of worrying about it buy a nice book on constructivism and learn to construct your reality yourself, after all you are sitting right at your source, closer than google&co can ever be. there is nothing more effective than that, or move to europe and fuck the companies with GDPR - per company the first time is even always free.
back to japanese tits in costumes, i don't care, would be happy with irc too

>>1332419
>the point is, it can't be completely avoided unless you unplug your router
well you can certainly mitigate it and make it so costly to monitor that they don't bother
the silver lining of AI and mass surveilance is they need things to come in predictable chunks with discernable patterns, and there us a lot you can do to dispell these. but this isn't the thread for that
>instead of worrying about it, consoom more goyim
I kid. but beleive me I already do understand this, hence why I felt the need to sperg out about it. if everyone falls for the trick, the thief will keep walking off with your money. if you can tell people how the trick works, you can stop the thief getting richer. the hard part is convincing being they are being tricked. but I digress in a porn thread

can I shrimply download the latest V3 packs over top of my half-completed V2 packs? I don't feel like redownloading a few TB, this already took me months to get halfway

>>1332441
there's no V3, the latest updates are still part of V2, they are meant to download on top of the previous parts

regarding the whole discord thing, i'd say the most appropriate software to use in this case would be matrix or XMPP, so far i haven't made a room anywhere because i want to keep the discussion as open as possible and over here you just have to hit post rather than going through creating and account and all that shit but i don't mind making a room somewhere, i'll have to find an appropriate server and talk to the admins though so it might take a while

for now i'm receiving comments/suggestions trough fedi on the account associated with cosplaybot (the one listed as bot owner), so far most of the comments i've received have been regarding the bot itself but you can also make suggestions about the library as a whole through there

>>1331255
Bump.

>>1331394
>>1331610

I'm sorry but there are so many that are upscaled and intentionally inflated in size.
Many of these photos are blurry because they're upscaled.

鬼畜瑶在不在\鬼畜瑶在不在 - atago bunny 2\鬼畜瑶在不在_atagobunny2_004.jpg is 8504x12751, but no commercial camera available on the market has this resolution. The Fujifilm GFX 100II and Hasselblad X2D 100C both do not cross 12000 lengthwise.

Furthermore, exif shows its taken on 2019:05:01 04:19:59 with lens Canon EF85mm f/1.2 L II. exif does not show which body it was taken on.
Canon does not produce any EF mount camera reaching those resolutions.

>>1333285
i wouldn't pay too much attention to the metadata on any of the images at all since pretty much all of them have been edited, it's so common that i turned it into a game of sorts: "spot the editing fuckups", it's oddly entertaining, especially with the asian cosplayers since they tend to be particularly... bold in their edits

taking that into consideration i think the most likely explanation in this particular case is that whoever edited the images fucked up (whether it was an honest mistake due to a less than ideal workflow or an attempt to mislead people i'm not sure), of course i'd love to have the originals but that's the only version i could find so it's that or nothing

anyone has secretnoel stuff?

File: f55a3d004796ac94216e1449f(...).jpg (35 KB, 600x800)

35 KB JPG

Does anyone know where I can get the recent-ish NTR piggie set/video (picrel) by Momokun? I'm downloading the whole megapack linked at the top of the thread but I don't see it in the file list.

Does anyone have momochino/momotino content??

Anyone got the most recent enafox stuff? It stopped getting leaked after the okayu vid

Where should I write requests for files if they do not relate to adult content?

>>1335273
AFAIK this thread is not necessarily only about adult content, as a matter of fact i'd argue that most of the content on the large megapacks wouldn't qualify as such, as far as requests go technically speaking the place for that would be /r but in practice for torrents you're probably better off asking on a relevant thread on /t , if it is related to cosplay that would be here or on the japanese cosplay thread (that one is mostly about JAV tho)

>>1335273
>>1335453
requests belong on /r/, no exceptions

there is nothing from momoreku

Any update on the bukkit brown torrent ? Thing's stuck on "downloading metadata" and won't budge.

>>1334549
https://simpcity.su/threads/momokun-mariah-mallad.5518/post-5928993

https://fantia.jp/products/716512

anyone got this sex syndrome

>>1338761
kurupika on the library, i'm missing a bunch of sets tho
>>1338476
shell be on the next update with 30-35 sets

i'll start organizing the new stuff for the next library updates, i should have enough for at least two maybe three parts already but i'm waiting a bit to see if i can minimize the amount of 1 set cosplayer updates

cosplay_photo_library\nekokoyoshi\nekokoyoshi - rizu-kyun

the files here are all zeros. The file is non-zero size, but data is filled with zeros

Looking for L@na Rain vidz. seems all the torrents i have are out of date and abandoned

File: XXM00889-129.jpg (1.62 MB, 4000x6000)

1.62 MB JPG

>>1339222
yeah, that is a weird one, the sizes are right too when comparing the files with the actual set and the nahida sets is the same, i'll add those sets to the next update, incidentally she's one of the cosplayers with one of the largest updates (about 40 gigs)

for reference there are 4-6 cosplayers with 30+gb updates, about 90 new cosplayers still to be added and probably around a couple hundred cosplayers with small updates (small as in less than 30gb) so i'm still figuring out how to divide all that stuff

>>1327875
> mercury_lamp
Apparently aka Mercurygin

where do you guys get most of the leaked content? no way you all bought all those packs.

File: agd4a5.jpg (1.21 MB, 2000x3000)

1.21 MB JPG

>>1339732
yeah, i have some sets under that name but nothing particularly rare and less than 10 sets (picrel)

a small update: after doing a first pass on the new stuff it seems that i have about 280 updated cosplayers and 82 new ones plus the major overhauls mentioned >>1339600 for a total of 600-700gb, i'll probably wait a while to get more sets so i can make updates with less cosplayers overall but more new sets per cosplayer

i also have to do a cleanup, there are a lot of cosplayers that will probably never make the cut and random loose sets so i'll probably delete the shitty ones and make a dedicated torrent only for cosplayers with <10 sets for the others (i was thinking on deleting all for a moment but some of them look really nice)

as a sidenote while i'll still check the thread regularly i might start putting these small progress updates directly on the rentry and maybe something like an automated weekly update on cosplaybot since doing it here is a bit cumbersome these days

P.S.: i coded the automatic weekly update on cosplaybot while waiting to post this, i still want to add some frills to it but it will most likely be online this week

File: 1627997052423.jpg (3.68 MB, 2000x3000)

3.68 MB JPG

>>1341341
Could you please add aliases in some shape or form? IDK maybe text file in the root or per cosplayer folder.

>>1339732
> > mercury_lamp
> Apparently aka Mercurygin

Would be nice in cases like this one.

Also would be extremely useful for Asian names. Some obvious examples:
chunmomo / 蠢沫沫 / stupid momo
爆机少女喵小吉 / Nekokoyoshi


Also, Mercurygin 10 sets link, will last two weeks: https://file.io/Dt75p6pkiNKE

Anyone have Vinnegal?

File: 1578603567178.jpg (715 KB, 1650x2200)

715 KB JPG

I'm trying to find all the available sets of a cosplayer from ~12 years ago
Her name is Jessica Onstott AKA Jsica
This is the most well-known photo of her
She had several photoshoots with CosplayDeviants
Some of them were named Runaway Princess, Summoner, Gunner and Beauty of Wisdom
There is a 2.35GB torrent of her on BT4G but it hasn't been seeded for years. I know because I've been leeching for years with no success
I know it's a long shot given how old these images are but can anybody throw me a bone? I've carried a torch for her for so long