[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology

Name
Options
Comment
Verification
4chan Pass users can bypass this verification. [Learn More] [Login]
File
  • Please read the Rules and FAQ before posting.
  • You may highlight syntax and preserve whitespace by using [code] tags.

08/21/20New boards added: /vrpg/, /vmg/, /vst/ and /vm/
05/04/17New trial board added: /bant/ - International/Random
10/04/16New board for 4chan Pass users: /vip/ - Very Important Posts
[Hide] [Show All]


[Advertise on 4chan]


File: hard disk drive.jpg (8 KB, 257x196)
8 KB
8 KB JPG
How many tbs do I need?
Is 10 tb enough?
>>
>>107969756
Lol. Lmao, even.
>>
>>107969756
Give one of the Ts to me
>>
>>107969756
Well, what quality do you want them in?
>>
>>107969756
there is no porn derivative where 10TB 'would be enough'. If your HDDs - capacity, any - aren't yet full, you're not looking hard enough.
>>
File: IMG_0083.png (199 KB, 1170x2532)
199 KB
199 KB PNG
>>107969756
start looking for a warehouse
>>
>>107969756
But why would you do that thoughbeit?
>>
>>107969756
you need a datacenter
>>
>>107970345
There's only 3000-5000 titles?
>>
File: IMG_0084.png (147 KB, 1170x2532)
147 KB
147 KB PNG
>>107970506
depends
>>
>>107970345
>relying on ai to pull retarded mental math out of its ass
our species is cooked
>>
>>107970522
Jesus. How many sins have Japanese people committed?
>>
>>107969756
1 exabyte
>>
whatever you need, count it double because you also need a backup
>>
Better question: how does one find the one in hundreds of thousands of JAVs where the actress was directed to do literally anything other than that weird cringing whine?
In my lifetime I’ve seen a few non AMWF JAVs where there was something approaching half decent acting.

There’s been nothing remotely resembling a reliable way to find them.
>>
>>107971231
you follow specific actresses and go from there
and also: hags. no more whining and more moaning but the downside is that they're scuffed and old
>>
>>107970522
Yeah, exactly. Way more.
>>
File: IMG_0085.png (222 KB, 1170x2532)
222 KB
222 KB PNG
>>107971141
these numbers are crucial for anon’s spank tank
>>
>>107969756
Isn't there an Anon who has a zfs array full of JAV? I can't remember how much it was, in the 10s of TB I think.

>>107970345
This is pretty dumb because a lot of JAV was before the HD era.
>>
File: 1749898872046707.jpg (75 KB, 900x900)
75 KB
75 KB JPG
>>107970345
>back-of-napkin
You will never hold a napkin, clank.
>>
>>107969756
I can tell you that I found and fully downloaded a 1.27TB Hitomi Tanaka collection all neatly organized by JAV identification whatever letters and numbers over the past couple weeks. It even has 3D videos formatted just for Nintendo 3DS, lmao, it's an awesome collection that I intend to keep seeding for a while. You'll probably need your own data center for all the JAVs out there.
>>
I know that feel, anon.
I've settled on 600gb of おちんコス and a few of my favorite 乙アリス vids though.
>>
>>107969756
even on idolpixels the data is 20tb.
and thats only for u15.
>>
>>107969756
why would you want to do that? their porn is terrible
>>
>>107971231
You look at the labels for stuff made for women, like Silk Lab.
>>
>>107969756
JAV?
>>
not sure about that better save imageboard .mp4
>>
>>107970345
why the fuck would you believe that?
>>
File: IMG_8006.jpg (110 KB, 707x1000)
110 KB
110 KB JPG
Growing up and becoming a real man of taste is learning that JAV is censored trash anyways, and all of most beautiful japanese yamato nadeshikos stay pure gravure idols and never go all the way to doing porn.
>>
>>107975810
look how fucking flat she is
>>
>>107974359
japanese animal video
>>
>>107975810
Lots of gravure goes quite far.
>>
>>107975832
Yeah she’s 4’2” perfection
>>
>>107970522
I know ChatGPT has confidence bias, but I do appreciate how emphatic it was with respect to just how much JAV there is out there
>>
>>107975810
the perfect female body type
>>
>>107971141
>our species is cooked
Yeah, the sky is totally falling, unlike when we believed random people online.
>>
>>107969756
First, you can't download every JAV ever made. A large amount of them won't be digitized (either low volume or originally released on VHS/Beta/Super8 etc).
Second, it's nowhere near enough space. The JAV industry releases about 4500 videos per month. If we assume 300MB per video (1 hour at low resolution Netflix quality) that's 1.35TB of video every month. You can't even store a single year's worth of video.
>>
>>107976336
Some of the best JAV of the 80s and 90s was released in SuperVision (analogue HD) on LaserDisc and those discs are rotting away as we speak
>>
One of three japanese women have done AV
>>
>>107970345
clankers are so fucking dumb.

let's say that you're just looking at 720p, most films are between 1 and 3 hours, whatever, let's say 2 GB per title. there are thousands of titles ever since the IPPA era. before that, there is an inordinate amount of VHS and random shit that doesn't even have codes, and the ones that have codes reuse codes and there are even conflicts. indexers of the codes don't even have all of these, especially once you get to anytime before the early 2000s.

Even in modern times, there are tons of japanese sites that release uncoded works that are PPV type things, but for the sake of argument, say you are disregarding these.

and what about gravure?

I think if you're just doing JAVs, even at 2 GB a film, you're going to be looking at 100 TB or more if you set a date of say 1960 and onward. next time you're in japan, go to some video store or porn shop in a random mid-sized city. there's tons of legacy media out there that is uncoded and hasn't seen the light of day in years. even the big corps like DMM/FANZA probably don't have complete records.
>>
>>107975810
They complain about men checking out of society. You promise every unmarried man that he'll have a loving loyal wife that looks like that and we'll have nuclear fusion cracked in 5 years, lunar colonies in 10, and Mars terraforming in 25.
>>
>>107969756
4tb is more than enough for me, have 8tb nas.
I don't hoard movies tho and it seems that is what most people with lots of storage do with all that funny software that ends with "r".
>>
>>107976382
I forgot all about laserdisc, thank you. Wasn't disc rot also a problem for early dvd releases?
>>
>>107971192
around 1/2 to 1/3 of japanese women have admitted to having done pay for play, a lot of that in japan involves photos and video, even as JKs. japanese aren't christian. they are shinto and cultists. to them, marriage isn't even monogamous, because their concept of man and woman has always been an adulterous type thing, and this has persisted into the modern era.

the amount of pron and "infidelity" (from the western perspective) in japan is off the charts.

t. lived in japan
>>
>>107976419
meant to say 1000 TB, or a PB.
>>
>>107976416
I'm pretty sure there are more then 3 Japanese women.
>>
>>107975810
Going to need a code, anon.
>>
File: 1751903358125600.jpg (362 KB, 781x1200)
362 KB
362 KB JPG
>>107969756
not even close this barely covers 1-2 months of releases of just VR JAVs
>>
>>107970294
I'm willing to bet that if you archived all the BDSM porn that started a short femdom with short black hair, narrow hips, small floppy breasts topping fit skinny men with beautiful faces and microdicks you could fit it on 10TB.
>>
>>107971498
>Isn't there an Anon who has a zfs array full of JAV? I can't remember how much it was, in the 10s of TB I think.
wow, memories. there was this weird guy on akibao*nline a long fucking time ago who had an insane collection, and even though people asked for him to share more things, he would only do trades. I never participated, it was just fun to look at the scans of the boxes. people ended up chastizing the guy for not sharing, anad then I think during covid he died or disappeared. he must have been in his 70s by that point. he's a foreigner, but I dont know if he still lived in japan, but he must have spent serious time there, like for decades I think.

anyway, it's ridiculous to think that this guy because of how stingy he was ended up with probably the largest or one of the largest collections of JAVs in the entire world, then died or disappeared, and that's it. shit probably is either rotting away somewhere, put into a landfill, or got parted out in bulk.
>>
>>107976484
Yeah but they all look the same
>>
>>107969756
There is actually such a project, but for pro wrestling and "MMA"
IIRC, it's ran by a bunch of Germans and they're at 700 TB already.
They do have duplicates, though.
If their catalogue would be curated better, they could probably shrink to 500 TB.
>>
>>107971866
>I settled on 600gb of dick juice


Um what
>>
>>107976446
winrar?
>>
>>107976463
japan sounds like heaven
>>
>>107976513
I think I've seen that video
>>
>>107969756
I've been to Japan a lot and I can honestly say that just ONE shelf in ONE of the stores I visit every time has more JAV on dvd than you can fit on 10 TB unless you compress the absolute hell out of it. We're talking thousands upon thousands of DVD's in multiple rows, wall to wall in a rather huge video store.
>>
>>107969756
it depends what quality you're looking to archive. you could probably download all jav ever made if you didn't mind it all being 180p like some of the ancient 80s and 90s javs were natively.
>>
>>107976799
What's the best archive strategy? Archive the actual disc or is encoding acceptable? Can you do it without noticeable quality loss and save some space at least?
>>
>>107976831
If you wanna store it for "the future" then I'd say both the physical copy and a digital one on harddrive. What you consider acceptable in terms of quality loss is up to you and the best way is to just experiment until you find that limit where size/quality is balanced enough for your needs.
I might be rare here but I do not trust neither SSD's or old school spinning hardrives, lost too many randomly for that to be a reliable way of storing things long term. Sure, dvd/bd isn't immortal either and disc rot is a thing but I still have dvd's from 1998 that works fine. Meanwhile my oldest surviving drive is from 2006.
>>
I bet you can achieve it.
Re-enconde everything with AV1.
Every movie can become a file with just 100 mb.

10,000,000 ÷ 100 = 100,000 titles
>>
Jav sucks ass. Why would you watch pixelated shit.
>>
>>107977815
I decensor my stuff with AI.
>>
>>107977819
>my stuff
you mean "the muff"
>>
>>107969756
what is the obsession with JAV? why do anons like blurry/gmasked porn so much?
the actresses aren't even attractive. is it just the weird fake squeek noises they make so you can imagine they're children being raped or what?
>>
>>107976877
How have you been archiving media for this long and don't know about RAID?
>>
File: 2.png (335 KB, 345x595)
335 KB
335 KB PNG
>>107971498
>>107976531
There has to be some way to distribute your collection to interested parties if you disappear. Perhaps a script to automatically generate and seed a torrent after a certain time.
>>
>>107976531
>anyway, it's ridiculous to think that this guy because of how stingy he was ended up with probably the largest or one of the largest collections of JAVs in the entire world, then died or disappeared, and that's it. shit probably is either rotting away somewhere, put into a landfill, or got parted out in bulk.
never heard of exoticaz or pornolab?
>>
>>107969756
>wanting pixelated porn
Gooners are something else.
>>
>>107977875
You know nothing of JAV.
>>
Don't listen to all these naysayers. Just start DLing and when your disk gets to 80% full buy another one. You'll get there buddy.
>>
>>107969756
Bout three fiddy should suffice
>>
>>107969756
I quit watching JAV because the last 5 years have seen a massive influx of blacked stuff.
>>
>>107969756
according to my months-old sukebei scrape, it would take 5.3PB to download every single torrent in the video category. this includes dead torrents and garbage chinese releases (AI decensors, downscales, chinky hardsubs, etc.)
i'm too lazy to write some SQL to calculate what constitutes a "good" release sorry
>>
>>107976831
modern streaming sites compress 1080p files through av1, from 1.5gb to around 5gb
these are really not bad filesizes when you think about 12tb storage drives...before the ram chip crisis
>>
File: 9TB to get into Mordor.jpg (164 KB, 800x600)
164 KB
164 KB JPG
>>
>>107980740
I want to hear this machine spool up.
>>
>>107977875
yeah pretty much. also why i exclusively bang chinese girls, the crying noises gets me off
>>
>>107980020
I thought that the like one black guy the I dustry had that was in everything retired
>>
>>107976416
nation of trad waifu literal whores
>>
>>107987437
being a whore is traditional
>>
>>107980740
>maxtor
the good old days when we had choice for hdd between Maxtor, IBM, Fujitsu, Samsung, Hitachi, WD, Seagate, Toshiba and probably more that I never had
>>
>>107980740
My NAS has a similar feel to this
Little less jury rigging tho.
>>
>>107980740
God I hated those molex power cables so fucking much. I can feel the pain just thinking about plugging them.
>>
>>107983307
I jerk it to asmr of women being physically abused. The whimpers and sniffles make me diamond hard. So I get you, bro
>>
>>107987610
same but for me its the sounds of pigs squealing in a slaughter house
>>
>>107987610
Links or search terms.
>>
>>107971252
Got any names? Preferably ones that do rapey scenarios
>>
>>107973870
Do they do the rapey stuff though?
>>
>>107970522
gemini says :
Estimates suggest that roughly 35,000 to 50,000 new titles are released every year.

The Modern Era (2010–2026): ~16 years × 40,000 titles = 640,000 titles.

The Legacy Era (1980–2009): ~30 years × 15,000 titles (lower volume) = 450,000 titles.

Total Estimated Library: Roughly 1.1 million unique titles.

2. The Storage Math (The "File Size" Problem)

SD/Legacy (480p): A 2-hour movie is roughly 1.5GB.

HD (1080p): A modern high-quality rip is roughly 6GB to 8GB.

4K/UHD (The Modern Standard): A single 4K title can easily hit 20GB to 30GB.

The Weighted Average Calculation:

If we assume an average file size of 10GB :
1,100,000 titles×10 GB=11,000,000 GB

Converted to petabytes:
11,000,000 GB÷1,024=10,742 TB≈10.5 PB


TL;DR: The "Japanese Cultural Archive" 2026 Master Plan

Total Content Volume: ~10.5 PB (Full professional history).

Post-AV1 Optimized Size: ~7.35 PB (30% storage savings).

Hardware Choice: 276 x 32TB Enterprise HAMR HDDs (e.g., Seagate Exos 32TB Mozaic 3+).

Chassis: 3 x 106-bay Ultra-Density JBODs (Occupies 12U of rack space).

Initial Hardware Cost: ~$263,000 (Drives, JBODs, and Host Server).

Primary Power Draw: ~3.5 kW (~$380/mo electricity at $0.15/kWh).

Networking & Ingest Timeline (7.35 PB)

1 Gbps: ~10 TB/day | ~2 Years to complete.

2.5 Gbps: ~25 TB/day | ~294 Days to complete.

10 Gbps: ~100 TB/day | ~74 Days to complete.

The "Mirror" Backup Plan (Total Protection)

To ensure your library survives a hardware catastrophe, you would build a second, identical setup.

Total Hardware Cost: ~$526,000 (2x Primary setup).

Total Drive Count: 552 drives.

Total Rack Space: ~30U (Includes 6 JBODs, 2 Servers, 2 Switches).

Total Power Draw: ~7.0 kW (~$760/mo electricity).
>>
>>107987866
>slop machine says :
post discarded
>>
>>107976463
And yet, prostitution is nonexistent there, as far as I can tell. I've even read that it's impossible for a foreigner to hire a Japanese hooker. Is that true?
>>
>>107987866
anyone on /g/ who has a spare half a mil?
>>
>>107987910
It is true, there is no prostitution.

What can happen is, you pay a woman to give you an overpriced massage. And if she likes you, you can have sex with her. You paid for massage, not for sex.

The problem with foreigners is, how can a japanese woman like a foreigner, if both don't speak the same language.
>>
>>107987866
The drive count is low. Those drives WILL eventually fail. You'll want those in RAIDz3. And you'll probably want them spread across multiple pools, like say nine drives each. That way you'll be able to suffer up the three drive failures per pool without data loss, at the cost of three drives worth of storage per pool. Even that will take a gorillon years to resilver. And THEN you'll want to mirror the pools.
>>
>>107988824
1. The Reliability Hardcore Mode: RAIDZ3

By moving to RAIDZ3, we are increasing the "safety tax." You now need enough drives to allow 3 simultaneous failures per group.

Configuration: 29 groups (vdevs) of 12-wide RAIDZ3.

Drive Count:

Data Drives: 261 drives.

Parity Drives: 87 drives (3 per vdev).

Total: 348 Enterprise 32TB HDDs.

Actual Usable Space: ~8.3 PB (Gives you a healthy buffer over your 7.35 PB target).

2. RAM is your new Best Friend

Your RAM is the only thing standing between you and 30-second wait times to see a file list. ZFS uses the ARC (Adaptive Replacement Cache) to store metadata.

The Rule of Thumb: 1GB of RAM per 1TB of usable storage is the old standard, but for a "Read-Only" media archive, you can be more efficient.

The 2026 Target: 512GB to 1TB of ECC RAM.

With 1TB of RAM, ZFS can keep almost the entire metadata index of your 10.5PB library in memory.

3. The "Cold Backup" Modification

Since this is a "set it and forget it" library, we can make the backup strategy much cheaper.

The "Offline" Mirror: You build an identical 348-drive rack, but you keep it powered off.

The Sync: Once a month, you boot the backup rack. You use zfs send to pipe over the new movies you downloaded that month.

The Benefit: This saves you $4,500 a year in electricity on the backup side and extends the life of those 348 backup drives significantly (since they aren't spinning 24/7).

Final TL;DR: The "No-SSD" 10.5PB Vault

Total Drives: 348 x 32TB HDDs (RAIDZ3 redundancy).

Storage Efficiency: ~75% (8.3 PB usable).

Chassis Required: 4 x 106-bay JBODs (We added one more chassis to fit the extra 72 ZFS parity drives).

Rack Space: 16U (for JBODs) + 2U (for the head server).

RAM: 512GB ECC DDR5 (Minimum for decent performance without metadata SSDs).

Initial Cost: ~$335,000 (Drives are the main expense here).

Power Draw: ~4.2 kW (Approx. $460/mo).
>>
>>107987866
To give a frame of reference, in 2019 pornhub said they had 11PB of videos (11,000TB).
>>
>>107989036
With this sort of budget and archival goals you would probably use LTO for cold storage
>>
>>107987866
>JBOD
meme term
>>
>>107977893

> never heard of exoticaz or pornolab?

Pornolab currently lists 140.559 terabytes of JAV in its “Japanese Movies & SiteRip's (DVD & HD Video)” subsection, and then 62.587 terabytes in its “Full Length Japanese Movies Packs & SiteRip's Packs” subsection, and 22.675 terabytes in its “Japanese Movies & SiteRip's 2015—2026” subsection, and 13.21 terabytes in its “Japanese Movies & SiteRip's 1991—2014” subsection.

(You do the math.)

Source: https://pornolab.net/forum/viewtopic.php?p=25137271#25137271



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.