Who is this for?Why would someone need this much storage in a portable format?¡!
>node_modules
It's probably cheaper and faster to ship 368TB on a plane than over the wire so it makes sense it's portable.
>>100149815Ukraine needed something like that 2 years ago.Also if you're moving a huge database then just use a suitcase.
>>100149866why not just buy a 747 and fill it with racks of hardrives and sell plane tickets to transport data, could make a killing, wide open market there
>>100149815playing video games
just another thing to add to the portable goon kit
>>100149815I run 24 tb homeserver for media center and security cameras, it will never get filled even with RAID, i imagine if i beef it up and host 2 gaming stations on it would still take years to run it out of space, as my two gaming setups with 4 tb each currently still sitting at less than 50% capacity
>>100149815>Why would someone need this much storage in a portable format?¡!People who do large sport/news events and need to dump lots of dataPeople who are doing huge migrations of data but don't have a network to make it worth itCompanies who might need to dump tons of data for audits or forensics
>>100149977>Boeing JeetAirOS activates>billions in hardware gone
>>100149815When you get to that size it's much faster to transport the drives than doing an internet transfer
>>100149977You're late, that already exists with something similar to OP. Although they also already changed to flash due to vibrations.
>>100149815s3 snowball
>>100149815>12.7 to 14.97 kgsI need this
>>100149815Would that be enough to archive everything decent on nyaa and sadpanda?
I'M FUCKING TIRED OF THESE VAPORWAVE STORAGE PRODUCTSUNTIL IT'S ON AMAZON AND IN MICROCENTER THIS SHIT DOESN'T FUCKING EXISTFUCK OFF WITH YOUR PRESS RELEASES ABOUT YOUR HYPOTHETICAL PRODUCT THAT COULD EXIST IN THEORY AND ACTUALLY BUILD IT FAGGOT
Picking up package
>>100149815>"SSD"today in questionably placed quotation marks:
>>100150066>24 TByou are like little baby
>>100149815>namefag>tripfag>¡Good morning sir
>>100149815glowniggers could definitely use something like thiswould be cool to watch a spy movie written around somebody trying to escape the NSA with such a thing
>>100149815>open it up>it's a raspi connected to hundreds of flash drives via chink hub
>>100150995I stopped saving shit locally long before even reaching 4TBand I can probably delete about 50% of what I have, just stupid TV shit I'll never watch againdata hoarding just ain't what it used to be
>>100151244keka (dumb) friend of mine ordered some "2TB" flash drive from walmart.com for $40, I told him that was very unlikely to be legitturned out to be some chink trash with 20GB capacity lolol
>>100150980because technically its a full server with 200GbE and 368 GB flash storage
>>100149815About the size of a compressed human brain.This is to transport the machine.
>>100151312
>>100149815my robot produces 20-40 gigs per hour of dive time. dives are up to 48 hours long with 2 hours turnaround jobs are up to 3 months long 7 days a weekthat's upwards of 90 terabytes of data for 1 job (multibeam sonar, laser, camera stills, fls sonars) if I want to deliver the data to a customer, one of these things might be useful and way more reliable than a shitty portable USB drive
>>100151448what exactly is your business? what are you selling to the customers?
>>100151581high resolution geographic survey data of offshore oil fields and other such products.
>>100149815So the CIA doesn't have to hack your computer.They just drop this at your door and arrest you when you pick it up.
>>100149815i'm gonna need one of these for my bug out bag.
>>100151448man your encodes are garbage
>>100151606sounds awesome and very expensive
>>100149815Seems to me like more of a novelty than anything.
>>100150021you turn into one of the Joker's goons with all that?truly you work in mysterious ways
>>100149815Why is it that big and heavy?These are 100TB and weigh 500g each.
>>100149815>me and my porn
>>10015167112mp 16bit grayscale deflate compressed tiff images at 1.5hz are still around 30MB a second laser data is about 56k per scan line at 50 scans a secondSonar data is extremely dense if you're collecting water column (we usually don't) at 32MB a ping, usually around 30 pings per second.we also collect black box stats data at around 5 gigs per day, although that's in a sqlite DB with double,double records so we could compress it by around 85% if we had to>>100151690most fun I ever had, hardest problems I've ever encountered, like making a high end game AI but actually useful
>>100151671just as an aside, often times compression is too expensive to employ on the robot computers because it has to dedicate most of its CPU time to streaming, storing, and processing the data.we picked deflate on the tiff images because we could operate at 30hz which gave us enough headroom to save and process the image in time to be ready to receive the next one.
>>100149815I only need at least 512gb to store my favorite yuu shinoda and riko honda videos.
>>100151256Would you be interested in archiving sites?
>>100150021I like how with all that shit there he’s somehow ashamed of what’s on his laptop screen and felt compelled to hide it.
>>100152224>ashamedHe's just being careful.
Billions of gigabytes must be saved.
>>1001498152 houers of fraps footage
>>100151671Not him but some equipment only works with specific encodes or data dumps. It's better to get everything then trim the fat later than have a possible bottleneck on the equipment CPU/GPU or software doing the compression/encoding/etc during a "you only get one shot" situation.
>>100152607we actually hit this problem recently; our laser was transmitting LAS data as 56k udp packets over loopback so we were losing like 30% of the scan lines.had to work with the vendor to change that to tcpthe change also let us move away from having the vendor API running on our computers and onto their device computer. definitely made life easier
>>100149815
>>100149815Rust Hello World
>>100150680>everything decentShould be close enough, depending on what you consider decent.If high quality releases of 5% of all known anime = 10TB then high quality releases of all anime ever = 200TB
>>100149815You're telling me I could have used a suitcase?
>>100149815why is SSD in quotes? does it have moving parts? was this written by AI?
>>100151368>>100153055
>>100153073Because the box is a whole ass computer not just some drive you plug in
>>100149815A ridiculously high speed camera capturing in high resolution
>>100149815It's for government. For when your data is so secret it *can not* be allowed over a wire.
>>100151950one of my favorites anon. good taste.
>>100151286Why is walmart allowed to sell fake flash drives?
>>100151959I bet most of that is highly compressible, even if your too lazy to make a proper compression format for it I bet it would 7z reall nice.
>>100154044Why is Walmart allowed to sell nonexistent meat? They make billions off this shit and when caught red handed they have to pay out a poultry 45 million? But some nigger steals meat from Walmart you know he's going to jail. I want to see the Walmart exects behind bars.
>>100149977>boeing
>>100149826FPBP
>>100153073Because all the SSD chips are mounted on a spinning platter, for some reason. It just proves that spinning rust will always be king.
>>100149815>4h>the actual article is from 2 weeks agoWhy did it took you so much time to do this thread anon? Were you calculating the best time/date to get more (you)s ?
>>100149977>why not just buy a 747 and fill it with racks of hardrives>a 747do you want your data to literally crash
>>100149815geniuses working against the american governemnt who do not their data to be intercepted by weird tecnologies
>>100150160>>100149866No, it's not.You'd still be bottlenecked by the SSD thoughput. Which is not that much faster than a high-speed corporate-grade Internet access.
>>100151798>microelectronics>made in the usayeah, i think i'll pass
>>100149815>Who is this for?privoocy chuds like luke or mentaloutlaw who wants to go offgrid to goon to 'p
>>100156293If you're using a single SATA link maybe.Something like this could (and should) have multiple memory controllers operating on separate blocks of memory in parallel that present a unified interface through PCIe 5 16x
>>100151959>>100152016>deflatezstd? (maybe with a custom dictionary even)>>100152643> TCPSCTP?QUIC?
>>100156996CPTSD?BDSM?DSBM?NWOBHM?COBHC?NYHC?LSPD?
>>100149815>Who is this for?We call them digital nomads
>>100157168Are those your genders?
>>100157391>Digital nomad needs to physically haul 368TB of data.This only exists in your imagination
>>100157650You lack imagination
>>100156717But you know all too well it's not.It's a gadget aimed at retarded nepohire. Retarded nepohire don't think in term of bottlenecks.It's probably using USB3 or some other marketable -but inefficient- shit. With an unecessary layer of bloatware for good measure.
>>100149815>>100149826>modern software engineer delivering updates of his electron app in person.
>>100157989>But you know all too well it's not.there are solutions that already are like that on the market so if you are somehow right they will just be beaten by bestjews or some other companies 200 terabyte suitcase instead
>>100149815Portable porn server.
>>100158051>Western Digital, known for its hard drives and SSDs, has unveiled a new product that isn't a storage device in the technical sense. The product, known as the Ultrastar Transporter, is a new Western Digital-built travel case that houses a whopping 368TB of NVMe flash storage. The case is TAA compliant and has a 12-core Intel Ice Lake server that houses all SSDs and dual 200Gb ethernet ports.That's not too shabby actually. There's not that much backbone infrastructure that could beat that transfer rate.On the downside : >1,300W power supplyThat's manageable, but not negligeable.
>>100156293Academia regularly produces shitfuck tons of data and labs don't usually have the required internet infrastructure, because they're either too remote or too specialized.You know ALMA in the atacama desert? Those telescopes are in the middle of fucking nowhere and while they do have internet, it's mainly for communications woth staff and shit.A couple weeks of observations can easily produce a couple hundred TB of data and it is 100% cheaper to move that data to a device and fly it to a supercomputer facility than it is to build (and maintain) the entire high speed infrastructure required for that data transfer.
>>100152494HA
>>100158474also alma cannot have most or maybe any wireless communications, bc of possible interference, with limits you a ton bc they are in middle of nowhere
>>100152224Ive seen the actual pic on /g/ recently. He didn't hide it at all, this pic was edited after the fact by some faggot, because it was NSFW i think.
>>100150021I hope that these posts/screenshots are just people memeing.
>>100158097I like Asians but I actually think she looks very unattractive. idk why.
>>100149815If you can't deadlift 5.3 petabytes can you really call yourself a man?
>>100160647You sweet innocent child. You are too pure for this world
>>100160651She's just ugly anon, ethnicity doesn't automatically guarantee beauty.
>>100160651Strong Asian face. I can see the novelty but it looks like she came out of a Department of War Japan occupation manual showing the how not to get a std
>>100149815So it is basically a AWS Snowball Edge Computing Thingy, just smaller for multi-location corps?
>>100154842>>100154245>>100150101as long as it's not a modern 737 or 787, I don't see what would be the problem?only a few 747s were made under the current Boeing regime, and the plane has since been discontinued.
>>100160457That too, but they do have some minor local area wifi for communications, since the radio telescope array is decently away (and spread around) from the command centre.Since ALMA works in the 4 to 0.3 mm range, longer frequencies (such as those from wifi) can be tuned out or compensated if some interference does happen.
>>100160647Redditors make shit up and post it on the internet for upvotes and attention. Redditors also make shit up and post it on 4chan for (You)s and attention. The subtitle on /b/ does not exclusively apply to that board.>>100151671yeah, he should be sloptimizing all that geographic survey data by saving it as gifs and jpegs. Fucking retard.
>>100157989>it's [schizobabble]https://www.notebookcheck.net/Western-Digital-s-368-TB-SSD-weighs-28-to-33-pounds-and-is-portable.826532.0.htmlRead what it is. This is why it should be mandatory, enforced by monthlong bans, to provide a link, direct or archived, with any OP that has a screenshot of a headline. >the device contains a Xeon 4310 with 12 cores. To achieve high data rates, however, a powerful CPU is needed, especially via network interfaces. There is also 128 GB of RDIMM RAM. All SSDs, including the two boot SSDs, are accessed via NVMe.>Once at its destination, the "SSD" is connected to the network via 200GbE via two QSFP112 ports in order to then provide or collect the data on site.
>>100156996tiff supports different compression techniques internally, but you're basically limited to lzo and deflate for any kind of portability.quic is just udp, sctp might be cool but why complicate the problem when tcp can handle it and everyone is familiar with it?
>>100160651Same
>>100161835QUIC is reliable, that was the point.SCTP itself is often implemented on top of udp.And those were just examples (prominent ones used in HTTP3 and WebRTC). The point was that you can get reliability on top of UDP without going full TCP.As for tiff. Here is a quick and dirty test with a few desktop screenshots. Input is raw tiff.Training done with:zstd -2 -o zstd_dict_2 -B128k --train *.raw.tiffzstd -6 -o zstd_dict_6 -B128k --train *.raw.tiffSo, default small(ish) dictionary size is used (110KiB).-----ffmpeg / tiff (deflate)Total size: 102.7528MiBEncoding Time: 13.7s (15.2 - 1.5 raw tiff decoding)zstd -2 -D zstd_dict_2Total size: 102.5664MiBEncoding Time: 1.8szstd -6 -D zstd_dict_6Total size: 87.0655MiBEncoding Time: 4.8s
>>100151950me as the retarded lion
>>100160651you are blind sirshe just has big teeth (they might be veneers desu)Cindy is Vietnamese though and a lot of Vietnamese girls have the same look
>>100149815the chad file hoarder ofcourse
>>100149815backblaze
>>100149815someone who wants to install the next call of duty
>>100149815i could stack 368 sd cards (1tb each) in my wallet if i wanted to.that shit is too big and expensive
>>100162990my input dataset is 16bit grayscale, and my images have to be compatible with an existing vendor program, so I can only use widely available and likely-to-be-included compression options.lzo was too expensive and zstd wasn't available
>>100163793i stacked 512 and they take less space than i thought
Bought a new Samsung nvme. It's been on for ~1000 hours and already at 97%. Based on this the estimated life is just over 3 years.Sure it will probably last longer than that but still.It's like buying a light bulb.
>>100164402what do you do with it, do you write and rewrite constantly?also how do you check the health
>>100164291My point was to compress raw TIFFs with zstd, and maybe stream-decompress them on the other side, not use zstd within TIFF.But maybe there are limitations (vendor or otherwise), as you mention, that doesn't allow for that.
>>100164402Time is not a factor in ssd health calculations.
>>100150913I'll bet you money it's to replace tape drives for long term storage. Might be released to the public, but you'll still pay enterprise© prices
>>100164402How many TB has it written over the time? Health should be depleting as more and more writes are made. If health is dropping faster than expected, something must be doing lots of writes you (don't) know about.
This expression dates itself:"Never underestimate the bandwidth of a station wagon full of tapes"
>>100157391You're a bugchaser with a laptop.
>>100164402samsung is generally ok, but has had certain drives with really bad firmware that eat themselves up quickly. Keep an eye on the SMART data and do some searches on your model # to see if others are having the same problem.
>>100149815Radio astronomers.
>>100149977Because the moment you do, the glowies get nervous and/or lick their lips and then they'll confiscate it.
>>100149977That's literally how Amazon does it with its truck. And the radio astronomers haul VLBI data that way for ages.
>>100164402I've had a Corsair 1TB NVME SSD for almost 5 years and it's only at 90%, the fuck are you doing with yours?
>>100157989Stop making assumptions like this faggot.
>>100149815The Goonbox.
me
>>100149815368 TB of CP
>>10014981599% of /g/ can't even bench press that
>>100153041literal cartoon watching neckbeard faggot. this nigga watches cartoons LMAO
>>100161759Yeah I'm sure he made a binder of women and bought a fleshlight ironically
>>100149815>>100150913>>100151448Amazon has been selling petabyte storage units for years
>>100163793They fail and you're screwed. The type of people that require what's in the OP are dealing with big business, not whatever you have going on
>>100149977https://aws.amazon.com/snowball/
>>100170073>pisses onto your petabyte briefcase with $10 million worth of corpo data
>>100149826k e k
>>100166894This is a great answer, broski.
>>100153088Is that a goddamn Liir?
>>100150422kys metricuck
>>100171360>be republic>use the units of an empire that doesn't even existAmerican moment
>>100158097sauce on this cutie pie?
>>100171750>be Britain, a Constitutional Monarchy>use the units of Revolutionary France Bong moment
>>100149815Finally my entire anime collection can fit on one portable drive!
>>100174845>she only has 400tb of animedo you even weeb?
>>100149826KEK
>>100170073thats not an ssd
>>100149815>>100149826>>100164347>>100167989It is an SSD for a reason, someone needs to persist and/or read a lot of data quicker than they would with HDD
>>100149977Cool idea, butIf it's Boeing, I ain't going.
>>100156324Where do you think all your CPUs and microcontrollers come from?
oops looks like our top secret government everything got lost off a back of a truck is israel
My company needed to move a massive amount of data to AWS glacial storage. We used one of their snowmobiles to do it. It took a bit to get the data into the truck but once they drove it to their datacenter they have some special connections that loaded it to s3 about 3x faster than we gave it to them. Saved on pushing the data over the cloud, saved on data ingress costs in aws. and now saving a shit load on the costs of keeping the data. They make smaller tools for the same process like the "snowbal" which lets someone do the same thing with a suitcase. Depending on the dataset size and its location it can certainly be cheaper and faster to do it physically. Ingress/egress costs can be a bitch depending on who youre paying in the chain. A colo egress of a couple PB of data probably costs more than that suitcase(pic not mine)
>>100154230paltry
>>100149815Big data from a large number of scientific instruments in raw form that needs to be transported off site.Seems a bit easier than using dozens of external drives with labels.
>>100149815Roughly 3 to 4 AAAA games.(or you can play it remotely via stream!)
>>100173242Cindy Starfall
>>100178080>snowmobilesThey made one truck for one company originally and not many companies tend to use them.Who do you work for anon?
>>100179776"My company" is a misnomer here since I dont work for them anymore. But it was digitalglobe. Dont remember the exact dates since pre-covid is a blur but it around 2017. Before I moved from Denver. Theres no way only one company has used it. The dates we originally wanted to move it it was reserved.
>>100149977How do you get the plane to the data centre to attach that storage to someone's network?
>>100169781You knooooow... Black people...
