[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: 64392.png (32 KB, 256x256)
32 KB
32 KB PNG
why do we need archives in 2025?
dont get me wrong, archive formats like iso tar and so on to preserve a certain file and fs structure are extremely useful, but why compressed?
everyone has TB of space on their drives, why do we have to waste valuable time and cpu with packing and unpacking to go from a 12GB folder to 11.2GB archive and vice versa?
is single digit compression ratio really a priority nowadays?
>>
>one file transfer vs. downloading dozens of small files
>one file checksum vs. dozens of file checksums to verify your download
OP is a faggot
>>
>>106858013
> cloud storage
> especially: enterprise archives
> it's far more easy to move a tarball of your backup than a directory
> text compresses really well, porn doesn't. If you want to compress your cp, tgen ffmpeg is for that
> text is where the actual use cases (logs, corpora, code, enterprise data, etc.) exist.
>>
File: 1646401568963.jpg (237 KB, 720x720)
237 KB
237 KB JPG
>>106858026
You didn't address the premise at all. Either LLM or a retard.
>>106858013
Storage is still limited enough for it to matter.
Sure we have more storage space, but media files are getting larger too.
People fill up their phone and laptop storage all the time because photos and videos are so big.
>>
>>106858106
OP's premise is retarded. Nobody has cared about compression rates since the first consumer terabyte HDD.
>>
>>106858124
>nobody has cared
Lmao. Ok. That's why everything is stored in raw uncompressed format, right?
hmm wait, no. Almost every single file format people use has some form of compression built into it. Weird.
>>
>>106858149
Sure the archives are compressed but only barely. Everyone uses either the fast or default compression settings these days, with damn near nobody tinkering any further.
Back in the day putting together RAR files was an art form in itself, and of course if you truly wanted bonkers levels of compression you could go with LHA or something, eventually there was 7Z which also allowed ridiculous compression ratios.
But since none of that shit scales well most everyone just kinda gave up on it soon as the average download speed surpassed what ADSL could offer and hard drives started being measured in terabytes. Just wasn't worth it to spend 2 hours unpacking a 3 gigabyte file to save 500 megabytes of downloading.
>>
>>106858013
It increases throughput
>>
>>106858013
> waste valuable time ... unpacking
Some algos, lz4 in particular, can unpack so quickly that you can often read packed data faster than raw data.
>>
>>106858351
>Everyone uses either the fast or default compression settings these days, with damn near nobody tinkering any further.
wrong
>>
>>106858013
go transfer 100000 small files totaling 1gb.
and then do the same with 1 compressed 1gb file, containing 100000 small files.
>>
>>106858878
>compressed
why compressed tho
>>
that's something you ask sites with retarded file sharing limits
>>
Very rarely do people zip files to compress them, most just use it as a way to upload a bunch of files in a single package. The default settings for both Winrar and 7zip are so mild they rarely save much space.
There's no push for it to change because every cloud provider benefits from archives being the standard.
>>
>>106859185
OP is kind of right however in that compressing can be a huge time waster if file size is unimportant. I just tried out of curiosity and creating an uncompressed tar tile tool like 10 seconds, and a 7z file took close to 8 minutes.

I'm kind of annoyed with myself for wasting so much time making 7z files for archiving/backups now.
>>
We don't really need compression anymore because things that take up a lot of space (images, videos etc) are already compressed
Compression works best on text and other such things that are already tiny
>>
>>106858013
At scale, that 10% makes a big difference. Maybe it doesn't matter to you, but it matters to the entity that has to serve up that archive to 10 million people.
>>
>>106859248
Although I should mention the tar file was 2.5gb while the 7z file was 900mb. So you can still save a fair amount of space.
>>
>>106858013
The number of files I want to keep scales with the size of my storage. I will never be satisfied.
>>
>>106858124
>Nobody has cared about compression rates since the first consumer terabyte HDD.
Retarded zoomer take. Back in the 1980s and early 1990s they even sold hardware file compression accelerator cards.
>>
>>106858013
logfiles can go from 2GB to 50MB with compression
idk what to tell you op
>>
>>106859248
the real problem is retards who compress files into a single archive where there is very little gain

not only do you stop people from downloading specific files but people will just delete your torrent once it finishes since they would have to keep *both* the original zip/whatever and the uncompressed contents around at the same time
>>
>>106858013
>packaging <> compression
>>
>>106859372
Why did they stop selling hardware file compression accelerator cards?
>>
>>106858013
Decompression time is negligible these days, so might as well.
>>
>>106859453
>the real problem is retards who compress files into a single archive where there is very little gain
I meant to specify torrents here somewhere but I forgot to add the word back in when I edited it to clarify
oops
>>
>>106859453
Compression images or audio, or videos is waste of time, those media formats are already compressed. The type of compression you use is also important for some formats. There this thing we call "solid compression" or "solid file compression", it's when we treat all the files as a single one so we can squish redundant data from multiple files, and these compresses archives can only be extracted by decompressing the whole stream instead of just decompressing the file you want to extract. Sadly that is the case for tar.gz files.
>>
>>106859614
that does not stop people from compressing albums or tv series into a single file on some dinky public trackers
luckily it is very rare but it happens
>>
>>106859459
>Why did they stop selling hardware file compression accelerator cards?
I know you're pretending to be retarded but I'll bite
1. You needed special compression software that was compatible with the card to take advantage of it
2. CPUs became fast enough to make them not worth the cost and eventually totally unnecessary
>>
>>106858013
Because when I send files over the network, I dont want them to be the size of the budget sam altman requested from the us goverment to beat china just this week, and I dont want the transfer time to take the amount of time sam altman needs to create agi with said budget
>>
>>106858996
Why not retard?
>>
>>106858013
To easily share folders as a single, platform agnostic file.
>>
>>106858106
You don't have to compress a zip, rar or whatever file, you can set the compression to store and it will just act as an archive.
>>
>>106858013
More archives
>>
>>106859372
>Back in the 1980s and early 1990s
this isnt 80s and 90s
>>
>>106859817
Waste of time and cpu. Basically this >>106859248
>>
>>106859414
it's 2025 and you dont have 2GB to spare for allegedly important logs?
>>
>>106858013
I still can't comprehend how file compression works.
Why wouldn't any file already be at its most optimized size to begin with?
Is there really that much "data" inside that is so meaningless it can be effectively eliminated to compress the size?
>>
>>106858013
>everyone has TB of space on their drives
But everyone does not have TB/s of network bandwidth, which is a problem when you are a server with many clients downloading stuff from you all at the same time
>>
>>106860251
no I dont have 2GB to spare for logs from each of the previous years that I probably wont access
>>
>>106859248
Try using zstd instead of 7z.
Make a .tar.zst file. I think you'll be astounded at the speed.
>>
>>106859849
That has literally nothing to do with what I said.
Either bot or LLM confirmed.
>>
Great question. The truth is we don't need it at all and OP is 100% right. I also want to suck his cock and congratulate him on being born in 2005.
>>
>>106858013
TRUE. I just wasted 20 minutes adding 4.7GB to an archive. Why can't I just skip the compression and add the file as is fast as fuck. Just copy that shit.
>>
File: 1701964399034762.gif (2.33 MB, 280x182)
2.33 MB
2.33 MB GIF
>>106858013

Because despite the fact that we Do have cheap as chips disk space and tons of Compute and network, compression is important because it saves resources. You still have to buy those resources, and to maximize our utility, we compress files. IN Enterprise, that means more VMs or code can be backed up to a given unit of disk space, more per tape.

Video is the same way. Most video compression formats were invented to save disk space, because if you can figure out how to ditch 50+% (or more) of a video, with maybe only a slight dip in quality the average user would never notice, why not? Or imagine you are a streaming company like Netflix, you would definitely be interested in investing billions into newer video codecs to transmit video to end users with less bandwidth specifically so you could serve more customers. FLAC Is the same way. Take an audio signal and compress it with an algorithm designed for it, you end up cutting half the data requirements in exchange for fairly minimal CPU usage when playing the file to decompress.
>>
>>106858013
>need
but you don't.
>>
>>106860318
You're acting like a schizophrenic to feel like you've won an argument, your questions were already answered. An archive can add as an archive only or compress the files as well.
>>
File: 1736999325973228.png (8 KB, 295x171)
8 KB
8 KB PNG
>>106860344
Is this really that hard?
>>
>>106860256
>when you are a server
Not my problem now, is it?
Also your argument doesn't make any sense. So now we should go back to binary only text files and no multimedia to save some heckin bandwidth on the serverino? Go ahead nobody is stoping you.
>>
>>106860489
>compression is important because it saves resources
at a cost of time+cpu for packing and time+cpu for unpacking, it's not free, doesnt save me shit
>>
>>106860858
Not even running any faster. What a shit algorithm.
>>
>>106860888
I think your computer is shit and you are a super gay baby.
>>
>>106858013
>1000 cloud customers, 1 file = 1000 upload operations
>1000 cloud customers, 1000 files = 1^6 upload operations
Also I've seen 33% ration on a 1 GB file. It was an iso image. There's a lot of data distributed as images, there's usecase.
Also
>laptops
>TBs of storage
Sure mate
And it costs near nothing. In fact you can get more RAM if you use compression on it, now most people count it in double or even single digits of GB, not tons of TB.
>>
>>106860874
>Not my problem now, is it?
It is when you're trying to download something and your download speed is getting throttled because you're competing with x other downloaders for limited bandwidth, you retard
>>
>>106860891
This work laptop has a xeon with 128GB memory. To be honest Im zipping up hundreds of thousands of tiny files lmao.
>>
>>106860901
>1000 files
>>106858026
>dozens of small files
are you two legitimately mentally ill or just shit llm chat bots
OP clearly made a point regarding compressed vs uncompressed
not single file vs multiple files
what the fuck are you even talking about? nobody is splitting any files you shitheads.
>>
>>106860919
>limited bandwidth
Sounds like a U problem my guy
>>
File: 1729793130743.png (482 KB, 840x859)
482 KB
482 KB PNG
>are you an LLM?
>are you a bot?
>are you chatGPT?
>are you using AI?
holy shit calm down lmao
>>
>>106860940
I sincerely hope you get the lifelong support you clearly need.
>>
>>106860927
1 thong includes the other by default
>>
>>106858013
OS itself is ~100GB
A single game is ~300+GB now (Call of Duty).
2 more games are ~150GB each(GTA V and Final Fantasy VII, only the second part cause if you keep the first part, thats another 100GB).
If you add in a browser with its cache, thats ~30-40GB
If you use visual studio, thats another 30-40GB.

I still want to keep another 15% leftover for buffer if I want to move files on the SSD. I wont include any other music, anime, movies, etc. Cause those eat up.

So basically, my SSD is full with just simple things
>>
>>106860964
If you type like a bot, reason like a bot, and are as retarded as a bot, then people are going to assume you're a bot. Improve the quality of your posts if you don't want people to suspect you of not being human.
>>
Video codecs are just archived compression for thousands of frames.
>>
>>106860926
You still have to copy the file, it will do that as fast or as slow as you can copy a file. Your RAM means almost nothing in this context.
>>
File: 1733811405612.gif (1.54 MB, 532x403)
1.54 MB
1.54 MB GIF
>>106861107
You just sound owned lmao
>>
>>106858013
Sure, here's an answer for that 4channel user:
Compression is an incredibly important piece of technology nowadays. Not only it saves disk space, but also FUCK OFF WITH YOUR TIME-WASTING QUESTION YOU APE
>>
>>106858013
You can choose not to compress the files.
Compression is still useful, though. It is used all the time in web traffic.
>>
>>106861056
And compression is used all through those products.
>>
>>106859849
>photos are big, people are low on storage space
>U DONT HAVE TO COMPRESS A ZIP
lmao wtf
>>
>>106858026
enjoy virus
>>
>>106864620
You can't compress photos or other binary files much with zip, you fucking retard.
>>
>>106864961
Chocolate milk doesn't come from brown cows, moron
>>
Why are you all replying to this thread which was made by a faggot, nigger, or woman?
>>
>>106858013
I zip my tax documents even though I only worked 3 years my whole life. I never open them and they’re all pdfs so why not shrink it all down?
>>
>>106865044
>faggot, nigger, or woman
What's the difference again?



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.