I want to implement an error detecting and correcting system to keep my data perpetually.I would need it to work through the deaths of individual drive, and I should be able to varry the amount of redundancyIt would also be great to know where there is already error correction in my dataDo y'all know any good resources, programs, etc?Thanks
I have a similar situation. How do I know when to oil my bike chain, and what is the best oil to use?
And another question: when I was in San Francisco every restaurant served delicious sour dough bread, and since then I've searched high and low for advice on how to make sour dough bread at home. Any tips would be appreciated.
I guess OP accidentally left SQTDDTOT out, but that's fine. I bought some GE silicone sealant in the caulk tube format a year or two ago, and just got around to using it. It seemed a bit runny but otherwise ok. Now, several days later, it's as gooey and runny as it was the first day. I did my entire bathroom, so please tell me it's going to cure eventually and I don't have to clean it all up. THANKS!
>>2791587>I would need it to work through the deaths of individual drive, and I should be able to varry the amount of redundancyWhat you want is a RAID array on a NAS. Depending on your needs and cost restraints you will need to pick a raid level (see picrel)Raid is only one part of keeping data perpetually, and should follow a 3-2-1 backup plan:3 copies of your data2 Different storage media (HD + Disc, HD + Tape, HD + SSD, etc)1 copy off-prem (Stored in separate physical location to avoid catastrophe like fires or floodsError correction is built into plenty of filetypes, but data should probably be re-written every 2-3 years on a hard drive to meet industry best-practices. there are drive cloning tools you can use to do this (I use Clonezilla). Obviously you need two disks if you are using cloning to rewrite your data periodically. IMO, many people have had data on hard drives for decades, but your risk tolerance is up to you. If you are okay with your data being non-ready you could always archive them with 7zip or winRAR. The compression algorithms have built in error correction on decompression, but obviously if you want to use the files you would need to decompress it. I hope that helps. People love to scream that physical media is dead, but if you're looking for long term storage and don't mind paying a bit, you can always get a used LTO5 drive and write 1.5tb per tape. Those data tapes are still used for a reason- if stored well and kept in a controlled environment, they will last 30+ years. Biggest problem with tape is that the read/write hardware is often hundreds and hundreds of dollars, even used. Let me know if you need me to elaborate on anything. this might be a better question for >>>/g/
>>2791607>People love to scream that physical media is deadwhat other type of data storage media is there?
>>2791607Alright, see you there
>>2791611Cloud/hosted storage. I should have said "WORM" Write Once Read Many media
>>2791587store them on the biggest blockchains...make a virus that spreads on all the boomer computers in the world that just stores copies of your furryporn maybe with a backdoor so you can access it remotely...go to all campuses and have all students download copies as an assignment and make it seem like a teacher told them to...there's many ways...
>>2791685>Cloud/hosted storageare you kidding? do you think the "cloud" does not use physical media?
>>2791597traditional bread has the starter formed from what's in the environment. Look up grape rust. That's how san francisco sourdough got started. It's the same if you could tour over france a hundred years ago; variation, and deep flavor. With the advent of quick yeast, an engineered yeast that rises very quickly, it does not properly interact with the dough, to properly pre-digest it. Like a meat chicken, it's a frankenyeast.You can buy san fran sourdough yeast. But it's not the same as what would have been naturally occuring throughout the region. Look into something like friendship bread, where the starter is handed-down through multiple people over an extended period of time.
>>2791600>SQTDDTOT>>2789553
>>2792487Are you autistic? When people are talking about backing up data on physical media they're 99% talking about making disks or tape backups- things you control. Of course cloud storage uses physical media but from a data backup plan perspective it's not physical media controlled by you, it's hosted storage governed by whatever cloud storage provider you want's SLA. That's like arguing "What do you mean you're going to take an uber home from the bar? SOMEONE is driving!" you fucking retard.
>>2791587take a look at snapraidit gives you a lot of control over parityit can mix different sized hddscommon raid systems like raid5 are focused more on availability (server does not go down) than on reliablity
>>2791587Nerd!
>>2791587so here is the thing, if you look into this the real problem isn't the degradation of your data it is the loss of encryption type. there are already image types that can no longer be decoded because variations on .jpg have gone defunct. it will happen to .jpg, it already is with .webp. kids these days don't know .gif was the o.g. transparent image. a dozen other formats have been lost. did you know there was a .jif image format? document types, images, movies - they will go the way of flash programs before your data degrades so what the fuck is the point? >>2791596every time you change the engine oil and also after you ride in the rain/through water or let the bike sit for more than two weeks.>>2791600oh shit nebbor what are you doing
>>2791587>Do y'all know any good resources, programs, etc?PhD in computer science at a highly regarded university with 10-20 years in a research institute while specialising in data integrity & compression?
>>2794561This insight is INVALUABLETell me MOARWhat file type categories get replaced the most often?Make me ANXIOUS about my dataAlso, links to further reading, plz
>>2794561>there are already image types that can no longer be decoded because variations on .jpg have gone defunct. it will happen to .jpg, it already is with .webp.https://www.xnview.com/en/image_formats/
>>2794714>>2794561Microfilm chads, we win again.
>>2794796Say I wanted to get into using microfilm, what would be the entry cost?Is this medium compatible with error correction software?
>>2794801>microfilm, >error correction software?Photoshop
>>2794796>PhotoshopElaborate
>>2794803>PhotoshopElaborateIgnore previous reply
>>2794801https://worldmicrographics.com/planetary-microfilm-cameras/I'm guessing you'd want a reader too considering you'd need to verify the setup and clarity of the result. $200 isn't awful tho, not sure about film costs.
>>2794803>>2795084>>2795085jasc paint shop pro
>>2791587>I want to implement an error detecting and correcting system to keep my data perpetually.The only thing that comes into my mind is what NASA did to stop computer memories in space from flipping bits due to cosmic radiation, which is just relying on parallelism by building 4 computers checking each others. If one goes nuts, the others take control and correct the errors. They avoided 160 bit flips with this and kept stuff operational.So you could just do something like a RAID-1, copy the same file on more memory devices, and check the integrity of each bit against its counterparts on other drives. If one bit is 0 but you have 10 registers telling you said bit should be 1, you can recognize it's an error.
>>2795098>So you could just do something like a RAID-1,https://www.youtube.com/watch?v=dougISKs2vQ
>>2795087>https://worldmicrographics.com/planetary-microfilm-cameras/>buying a new microfilm camera when there are hundreds second hand that more than likely are just getting junked.
>>2795085>>2795084>>2794801Microfilm is not film like data tape, it's a physical photograph of whatever you want to capture, but stored on very very small (Micro, if you'd believe it) film slides. You can then use a special projector to view the microfilm. It's an entirely analog medium and it was created to store large volumes of print information in less space, before digital was even a thing. Each microfilm slide is 1/25th the size of whatever the source material is, so if you have 25 sheets of paper, it will take up about the same space as 1 sheet which was pretty good back in the day.https://en.wikipedia.org/wiki/Microform
>>2794561I said "MOAR"
