Data degradation
Data degradation, also known as data decay or data rot, is a colloquial computing phrase for the gradual decay of storage media. It should not be confused with "bit rot", defined in the Jargon File as a jocular explanation for the degradation of a software program over time even if "nothing has changed".[1]
Decay of data in memory
Data degradation in dynamic random-access memory (DRAM) can occur when the small electric charge of a bit in DRAM disperses, possibly altering program code or stored data. semiconductor RAM may occasionally be altered by cosmic rays or other high-energy particles, known as soft error.[2]
Decay of storage media
Data degradation can also be used to describe the phenomenon of storage media gradually decaying over the duration of many years. The cause of data decay varies depending on the medium:
- Solid state media, such as EPROMs, flash memory and other solid-state drives, stores data using electrical charges, which can slowly leak away due to imperfect insulation. The chip itself is not affected by this, so re-programming it once per decade or so will prevent data decay. The biggest problem can be finding a clean copy of the master data from which to make the copy; frequently, by the time the user discovers the data decay, the master data may be lost.
- Magnetic media, such as hard disk drives, floppy disks and magnetic tapes, may experience data decay as bits lose their magnetic orientation. Periodic refreshing by rewriting the data can alleviate this problem. Also, in warm and humid conditions these media, especially the ones poorly protected against aggressive air conditions, are prone to the decomposition of the very material the are fabricated of.
- Optical media, such as CD-R, DVD-R and BD-R, may experience data decay from the breakdown of the material onto which the data is stored. This can be mitigated by storing discs in a dark, cool location with low humidity. "Archival quality" discs are also available, but do not necessarily provide a permanent solution to the onset of data decay or other types of data corruption beyond a certain amount of time. Some media (such as M-DISC) are designed to improve longevity over DVD-R and BD-R.
- Paper media, such as punched cards and punched tape, may also experience literal rotting. Mylar punched tape is available for use in this situation.
Component and system failures
Most disk, disk controller and higher-level systems are subject to a small degree of unrecoverable failure. With ever-growing disk capacities, file sizes, and increases in the amount of data stored on a disk, the likelihood of the occurrence of data decay and other forms of uncorrected and undetected data corruption increases.[3]
Higher-level software systems may be employed to mitigate the risk of such underlying failures by increasing redundancy and implementing integrity checking and self-repairing algorithms.[4] The ZFS file system was designed to address many of these data corruption issues.[5] The Btrfs file system also includes data protection and recovery mechanisms,[6] and so does ReFS.[7]
See also
- Checksum
- Database integrity
- Digital permanence
- Digital preservation
- Disc rot
- Link rot
- Software rot
- RAR archive file format has optional recovery
- PAR2 recovery file format
References
- ↑ Raymond, Eric. "Bit rot". The Jargon File. Retrieved 3 March 2013.
- ↑ O'Gorman, T. J.; Ross, J. M.; Taber, A. H.; Ziegler, J. F.; Muhlfeld, H. P.; Montrose, C. J.; Curtis, H. W.; Walsh, J. L. (January 1996). "Field testing for cosmic ray soft errors in semiconductor memories". IBM Journal of Research and Development 40 (1): 41–50. doi:10.1147/rd.401.0041. Retrieved 4 March 2013.
- ↑ Gray, Jim; van Ingen, Catharine (December 2005). "Empirical Measurements of Disk Failure Rates and Error Rates" (PDF). Microsoft Research Technical Report MSR-TR-2005-166. Retrieved 4 March 2013.
- ↑ Salter, Jim (15 January 2014). "Bitrot and atomic COWs: Inside "next-gen" filesystems". Ars Technica. Archived from the original on 23 March 2015. Retrieved 15 January 2014.
- ↑ Bonwick, Jeff. "ZFS: The Last Word in File Systems" (PDF). Storage Networking Industry Association (SNIA). Retrieved 4 March 2013.
- ↑ "btrfs Wiki: Features". The btrfs Project. Retrieved 19 September 2013.
- ↑ Wlodarz, Derrick. "Windows Storage Spaces and ReFS: is it time to ditch RAID for good?". Betanews. Retrieved 2014-02-09.