Ban (information)
From Wikipedia, the free encyclopedia
A ban, sometimes called a hartley (symbol Hart), is a logarithmic unit which measures information or entropy, based on base 10 logarithms and powers of 10, rather than the powers of 2 and base 2 logarithms which define the bit. Like a bit corresponds to a binary digit, a ban is a decimal digit. A deciban is one tenth of a ban.
One ban corresponds to about 3.32 bits (log2(10)), or 2.30 nats (ln(10)). A deciban is about 0.33 bits.
[edit] History
The ban and the deciban were invented by Alan Turing with I. J. Good in 1940, to measure the amount of information which could be deduced by the codebreakers at Bletchley Park using the Banburismus procedure, towards determining each day's unknown setting of the German naval Enigma cipher machine. The name was inspired by the enormous sheets of card, printed in the town of Banbury about 30 miles away, that were used in the process.
The term hartley is after Ralph Hartley, who suggested this unit in 1928 (Reza [1961] 1994:7).
The units pre-date Shannon's bit by at least eight years.
[edit] Usage as a unit of probability
The deciban is a particularly useful measure of odds-ratios or weights of evidence. 10 decibans corresponds to an odds ratio of 10:1; 20 decibans to 100:1 odds, etc.
According to I. J. Good a change in a weight of evidence of 1 deciban (ie a change in an odds ratio from evens to about 55:45), or perhaps half a deciban, is about as finely as humans can reasonably be expected to quantify their degree of belief in a hypothesis.
[edit] References
- Hartley, R.V.L., "Transmission of Information," Bell System Technical Journal, July 1928
- Reza, Fazlollah M. An Introduction to Information Theory. New York: Dover, 1994. ISBN 0-486-68210-2
- David J. C. MacKay. Information Theory, Inference, and Learning Algorithms Cambridge: Cambridge University Press, 2003. ISBN 0-521-64298-1. This on-line textbook includes a chapter on the units of information content, and the game of Banburismus that the codebreakers played when cracking each day's Enigma codes.