Letter frequencies
From Wikipedia, the free encyclopedia
The frequency of letters in text messages has often been studied for use in cryptography, and frequency analysis in particular. An exact analysis of this is not possible, as each person writes slightly differently, and the amount of writing in a language is too vast to allow anything more than a statistical sample of a language to be analysed. Linotype machines used the ordering etaoin shrdlu cmfwyp vbgkqj xz based on what was believed the order of frequency of use was in the English language at the time the machine was invented. More recent analyses show some variation in the order of letter frequencies.
Letter frequencies, like word frequencies, tend to vary, both by writer and by subject. One cannot talk about x-rays without using frequent Xs, and different authors have habits which can be reflected in their use of letters. American English has more 'z's than British English, because American English uses the suffix "-ize" while British English also uses "-ise".
Everyone writes differently – for example, Hemingway's writing style is quite visibly different from Faulkner's. Letter, bigram, trigraph, word frequencies, average word length and average sentence length can be calculated for specific authors, and used to prove or disprove authorship of texts, even for authors whose styles aren't so divergent.
A precise average usage can only be gleaned by analyzing usage in a large mass of representative text; since the availability of modern computing and collections of large text corpora, such calculations are nearly trivial.
[edit] Relative frequencies of letters in the English language
| By letter | By frequency | ||
| Letter | Frequency | Letter | Frequency |
| a | 8.167% | e | 12.702% |
| b | 1.492% | t | 9.056% |
| c | 2.782% | a | 8.167% |
| d | 4.253% | o | 7.507% |
| e | 12.702% | i | 6.966% |
| f | 2.228% | n | 6.749% |
| g | 2.015% | s | 6.327% |
| h | 6.094% | h | 6.094% |
| i | 6.966% | r | 5.987% |
| j | 0.153% | d | 4.253% |
| k | 0.772% | l | 4.025% |
| l | 4.025% | c | 2.782% |
| m | 2.406% | u | 2.758% |
| n | 6.749% | m | 2.406% |
| o | 7.507% | w | 2.360% |
| p | 1.929% | f | 2.228% |
| q | 0.095% | g | 2.015% |
| r | 5.987% | y | 1.974% |
| s | 6.327% | p | 1.929% |
| t | 9.056% | b | 1.492% |
| u | 2.758% | v | 0.978% |
| v | 0.978% | k | 0.772% |
| w | 2.360% | j | 0.153% |
| x | 0.150% | x | 0.150% |
| y | 1.974% | q | 0.095% |
| z | 0.074% | z | 0.074% |
