Power Laws for Monkeys Typing Randomly: The Case of Unequal Probabilities
- 21 June 2004
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 50 (7), 1403-1414
- https://doi.org/10.1109/tit.2004.830752
Abstract
An early result in the history of power laws, due to Miller, concerned the following experiment. A monkey types randomly on a keyboard with N letters (N>1) and a space bar, where a space separates words. A space is hit with probability p; all other letters are hit with equal probability (1-p)/N. Miller proved that in this experiment, the rank-frequency distribution of words follows a power law. The case where letters are hit with unequal probability has been the subject of recent confusion, with some suggesting that in this case the rank-frequency distribution follows a lognormal distribution. We prove that the rank-frequency distribution follows a power law for assignments of probabilities that have rational log-ratios for any pair of keys, and we present an argument of Montgomery that settles the remaining cases, also yielding a power law. The key to both arguments is the use of complex analysis. The method of proof produces simple explicit formulas for the coefficient in the power law in cases with rational log-ratios for the assigned probabilities of keys. Our formula in these cases suggests an exact asymptotic formula in the cases with an irrational log-ratio, and this formula is exactly what was proved by Montgomery.Keywords
This publication has 10 references indexed in Scilit:
- Analytic CombinatoricsPublished by Cambridge University Press (CUP) ,2009
- A Brief History of Generative Models for Power Law and Lognormal DistributionsInternet Mathematics, 2004
- The Pareto law of incomes—an explanation and an extensionPhysica A: Statistical Mechanics and its Applications, 2002
- Average Case Analysis of Algorithms on SequencesPublished by Wiley ,2001
- Highly optimized tolerance: A mechanism for power laws in designed systemsPhysical Review E, 1999
- Zipf’s law is not a consequence of the central limit theoremPhysical Review E, 1998
- Zipf’s law, the central limit theorem, and the random division of the unit intervalPhysical Review E, 1996
- Some Effects of Intermittent SilenceThe American Journal of Psychology, 1957
- On a Class of Skew Distribution FunctionsBiometrika, 1955