Talk:Rényi entropy
From Wikipedia, the free encyclopedia
[edit] Why α=1 is special
Section doesn't feel like it's quite there yet. Maybe consider what happens when you're using a Renyi entropy as a measure of ecological diversity, and then realise that you need to split one species into two... -- Jheald 22:19, 23 January 2006 (UTC).
[edit] To add
Renyi entropy was defined axiomatically in Renyi's Berkeley entropy paper. In this, a weakening of one of the Shannon axioms results in Renyi entropy; that's why α=1 is special. Also, some of Renyi entropy's applications - Statistical physics, General statistics, Machine learning, Signal processing, Cryptography (a measure of randomness, robustness), Shannon theory (generalizing, proving theorems), Source coding - should be added with context. I don't have all this handy right now, but I'm sure each piece of this is familiar to at least one person reading this page.... Calbaer 05:59, 5 May 2006 (UTC)
- Also the continuous case is missing. -- Zz 11:58, 24 October 2006 (UTC)
[edit] non-decreasing?
The statement that Hα is non-decreasing in α seems to contradict the statement that . Also, should that be a weak inequality? LachlanA 23:24, 21 November 2006 (UTC)