Possibility theory
From Wikipedia, the free encyclopedia
Possibility theory is a mathematical theory for dealing with certain types of uncertainty and is an alternative to probability theory. Professor Lotfi Zadeh first introduced possibility theory in 1978 as an extension of his theory of fuzzy sets and fuzzy logic. D. Dubois and H. Prade further contributed to its development. Earlier in the 50s, economist G.L.S. Shackle proposed the min/max algebra to describe degrees of potential surprise.
Contents |
[edit] Formalization of possibility
For simplicity, assume that the universe of discourse Ω is a finite set, and assume that all subsets are measurable. A distribution of possibility is a function from Ω to [0, 1] such that:
- Axiom 1:
- Axiom 2:
- Axiom 3: for any disjoint subsets U and V.
It follows that, like probability, the possibility measure on finite or countably infinite sets is determined by its behavior on singletons:
provided U is finite or countably infinite.
Axiom 1 can be interpreted as the assumption that Ω is an exhaustive description of future states of the world, because it means that no belief weight is given to elements outside Ω.
Axiom 2 could be interpreted as the assumption that the evidence from which was constructed is free of any contradiction. Technically, it implies that there is at least one element in Ω with possibility 1.
Axiom 3 corresponds to the additivity axiom in probabilities. However there is an important practical difference. Possibility theory is computationally more convenient because Axioms 1-3 imply that:
- for any subsets U and V.
Because one can know the possibility of the union from the possibility of each component, it can be said that possibility is compositional with respect to the union operator. Note however that it is not compositional with respect to the intersection operator. Generally:
Remark for the mathematicians:
When Ω is not finite Axiom 3 can be replaced by:
- For all index sets I, if the subsets are pairwise disjoint,
[edit] Necessity
Whereas probability theory uses a single number, the probability, to describe how likely an event is to occur, possibility theory uses two concepts, the possibility and the necessity of the event. For any set U, the necessity measure is defined by
In the above formula, denotes the complement of U, that is the elements of Ω that do not belong to U. It is straightforward to show that:
- for any U
and that:
Note that contrary to probability theory, possibility is not self-dual. That is, for any event U, we only have the inequality:
However, the following duality rule holds:
- For any event U, either , or
Accordingly, beliefs about an event can be represented by a number and a bit.
[edit] Interpretation
There are four cases that can be interpreted as follows:
means that U is certainly true. It implies that .
means that U is certainly false. It implies that .
means that I would not be surprised at all if U occurs. It leaves unconstrained.
means that I would not be surprised at all if U does not occur. It leaves unconstrained.
The intersection of the last two cases is and meaning that I believe nothing at all about U. Because it allows for indeterminacy like this, possibility theory relates to the graduation of a three-valued logic, such as intuitionistic logic, rather than the classical two-valued logic.
Note that unlike possibility, fuzzy logic is compositional with respect to both the union and the intersection operator. The relationship with fuzzy theory can be explained with the following classical example.
- Fuzzy logic: When a bottle is half full, it can be said that the level of truth of the proposition "The bottle is full" is 0.5. The word "full" is seen as a fuzzy predicate describing the amount of liquid in the bottle.
- Possibility theory: There is one bottle, either completely full or totally empty. The proposition "the possibility level that the bottle is full is 0.5" describes a degree of belief. One way to interpret 0.5 in that proposition is to define its meaning as: I am ready to bet that it's empty as long as the odds are even (1:1) or better, and I would not bet at any rate that it's full.
[edit] Possibility theory as an imprecise probability theory
- There is an extensive formal correspondence between probability and possibility theories, where the addition operator corresponds to the maximum operator.
- A possibility measure can be seen as a consonant plausibility measure in Dempster-Shafer theory of evidence. The operators of possibility theory can be seen as a hyper-cautious version of the operators of the transferable belief model, a modern development of the theory of evidence.
- Possibility can be seen as an upper probability: any possibility distribution defines a unique set of admissible probability distributions by
This allows one to study possibility theory using the tools of imprecise probabilities.
[edit] References
- Dubois, Didier and Prade, Henri, "Possibility Theory, Probability Theory and Multiple-valued Logics: A Clarification", Annals of Mathematics and Artificial Intelligence 32:35-66, 2001.
- Zadeh, Lotfi, "Fuzzy Sets as the Basis for a Theory of Possibility", Fuzzy Sets and Systems 1:3-28, 1978. (Reprinted in Fuzzy Sets and Systems 100 (Supplement): 9-34, 1999.)