Subjective logic

From Wikipedia, the free encyclopedia

Subjective logic is a type of probabilistic logic that explicitly takes uncertainty and belief ownership into account. In general, subjective logic is suitable for modeling and analysing situations involving uncertainty and incomplete knowledge[1][2]. For example, it can be used for modeling trust networks and for analysing Bayesian networks.

Arguments in subjective logic are subjective opinions about propositions. A binomial opinion applies to a single proposition, and can be represented as a Beta distribution. A multinomial opinion applies to a collection of propositions, and can be represented as a Dirichlet distribution. Through the correspondence between opinions and Beta/Dirichlet distributions, subjective logic provides an algebra for these functions. Opinions are also related to the belief functions of Dempster-Shafer belief theory.

A fundamental aspect of the human condition is that nobody can ever determine with absolute certainty whether a proposition about the world is true or false. In addition, whenever the truth of a proposition is expressed, it is always done by an individual, and it can never be considered to represent a general and objective belief. These philosophical ideas are directly reflected in the mathematical formalism of subjective logic.

Contents

[edit] Subjective opinions

Subjective opinions express subjective beliefs about the truth of propositions with degrees of uncertainty, and can indicate subjective belief ownership whenever required. An opinion is usually denoted as \omega^{A}_{x} where A\,\! is the subject, also called the belief owner, and x\,\! is the proposition to which the opinion applies. An alternative notation is \omega(A:x)\,\!. The proposition x\,\! is assumed to belong to a frame of discernment (also called state space) e.g. denoted as X\,\!, but the frame is usually not included in the opinion notation. The propositions of a frame are normally assumed to be exhaustive and mutually disjoint, and subjects are assumed to have a common semantic interpretation of propositions. The subject, the proposition and its frame are attributes of an opinion. Indication of subjective belief ownership is normally omitted whenever irrelevant.

[edit] Binomial opinions

Let x\,\! be a proposition. A binomial opinion about the truth of a x\,\! is the ordered quadruple \omega_{x} = (b,d,u,a)\,\! where:

b\,\!: belief is the belief that the specified proposition is true.
d\,\!: disbelief is the belief that the specified proposition is false.
u\,\!: uncertainty is the amount of uncommitted belief.
a\,\!: base rate is the a priori probability in the absence of evidence.

These components satisfy b+d+u=1\,\! and b,d,u,a \in [0,1]\,\!. The characteristics of various opinion classes are listed below.

An opinion where b=1\,\! is equivalent to binary logic TRUE,
where d=1\,\! is equivalent to binary logic FALSE,
where b+d=1\,\! is equivalent to a traditional probability,
where b+d<1\,\! expresses degrees of uncertainty, and
where b+d=0\,\! expresses total uncertainty.

The probability expectation value of an opinion is defined as E=b+au\,\!.

Binomial opinions can be represented on an equilateral triangle as shown below. A point inside the triangle represents a (b,d,u)\,\! triple. The b,d,u-axes run from one edge to the opposite vertex indicated by the Belief, Disbelief or Uncertainty label. For example, a strong positive opinion is represented by a point towards the bottom right Belief vertex. The base rate, also called relative atomicity, is shown as a red pointer along the base line, and the probability expectation, E\,\!, is formed by projecting the opinion onto the base, parallel to the base rate projector line. Opinions about the three propositions X, Y and Z are visualized on the triangle to the left, and their equivalent Beta distributions are visualized on the plot to the right. The numerical values and verbal discrete descriptions of each opinion are also shown. Example binomial opinions with corresponding Beta distributions

Beta distributions are normally denoted as \mathrm{Beta}(\alpha,\beta)\,\! where \alpha\,\! and \beta\,\! are its two parameters. The Beta distribution of a binomial opinion \omega = (b,d,u,a)\,\! is the function \mathrm{Beta}(\alpha,\beta) \mbox{ where } \begin{cases} \alpha &= 2b/u+2a\\ \beta &= 2d/u+2(1-a) \end{cases} \,\!

[edit] Multinomial opinions

Let X\,\! be a frame, i.e. a set of exhaustive and mutually disjoint propositions x_i\,\!. A multinomial opinion over X\,\! is the composite function \omega_{X}=(\vec{b}, u, \vec{a})\,\!, where \vec{b}\,\! is a vector of belief masses over the propositions of X\,\!, u\,\! is the uncertainty mass, and \vec{a}\,\! is a vector of base rate values over the propositions of X\,\!. These components satisfy u+\sum \vec{b}(x_i) = 1\,\! and \sum \vec{a}(x_i) = 1\,\! as well as \vec{b}(x_i),u,\vec{a}(x_i) \in [0,1]\,\!.

Visualising multinomial opinions is not trivial. Trinomial opinions could be visualised as points inside a triangular pyramid, but the 2D aspect of computer monitors would make this impractical. Opinions with dimensions larger than trinomial do not lend themselves to traditional visualisation.

Dirichlet distributions are normally denoted as \mathrm{Dir}(\vec{\alpha})\,\! where \vec{\alpha}\,\! represents its parameters. The Dirichlet distribution of a multinomial opinion \omega_{X} = (\vec{b},u,\vec{a})\,\! is the function \mathrm{Dir}(\vec{\alpha}) where the vector components are given by \vec{\alpha}(x_i) = 2\vec{b}(x_i)/u+2\vec{a}(x_i)\,\!

[edit] Subjective logic operators

Most operators in the table below are generalisations of binary logic and probability operators. For example addition is simply a generalisation of addition of probabilities. Most operators are only meaningful for combining binomial opinions, but some also apply to multinomial opinions[3]. Most operators are binary, but complement is unary, deduction is ternary and abduction is quaternary. See the referenced papers for mathematical details of each operator.

Subjective logic operators, notations, and corresponding propositional/binary logic operators
Subjective logic operator Operator notation Propositional/binary logic operator
Addition[4] \omega^{A}_{x\cup y}=\omega^{A}_{x}+\omega^{A}_{y}\,\! Union
Subtraction[4] \omega^{A}_{x\backslash y}=\omega^{A}_{x}-\omega^{A}_{y}\,\! Difference
Multiplication[5] \omega^{A}_{x\land y}=\omega^{A}_{x}\cdot \omega^{A}_{y}\,\! Conjunction / AND
Division[5] \omega^{A}_{x\overline{\land} y}=\omega^{A}_{x}/\omega^{A}_{y}\,\! Unconjunction / UN-AND
Comultiplication[5] \omega^{A}_{x\lor y}=\omega^{A}_{x}\sqcup \omega^{A}_{y}\,\! Disjunction / OR
Codivision[5] \omega^{A}_{x\overline{\lor} y}=\omega^{A}_{x}\;\overline{\sqcup}\;\omega^{A}_{y}\,\! Undisjunction / UN-OR
Complement[1][2] \omega^{A}_{\overline{x}}\;\;=\lnot\omega^{A}_{x}\,\! NOT
Deduction[6] \omega^{A}_{y\|x}=\omega^{A}_{x}\circledcirc (\omega^{A}_{y|x},\omega^{A}_{y|\overline{x}})\,\! Modus Ponens
Abduction[7] \omega^{A}_{y\overline{\|}x}=\omega^{A}_{x}\;\overline{\circledcirc}\; (\omega^{A}_{x|y},\omega^{A}_{x|\overline{y}},a_{y})\,\! Modus Tollens
Transitivity / discounting[1][2][8] \omega^{A:B}_{x}=\omega^{A}_{B}\otimes\omega^{B}_{x}\,\! n.a.
Cumulative fusion / consensus[1][9][3] \omega^{A\diamond B}_{x}=\omega^{A}_{x}\oplus \omega^{B}_{x}\,\! n.a.
Averaging fusion[8][3] \omega^{A\underline{\diamond} B}_{x}=\omega^{A}_{x}\;\underline{\oplus}\; \omega^{B}_{x}\,\! n.a.

Apart from the computations on the opinion values themselves, subjective logic operators also affect the attributes, i.e. the subjects, the propositions, as well as the frames containing the propositions. In general, the attributes of the derived opinion are functions of the argument attributes, following the principle illustrated below. For example, the derived proposition is typically obtained using the propositional logic operator corresponding to the subjective logic operator.

Subjective logic operator principle

The functions for deriving attributes depend on the operator. Some operators, such as cumulative and averaging fusion, only affect the subject attribute, not the proposition which then is equal to that of the arguments. Fusion for example assumes that two separate argument subjects are fused into one. Other operators, such as multiplication, only affect the proposition and its frame, not the subject which then is equal to that of the arguments. Multiplication for example assumes that the derived proposition is the conjunction of the argument propositions, and that the derived frame is composed as the Cartesian product of the two argument frames. The transitivity operator is the only operator where both the subject and the proposition attributes are affected, more specifically by making the derived subject equal to the subject of the first argument opinion, and the derived proposition and frame equal to the proposition and frame of the second argument opinion.

It is impractical to explicitly express complex subject combinations and propositional logic expressions as attributes of derived opinions. Instead, the trust origin subject and a compact substitute propositional logic term can be used.

Subject combinations can be expressed in a compact or expanded form. For example, the transitive trust path from A\,\! via B\,\! to C\,\! can be expressed as A:B:C\,\! in compact form, or as [A,B]:[B,C]\,\! in expanded form. The expanded form is the most general, and corresponds directly with the way subjective logic expressions are formed with operators.

[edit] Properties

Subjective logic allows extremely efficient computation of mathematically complex models. This is possible by approximating the analytically correct functions whenever needed. While it is relatively simple to analytically multiply two Beta distributions in the form of a joint distribution, anything more complex than that quickly becomes intractable. When combining two Beta distributions with some operator/connective, the analytical result is not always a Beta distribution and can involve hypergeometric series. In such cases, subjective logic always approximates the result as an opinion that is equivalent to a Beta distribution.

In case the argument opinions are equivalent to binary logic TRUE or FALSE, the result of any subjective logic operator is always equal to that of the corresponding propositional/binary logic operator. Similarly, when the argument opinions are equivalent to traditional probabilities, the result of any subjective logic operator is always equal to that of the corresponding probability operator (when it exists).

In case the argument opinions contain degrees of uncertainty, the operators involving multiplication and division will produce derived opinions that always have correct expectation value but possibly with approximate variance when seen as Beta/Dirichlet probability distributions[5]. All other operators produce opinions where the expectation value and the variance are always equal to the analytically correct values.

Different composite propositions that traditionally are equivalent in propositional logic do not necessarily have equal opinions. For example \omega_{x\land (y\lor z)} \neq \omega_{(x \land y)\lor (x\land z)}\,\! in general although the distributivity of conjunction over disjunction, expressed as x\land (y\lor z) \Leftrightarrow (x \land y)\lor (x\land z)\,\!, holds in binary propositional logic. This is no surprise as the corresponding probability operators are also non-distributive. However, multiplication is distributive over addition, as expressed by \omega_{x\land (y\cup z)} = \omega_{(x \land y)\cup (x\land z)}\,\!. De Morgan's laws are also satisfied as e.g. expressed by \omega_{\overline{x\land y}} = \omega_{\overline{x} \lor \overline{y}}\,\! .

[edit] Applications

Subjective logic is applicable when the situation to be analysed is characterised by considerable uncertainty and incomplete knowledge. Trust networks and Bayesian networks are typical examples.

Trust networks can be modelled with a combination of the transitivity and fusion operators. Let [A,B]\,\! express the trust edge from A\,\! to B\,\!. A simple trust network can for example be expressed as ([A,B]:[B,D])\diamond([A,C]:[C,D])\,\! as illustrated in the figure below.

Simple trust network

The indices 1, 2 and 3 indicate the chronological order in which the trust edges and recommendations are formed. Thus, given the set of trust edges with index 1, the origin trustor A\,\! receives recommendations from B\,\! and C\,\!, and is thereby able to derive trust in D\,\!. By expressing each trust edge and recommendation as an opinion A\,\!'s trust in D\,\! can be computed as \omega^{A}_{D} = (\omega^{A}_{B}\otimes \omega^{B}_{D}) \oplus (\omega^{A}_{C}\otimes \omega^{C}_{D})\,\!.

Trust networks can express the reliability of information sources for propositions, and can be used to determine subjective opinions about propositions. There can be a separate trust network leading to the opinion about each propositional term.

Logical structures can also be analysed without reference to trust networks or belief owners. In this way, subjective logic becomes a probabilistic logic for uncertain probabilities. This uncertainty is carried through the analysis and is made explicit in the results so that it is possible to distinguish between certain and uncertain conclusions.

[edit] References

  1. ^ a b c d A. Jøsang. Artificial Reasoning with Subjective Logic. Proceedings of the Second Australian Workshop on Commonsense Reasoning, Perth 1997. PDF
  2. ^ a b c A. Jøsang. A Logic for Uncertain Probabilities. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems. 9(3), pp.279-311, June 2001. PDF
  3. ^ a b c A. Jøsang. Probabilistic Logic Under Uncertainty. Proceedings of Computing: The Australian Theory Symposium (CATS'07), Ballarat, January 2007. PDF
  4. ^ a b D. McAnally and A. Jøsang. Addition and Subtraction of Beliefs. Proceedings of the conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU2004), Perugia, July, 2004.
  5. ^ a b c d e A. Jøsang, and D. McAnally. Multiplication and Comultiplication of Beliefs. International Journal of Approximate Reasoning, 38/1, pp.19-51, 2004.
  6. ^ A. Jøsang, S. Pope and M. Daniel. Conditional Deduction Under Uncertainty. Proceedings of the 8th European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty (ECSQARU 2005). Barcelona, Spain, July 2005.
  7. ^ S. Pope and A. Jøsang. Analysis of Competing Hypothesis using Subjective Logic. Proceedings of the 10th International Command and Control Research Technology Symposium (ICCRTS'05), McLean Virginia, USA, 2005.
  8. ^ a b A. Jøsang, S. Pope, and S. Marsh. Exploring Different Types of Trust Propagation. Proceedings of the 4th International Conference on Trust Management (iTrust'06), 2006.
  9. ^ A. Jøsang. The Consensus Operator for Combining Beliefs. Artificial Intelligence Journal, 142(1-2), Oct. 2002, p.157-170

[edit] External links