Talk:Law of total probability

From Wikipedia, the free encyclopedia

WikiProject Mathematics
Mathematics Portal
This article is within the scope of WikiProject Mathematics, which collaborates on articles related to mathematics.
Mathematics rating: Start Class High Priority  Field: Probability and statistics

This article is within the scope of WikiProject Statistics, which collaborates to improve Wikipedia's coverage of statistics. If you would like to participate, please visit the project page.

Contents

[edit] Notations

I read somewhere that P(A|B):=\frac{P(A\cap B)}{P(B)}

in which case the two "different" notions of total probability would be aequivalent, since obvisously

P(A\cap B_n)=P(A\mid B_n)P(B_n) for n=1,2,3,\ldots

Note however that i have very little knowledge of the whole domain, so maybe i just missed the point...

--lu 10:42, 26 Apr 2005 (UTC)

[edit] conditional probability

The conditional probablity of A given B is only defined if the probability of B is non-zero. This is really unsatisfactory in this context, since you end up having to partition the space, avoiding zero-measure sets.

There must be a way around this tecnicallity. Or is it necessary? --67.103.110.175 02:55, 27 May 2006 (UTC)

OK, self, the statement should run more like, given Bi, mutually exclusive, whose probabilities sum to one ... Mathworld[1] So you can ignore that part of the space with zero probability, or include it, according to the situation. All that is important is that the part of the space with positive probability be covered. --67.103.110.175 02:55, 27 May 2006 (UTC)

It is absolutely necessary to be able to condition on continuous random variables. That entails conditioning on events of probability zero and getting nonzero conditional probabilities. Michael Hardy 21:52, 27 May 2006 (UTC)
Thanks for reverting and keeping the page accurate. However, in this case, it is a vanity and disservice not to mention that P(A|B) will not be defined for P(B)=0, in the discrete case. As for the continuous case, these are going to be a countable collection of events covering the space, so zero probability events remain insubstantial. Ozga 00:02, 28 May 2006 (UTC)

They are not at all insubstantial in the continuous case. When one finds E(Pr(A | X)). where X is a continuous random variable, the event on which one conditions always has probability 0. Michael Hardy 01:04, 30 May 2006 (UTC)

As in E(Pr(A | X))=Pr(A), as one reintegrates up the slices of A? --Ozga 17:28, 31 May 2006 (UTC)

I find this sentence confusing: "In the discrete case, the statements above are equivalent to the following statement, which also holds in the continuous case and is not the same as the law of alternatives." I think it should be reworded. Also, it is rather tricky to define the conditional probability of an event given the value of a continuous random variable. I think it is more or less

\mathrm{Pr}(A|X=x) = \lim_{\epsilon\rightarrow 0} \frac{\mathrm{Pr}(A\cap \{x-\epsilon < X < x+\epsilon\})}{\mathrm{Pr}(\{x-\epsilon < X < x+\epsilon\})},

provided that the density function of X is continuous at x, but take that with a grain of salt. --130.94.162.64 23:48, 15 June 2006 (UTC)

Indeed, it can be considered "tricky", since probably most people who grasp the idea intuitively do not know the Radon-Nikodym theorem, on which one of the usual definitions relies. But nonetheless perfectly doable. Michael Hardy 00:56, 16 June 2006 (UTC)
I still find that sentence confusing. From reading the entire article, I get the impression that the "law of total probability" has a perfectly unambiguous meaning that can be applied in a consistent way to both the discrete and continuous cases. The disclaimer that "nomenclature is not wholly standard" seems both a little unnecessary and rather foreboding to me. Perhaps instead, one could mention (in the beginning of that section) that in the discrete case it is also called the "law of alternatives". Also, the article should have references. --130.94.162.64 18:46, 17 June 2006 (UTC)
I think that's exactly what we should do. MisterSheik 22:34, 16 February 2007 (UTC)

[edit] Definition

From my user talk page 83.67.217.254 14:39, 26 August 2007 (UTC)

Your edit was horribly wrong. We DO NOT want to condition on the event's actually occurring; we DO want to allow general random variables and not just indicator variables of events; and the fact that we sometimes condition on events of probability 0 and therefore need to talk about densiety functions in order to apply the result to those cases in no way means the identity is wrong. Michael Hardy 14:27, 26 August 2007 (UTC)

Hey, thanks for the flowers Michael! :-) You were referring to this edit, which you reverted with a charming and welcoming comment. I'll be back later. 83.67.217.254 14:39, 26 August 2007 (UTC)
In the meantime you may want to reflect on the fact that the definition of conditional probability does not involve random variables, but events. In other words, in the definition of P(A|B), both A and B are events, not random variables. 83.67.217.254 14:44, 26 August 2007 (UTC)
You are writing nonsense. The definition there is the definition of conditional probability given an event. There is also such a thing as conditional probability given a random variable. That is the concept needed here. I have a Ph.D. in statistics and I know this material. Michael Hardy 17:02, 28 September 2007 (UTC)]
And I repeat: the edit I reverted was horribly horribly wrong. Michael Hardy 17:04, 28 September 2007 (UTC)

I agree the definition is inconsistent —Preceding unsigned comment added by 221.47.185.2 (talk) 01:54, 28 September 2007 (UTC)

OK, I've got a minute or two and I will elaborate (barely):

  • The conditional probability of an event given another event is just a number, not a random variable, so there would be no sense in evaluating its expected value, as this law does.
  • To say that this is true of any event is clearly nonsense because almost any specific concrete example you pick would be a counterexample proving that the proposed law is in fact false. And I would claim that that is trivial and obvious.
  • This law is found in many many many textbooks. Look it up. Don't insist on making a complete crackpot of yourself.

Michael Hardy 18:01, 28 September 2007 (UTC)
PS: The word definition that you've chosen as a heading is wrong. Concepts have definitions; propositions have statements. This is a proposition, not a concept. If you don't even know such elementary things, you shouldn't be acting that way you are. Michael Hardy 18:02, 28 September 2007 (UTC)

I have now added a new section to conditional probability that I hope will clear up the confusion on this point. Michael Hardy 19:47, 25 October 2007 (UTC)

I find it very interesting that your new definition almost exactly replicates my original edit. While I'm glad you are starting to understand, conditional probability given a continuous random variable is still not covered (unsurprisingly) by this novel definition of yours. Therefore, as I was suggesting in my edit comment, the definition of the law of total probability for continuous variables is still ill-defined. Horribly horribly yours, 83.67.217.254 13:01, 27 October 2007 (UTC)

It comes nowhere near replicating your edit, since you wrote of the conditional probability given an event, not about the conditional probability given a random variable, and your statement was clearly erroneous: you didn't need to understand what the law of total probability says in order to see that the statement as you wrote it was wrong, since virtually any example you picked would be a counterexample. I have not given any new definition in this article. I added a new section to a different article. There is nothing "novel" in the definition I gave. It is standard. I did not give the case of continuous random variables. The case I did give should make the idea clear.
Do not speak of "the definition of the law". One defines concepts; one states propositions. This law is a proposition, not a concept.
It is becoming apparent that you are here only to have fun arguing and you're dishonest. Michael Hardy 20:47, 27 October 2007 (UTC)
Other editors can judge for themselves whether or not your definition of conditional probability given a (discrete) random variable is equivalent to my edit on this article. You are entitled to your opinion and I am no longer interested in this aspect.
Since this definition of probability given a random variable is standard, you should have no problems referencing it (with page numbers if possible) and extending it (with references) to continuous variables. Until then, the current definition of the law of probability will not cover continuous variables.
By the way, as a minor point, I inform you that, despite your insistence to the contrary, I will keep writing about the "definition of the law", as opposed to, I suppose, the "statement of the law", since I find no ambiguity and you seem to understand what I mean perfectly well.
As for your accusation of "fun arguing"; I don't know what your concept of "fun" is, but I can assure you that your groundless and repeated personal attacks are not. In particular, I'd be interested to know when exactly I have been dishonest.
Also, in my user page you accuse me of "cowardice" for editing Wikipedia "anonymously". Firstly, I am not editing any more anonymously than you are. Wikipedia does not require the user names to correspond to real names, and provides no way to anybody to verify whether that is the case. If by "anonymous" you mean "unregistered", I'll have you know that I have been a happy unregistered user for quite some time, that Wikipedia welcomes unregistered users (and so should its editors) and that edits by unregistered users should not be discriminated against. This means by the way that you are not assuming good faith. Anyway, if you think I am a "coward" for not registering under my real name, I beg to differ and put to you that I find it foolish for anybody to register under their real name and run the risk (for some users apparently higher than for others) to have a permanent public record of being incompetent and behaving like a dick.
Finally, can I ask you to kindly rein in your use of bold and italics? It makes you look hysterical and desperate, and it's not conductive to a civil discussion. Thanks. 83.67.217.254 12:32, 28 October 2007 (UTC)

It's starting to become apparent that you are a retired lawyer with a lot of time on his hands. Now you're trying to make it appear that I said it's cowardly to edit Wikipedia anonymously. You know that I said I have nothing against anonymous editing and that I sometimes edit anonymously myself. I never said you're a coward simply for editing anonymously. I said that your behavior is that of a coward and that in your case it is out of cowardice that you edit anonymously. Michael Hardy 16:19, 28 October 2007 (UTC)

Can you prove this accusation? Or are you just failing to assume good faith? Actually, don't answer that, please let's stick to the more important issue at hand. 83.67.217.254 16:28, 28 October 2007 (UTC)

I think I can prove that in some of your comments you acted as if the accusation is true. Michael Hardy 23:34, 31 October 2007 (UTC)

So you can't prove your accusation(s). 83.67.217.254 00:26, 1 November 2007 (UTC)

As I said, it's becoming apparent that you're a retired lawyer with time on his hands. Michael Hardy 02:40, 1 November 2007 (UTC)

[edit] Law of total probability, conditional probability and conditional expectation

As per discussion above, the description currently given does not cover continuous random variables. I am no expert in this subject, but I suspect that the definition of the law currently suggested by this article cannot be extended to continuous variables without introducing the concepts of Borel sets, sigma field generated by a variable and the conditional expectation (as opposed to conditional probability) of a variable given that sigma field (see e.g. Mikosch 1998, sections 1.4.2--1.4.3).

I also suspect that the unreferenced definition of conditional probability given a random variable is original research. I believe that the "law of alternatives" reported in a separate section of the article is a better description covering discrete random variables. Incidentally, I think that contrary to what the article currently states, the partition defined by a discrete random variable is indeed a special case of a generic partition of the probability space.

Thanks for any insights. 83.67.217.254 23:09, 31 October 2007 (UTC)

It is not original research; it is found in many textbooks. I'll dig one out and cite it. For the most general definition, some measure-theoretic stuff is needed. Maybe I'll add them when I'm feeling more ambitious. But I think the very simplest example, which is the only one I gave, fully conveys what the concept is supposed to accomplish. 23:33, 31 October 2007 (UTC)

Please do not be overly ambitious if this is not your area of expertise. Hopefully this request will attract an expert third opinion. 83.67.217.254 00:21, 1 November 2007 (UTC)