Talk:Markov process

From Wikipedia, the free encyclopedia

Contents

[edit] Merge

This article should be merged with the article Markov chain. As far as I can tell, this article doesn't actually say anything that the Markov chain article doesn't say. linas 15:56, 4 September 2005 (UTC)

I agree that the content may be related, but I think having a separate entry for Markov processes is still useful for the layperson. (Anonymous user) 23:37, 22 September 2005 (PST).
?? I don't get the sense that this aricle is somehow "easier to understand" than the other one. linas 16:18, 23 September 2005 (UTC)
Laypersons looking for a Markov process will be redirected to Markov chain when the redirect is in place --Anthony Liekens 14:43, 10 October 2005 (UTC)
I think it should be merged with Markov property not with markov chain. Markov property
the contents of this article discusses the Markov property, but it's title is more related to a Markov chain, not the Markov property --Anthony Liekens 14:43, 10 October 2005 (UTC)
Agree, just putting up a redirect to Markov chain would be sufficient. By the way, there's a lot of work to be done in Markov chain itself! --Anthony Liekens 14:43, 10 October 2005 (UTC)
It makes sense to fold Process into the Property entry, then have a link called Process. But I would leave the Chain entry alone unless someone has a clear idea how to integrate Process, Property, Chain, and perhaps HMM, MDP, and POMDP. --Randy Crawford 20:55, 10 October 2005 (UTC)
At the very least, somewhere there needs to be either an entry or subsection for 'Markov process.' Any textbook on Stochastic Processes usually has an entire chapter devoted to 'Markov processes'. Furthermore, not all Markov processes are Markov chains (e.g. a process that is not stationary or homogeneous in time); redirecting the entry for the 'process' to an entry for one particular class of that process would only confuse and bias the reader. If it is to be redirected, it ought to be to folded into Markov property and not Markov chain. --H. C. Hodges 15:52, 22 October 2005 (PST).
Markov property seems a nicer article than Markov process, but since the Markov property is a property of processes, an article titled Markov process and also covering the Markov property seems best. Then, Markov property could redirect there. Merging this with Markov chain would be a mistake, for the reasons given by H. C. Hodges. Ben Cairns 13:39, 23 October 2005 (UTC).

I have clarified the second paragraph slightly. LS

[edit] Introductory sentence

It would be good to have an introductory sentence that introduces the subject to a layperson. For example, see [1]. Jim 18:51, 24 March 2006 (UTC)

[edit] Continuous Time

For mathematicians, usually Markov process means continuous time, whereas Markov chain means discrete time. Markov processes are often used in chemistry and biology, and their properties are different than Markov chains -- would be nice to have a separate entry. Leboudec 16:24, 15 May 2006 (UTC)

[edit] Continuous Value

Markov chain is only for countable set of states. I thought Markov process might contain continuous valued version. (c.f. Mathworld [2]) Memming 13:15, 24 September 2006 (UTC)