Some basic equations and the relations among various Markov chains are established. These works are the bases in the investigation of the theory of Markov chain in random environment.
This paper is a continuation of [8]. In Section 1, three kinds of communication are introdnced for two states and the relations among them are investigated. In Section 2, two kinds of period of a state are introdnced ...This paper is a continuation of [8]. In Section 1, three kinds of communication are introdnced for two states and the relations among them are investigated. In Section 2, two kinds of period of a state are introdnced and it is obtained that the period is a 'class property',i.e. two states x and y belong to same class implies the period of x is equal to the period of y.展开更多
The investigation for branching processes has a long history by their strong physics background, but only a few authors have investigated the branching processes in random environments. First of all, the author introd...The investigation for branching processes has a long history by their strong physics background, but only a few authors have investigated the branching processes in random environments. First of all, the author introduces the concepts of the multitype canonical Markov branching chain in random environment （CMBCRE） and multitype Markov branching chain in random environment （MBCRE） and proved that CMBCRE must be MBCRE, and any MBCRE must be equivalent to another CMBCRE in distribution. The main results of this article are the construction of CMBCRE and some of its probability properties.展开更多
This paper is a continuation of [8] and [9]. The author obtains the decomposition of state space X of an Markov chain in random environment by making use of the results in [8] and [9], gives three examples, random wal...This paper is a continuation of [8] and [9]. The author obtains the decomposition of state space X of an Markov chain in random environment by making use of the results in [8] and [9], gives three examples, random walk in random environment, renewal process in random environment and queue process in random environment, and obtains the decompositions of the state spaces of these three special examples.展开更多
There are two parts in this paper. In the first part we construct the Markov chain in random environment（MCRE）, the skew product Markov chain and p-θ^→ chain from a random transition matrix and a two-dimensional p...There are two parts in this paper. In the first part we construct the Markov chain in random environment（MCRE）, the skew product Markov chain and p-θ^→ chain from a random transition matrix and a two-dimensional probability distribution, and in the second part we prove that the invarianee principle for p-θ^→ chain, a more complex non-homogeneous Markov chain, is true under some reasonable conditions. This result is more powerful.展开更多
First of all, we introduces the concept of m-irreducible of Markov chain in random environment. Then under the condition of m-irreducible, the relationship of recurrent and positive recurrent between two states is stu...First of all, we introduces the concept of m-irreducible of Markov chain in random environment. Then under the condition of m-irreducible, the relationship of recurrent and positive recurrent between two states is studied. We also give several conditions that can imply a state is recurrent and positive recurrent. And then the period of a state is discussed and we obtained that under the condition of m-irreducible, for any two states in x, they have the same period.展开更多
The concepts of random Markov matrix, Markov branching chain in randomenvironment (MBCRE) and Laplace functional of Markov branching chain in random environment (LFMBCRE)are introduced. The properties of LFMBCRE and t...The concepts of random Markov matrix, Markov branching chain in randomenvironment (MBCRE) and Laplace functional of Markov branching chain in random environment (LFMBCRE)are introduced. The properties of LFMBCRE and the explicit formulas of momentsof MBCRE are given.展开更多
First of all we introduce the concepts of infinitely dimensional control Markov branching chains in random environments (β-MBCRE) and prove the existence of such chains, then we introduce the concepts of conditional ...First of all we introduce the concepts of infinitely dimensional control Markov branching chains in random environments (β-MBCRE) and prove the existence of such chains, then we introduce the concepts of conditional generating functionals and random Markov transition functions of such chains and investigate their branching property. Base on these concepts we calculate the moments of the β-MBCRE and obtain the main results of this paper such as extinction probabilities, polarization and proliferation rate. Finally we discuss the classification ofβ-MBCRE according to the different standards.展开更多
基金the National Natural Science Foundation of China(10 0 710 5 8-2 ) and Doctoral Programme Foundationof China
文摘Some basic equations and the relations among various Markov chains are established. These works are the bases in the investigation of the theory of Markov chain in random environment.
文摘This paper is a continuation of [8]. In Section 1, three kinds of communication are introdnced for two states and the relations among them are investigated. In Section 2, two kinds of period of a state are introdnced and it is obtained that the period is a 'class property',i.e. two states x and y belong to same class implies the period of x is equal to the period of y.
基金Project supported by the National Natural Science Foundation of China and the Foundation of Wuhan University
文摘The investigation for branching processes has a long history by their strong physics background, but only a few authors have investigated the branching processes in random environments. First of all, the author introduces the concepts of the multitype canonical Markov branching chain in random environment （CMBCRE） and multitype Markov branching chain in random environment （MBCRE） and proved that CMBCRE must be MBCRE, and any MBCRE must be equivalent to another CMBCRE in distribution. The main results of this article are the construction of CMBCRE and some of its probability properties.
基金Supported by the National Natural Science Foundation of China (10371092) and the Foundation of Wuhan University.
文摘This paper is a continuation of [8] and [9]. The author obtains the decomposition of state space X of an Markov chain in random environment by making use of the results in [8] and [9], gives three examples, random walk in random environment, renewal process in random environment and queue process in random environment, and obtains the decompositions of the state spaces of these three special examples.
文摘There are two parts in this paper. In the first part we construct the Markov chain in random environment（MCRE）, the skew product Markov chain and p-θ^→ chain from a random transition matrix and a two-dimensional probability distribution, and in the second part we prove that the invarianee principle for p-θ^→ chain, a more complex non-homogeneous Markov chain, is true under some reasonable conditions. This result is more powerful.
基金Supported by the National Natural Science Foundation of China (10371092)the Foundation of Wuhan University
文摘First of all, we introduces the concept of m-irreducible of Markov chain in random environment. Then under the condition of m-irreducible, the relationship of recurrent and positive recurrent between two states is studied. We also give several conditions that can imply a state is recurrent and positive recurrent. And then the period of a state is discussed and we obtained that under the condition of m-irreducible, for any two states in x, they have the same period.
文摘The concepts of random Markov matrix, Markov branching chain in randomenvironment (MBCRE) and Laplace functional of Markov branching chain in random environment (LFMBCRE)are introduced. The properties of LFMBCRE and the explicit formulas of momentsof MBCRE are given.
基金supported by the National Natural Science Foundation of China(Grant No:10371092)the Foundation of Wuhan University.
文摘First of all we introduce the concepts of infinitely dimensional control Markov branching chains in random environments (β-MBCRE) and prove the existence of such chains, then we introduce the concepts of conditional generating functionals and random Markov transition functions of such chains and investigate their branching property. Base on these concepts we calculate the moments of the β-MBCRE and obtain the main results of this paper such as extinction probabilities, polarization and proliferation rate. Finally we discuss the classification ofβ-MBCRE according to the different standards.
