Title:
|
Approximation of bivariate Markov chains by one-dimensional diffusion processes (English) |
Author:
|
Kuklíková, Daniela |
Language:
|
English |
Journal:
|
Aplikace matematiky |
ISSN:
|
0373-6725 |
Volume:
|
23 |
Issue:
|
4 |
Year:
|
1978 |
Pages:
|
267-279 |
Summary lang:
|
English |
Summary lang:
|
Czech |
Summary lang:
|
Russian |
. |
Category:
|
math |
. |
Summary:
|
The paper deals with several questions of the diffusion approximation. The goal of this paper is to create the general method of reducting the dimension of the model with the aid of the diffusion approximation. Especially, two dimensional random variables are approximated by one-dimensional diffusion process by replacing one of its coordinates by a certain characteristic, e.g. by its stationary expectation. The suggested method is used for several different systems. For instance, the method is applicable to the sequences of Markov chains $\left\{(^nX_m, ^nY_m), m=0,1,\ldots \right\}\ n=1,2,\ldots$ where the tendency of $\left\{^nY_m \right\}$ to the stationary state is greater than that of $\left\{^nX_m\right\}$. (English) |
Keyword:
|
diffusion approximation |
Keyword:
|
Markov chains |
Keyword:
|
ito equation |
Keyword:
|
difference equation |
Keyword:
|
renewal process |
MSC:
|
60F05 |
MSC:
|
60H10 |
MSC:
|
60J05 |
MSC:
|
60J60 |
MSC:
|
60K05 |
idZBL:
|
Zbl 0405.60071 |
idMR:
|
MR0495429 |
DOI:
|
10.21136/AM.1978.103752 |
. |
Date available:
|
2008-05-20T18:09:49Z |
Last updated:
|
2020-07-28 |
Stable URL:
|
http://hdl.handle.net/10338.dmlcz/103752 |
. |
Reference:
|
[1] I. I. Gichman A. V. Skorochod: Theory of Random Processes III.(in Russian). Nauka, Moscow 1975. MR 0651014 |
Reference:
|
[2] P. Mandl: A connection between Controlled Markov Chains and Martingales.Kybernetika 9 (1973), 237-241. Zbl 0265.60060, MR 0323427 |
Reference:
|
[3] P. Mandl: On aggregating controlled Markov chains.in Jaroslav Hájek Memorial Volume (to appear). Zbl 0431.93063, MR 0561266 |
Reference:
|
[4] P. Morton: On the Optimal Control of Stationary Diffusion Processes with Inaccessible Boundaries and no Discounting.J. Appl. Probability 8 (1971), 551 - 560. Zbl 0234.49019, MR 0292572, 10.2307/3212178 |
. |