Previous |  Up |  Next

Article

Title: Approximation of bivariate Markov chains by one-dimensional diffusion processes (English)
Author: Kuklíková, Daniela
Language: English
Journal: Aplikace matematiky
ISSN: 0373-6725
Volume: 23
Issue: 4
Year: 1978
Pages: 267-279
Summary lang: English
Summary lang: Czech
Summary lang: Russian
.
Category: math
.
Summary: The paper deals with several questions of the diffusion approximation. The goal of this paper is to create the general method of reducting the dimension of the model with the aid of the diffusion approximation. Especially, two dimensional random variables are approximated by one-dimensional diffusion process by replacing one of its coordinates by a certain characteristic, e.g. by its stationary expectation. The suggested method is used for several different systems. For instance, the method is applicable to the sequences of Markov chains $\left\{(^nX_m, ^nY_m), m=0,1,\ldots \right\}\ n=1,2,\ldots$ where the tendency of $\left\{^nY_m \right\}$ to the stationary state is greater than that of $\left\{^nX_m\right\}$. (English)
Keyword: diffusion approximation
Keyword: Markov chains
Keyword: ito equation
Keyword: difference equation
Keyword: renewal process
MSC: 60F05
MSC: 60H10
MSC: 60J05
MSC: 60J60
MSC: 60K05
idZBL: Zbl 0405.60071
idMR: MR0495429
DOI: 10.21136/AM.1978.103752
.
Date available: 2008-05-20T18:09:49Z
Last updated: 2020-07-28
Stable URL: http://hdl.handle.net/10338.dmlcz/103752
.
Reference: [1] I. I. Gichman A. V. Skorochod: Theory of Random Processes III.(in Russian). Nauka, Moscow 1975. MR 0651014
Reference: [2] P. Mandl: A connection between Controlled Markov Chains and Martingales.Kybernetika 9 (1973), 237-241. Zbl 0265.60060, MR 0323427
Reference: [3] P. Mandl: On aggregating controlled Markov chains.in Jaroslav Hájek Memorial Volume (to appear). Zbl 0431.93063, MR 0561266
Reference: [4] P. Morton: On the Optimal Control of Stationary Diffusion Processes with Inaccessible Boundaries and no Discounting.J. Appl. Probability 8 (1971), 551 - 560. Zbl 0234.49019, MR 0292572, 10.2307/3212178
.

Files

Files Size Format View
AplMat_23-1978-4_4.pdf 1.503Mb application/pdf View/Open
Back to standard record
Partner of
EuDML logo