• DML-CZ Home

60J05 Markov processes with discrete parameter (17 articles)

• López-Rivero, Jaicer; Cavazos-Cadena, Rolando; Cruz-Suárez, Hugo: Risk-sensitive Markov stopping games with an absorbing state. (English). Kybernetika, vol. 58 (2022), issue 1, pp. 101-122
• Yu, Wen-Hai; Ni, Hong-Jie; Dong, Hui; Zhang, Dan: Consensus of heterogeneous multi-agent systems with uncertain DoS attack: Application to mobile stage vehicles. (English). Kybernetika, vol. 56 (2020), issue 2, pp. 278-297
• Alanís-Durán, Alfredo; Cavazos-Cadena, Rolando: An optimality system for finite average Markov decision chains under risk-aversion. (English). Kybernetika, vol. 48 (2012), issue 1, pp. 83-104
• Asci, Claudio; Piccioni, Mauro: Asymptotic behaviour of a BIPF algorithm with an improper target. (English). Kybernetika, vol. 45 (2009), issue 2, pp. 169-188
• Cavazos-Cadena, Rolando: The risk-sensitive Poisson equation for a communicating Markov chain on a denumerable state space. (English). Kybernetika, vol. 45 (2009), issue 5, pp. 716-736
• Gordienko, Evgueni I.; Minjárez-Sosa, J. Adolfo: Adaptive control for discrete-time Markov processes with unbounded costs: Discounted criterion. (English). Kybernetika, vol. 34 (1998), issue 2, pp. [217]-234
• Melicherčík, Igor: Asymptotic behaviour of some Markov operators appearing in mathematical models of biology. (English). Mathematica Slovaca, vol. 48 (1998), issue 3, pp. 303-314
• Mohapl, Jaroslav: Mild law of large numbers and its consequences. (English). Mathematica Slovaca, vol. 43 (1993), issue 3, pp. 277-292
• Cavazos-Cadena, Rolando: Solution to the optimality equation in a class of Markov decision chains with the average cost criterion. (English). Kybernetika, vol. 27 (1991), issue 1, pp. 23-37
• Laušmanová, Monika: A vanishing discount limit theorem for controlled Markov chains. (English). Kybernetika, vol. 25 (1989), issue 5, pp. 366-374
• Cavazos-Cadena, Rolando: Weak conditions for the existence of optimal stationary policies in average Markov decision chains with unbounded costs. (English). Kybernetika, vol. 25 (1989), issue 3, pp. 145-156
• Kunderová, Pavla: The expected discounted reward from a Markov replacement process. (English). Acta Universitatis Palackianae Olomucensis. Facultas Rerum Naturalium. Mathematica, vol. 24 (1985), issue 1, pp. 97-105
• Kunderová, Pavla: On a mean reward from a Markov replacement process with only one isolated class of recurrent states. (English). Sborník prací Přírodovědecké fakulty University Palackého v Olomouci. Matematika, vol. 18 (1979), issue 1, pp. 145-155
• Kuklíková, Daniela: Approximation of bivariate Markov chains by one-dimensional diffusion processes. (English). Aplikace matematiky, vol. 23 (1978), issue 4, pp. 267-279
• Isaac, Richard: The tail $\sigma$-fields of recurrent Markov processes. (English). Aplikace matematiky, vol. 22 (1977), issue 6, pp. 397-408
• Šidák, Zbyněk: Bibliography on Markov chains with a general state space. (English). Aplikace matematiky, vol. 21 (1976), issue 5, pp. 365-382
• Mandl, Petr: A connection between controlled Markov chains and martingales. (English). Kybernetika, vol. 9 (1973), issue 4, pp. (237)-241