Article
Full entry |
PDF
(0.3 MB)
Feedback
PDF
(0.3 MB)
Feedback
Keywords:
Berge's minimum theorem; moment function; discounted Markov decision process; uniqueness of the optimal policy; continuous optimal policy
Berge's minimum theorem; moment function; discounted Markov decision process; uniqueness of the optimal policy; continuous optimal policy
Summary:
References:
[1] C. D. Aliprantis, K. C. Border: Infinite Dimensional Analysis. Third Edition. Springer-Verlag, Berlin 2006. MR 2378491 | Zbl 1156.46001
[2] R. B. Ash: Real Variables with Basic Metric Space Topology. IEEE Press, New York 1993. MR 1193687 | Zbl 0920.26002
[3] J. P. Aubin, I. Ekeland: Applied Nonlinear Analysis. John Wiley, New York 1984. MR 0749753 | Zbl 1115.47049
[4] L. M. Ausubel, R. J. Deneckere: A generalized theorem of the maximum. Econom. Theory 3 (1993), 99-107. MR 1211955 | Zbl 1002.49500
[5] C. Berge: Topological Spaces. Oliver and Boyd, Edinburgh and London 1963 (reprinted by Dover Publications, Inc., Mineola, New York 1997). MR 1464690 | Zbl 0114.38602
[6] D. Cruz-Suárez, R. Montes-de-Oca, F. Salem-Silva: Conditions for the uniqueness of optimal policies of discounted Markov decision processes. Math. Methods Oper. Res. 60 (2004), 415-436. MR 2106092 | Zbl 1104.90053
[7] J. Dugundji: Topology. Allyn and Bacon, Inc., Boston 1966. MR 0193606 | Zbl 0397.54003
[8] P. K. Dutta, M. K.Majumdar, R. K. Sundaram: Parametric continuity in dynamic programming problems. J. Econom. Dynam. Control 18 (1994), 1069-1092. MR 1298092 | Zbl 0875.90096
[9] P. K. Dutta, T. Mitra: Maximum theorems for convex structures with an application to the theory of optimal intertemporal allocations. J. Math. Econom. 18 (1989), 77-86. MR 0985949
[10] O. Hernández-Lerma, J. B. Lasserre: Discrete-Time Markov Control Processes: Basic Optimality Criteria. Springer-Verlag, New York 1996. MR 1363487 | Zbl 0840.93001
[11] O. Hernández-Lerma, W. J. Runggaldier: Monotone approximations for convex stochastic control problems. J. Math. Systems Estim. Control 4 (1994), 99-140. MR 1298550 | Zbl 0812.93078
[12] K. Hinderer: Lipschitz continuity of value functions in Markovian decision Processes. Math. Methods Oper. Res. 60 (2005), 3-22. MR 2226965 | Zbl 1093.90075
[13] K. Hinderer, M. Stieglitz: Increasing and Lipschitz continuous minimizers in one-dimensional linear-convex systems without constraints: the continuous and the discrete case. Math. Methods Oper. Res. 44 (1996), 189-204. MR 1409065 | Zbl 0860.90126
[14] A. Horsley, A. J. Wrobel, T. Van Zandt: Berge's maximum theorem with two topologies on the action set. Econom. Lett. 61 (1998), 285-291. MR 1676329 | Zbl 0913.90079
[15] J. S. Jordan: The continuity of optimal dynamic decision rules. Econometrica 45 (1977), 1365-1376. MR 0456573 | Zbl 0363.90035
[16] T. Kamihigashi: Stochastic optimal growth with bounded or unbounded utility and with bounded or unbounded shocks. J. Math. Econom. 43 (2007), 477-500. MR 2317118 | Zbl 1154.91032
[17] T. Kamihigashi, S. Roy: A nonsmooth, nonconvex model of optimal growth. J. Econom. Theory 132 (2007), 435-460. MR 2285614 | Zbl 1142.91667
[18] R. B. King: Beyond Quartic Equation. Birkhauser, Boston 1996. MR 1401346
[19] M. Kitayev: Semi-Markov and jump Markov control models: average cost criterion. Theory Probab. Appl. 30 (1985), 272-288. MR 0792619
[20] D. V. Lindley: The theory of queues with a single server. Proc. Cambridge Philos. Soc. 48 (1952), 277-289. MR 0046597 | Zbl 0046.35501
[21] M. Majumdar, R. Radner: Stationary optimal policies with discounting in a stochastic activity analysis model. Econometrica 51 (1983), 1821-1837. MR 0720089
[22] S. P. Meyn: Ergodic Theorems for discrete time stochastic systems using a stochastic Lyapunov functions. SIAM J. Control Optim. 27 (1989), 1409-1439. MR 1022436
[23] E. A. Ok: Real Analysis with Economic Applications. Princeton University Press, Princeton 2007. MR 2275400 | Zbl 1119.26001
[24] A. L. Peressini, F. E. Sullivan, J. J. Uhl: The Mathematics of Nonlinear Programming. Springer-Verlag, New York 1988. MR 0932726 | Zbl 0663.90054
[25] M. L. Puterman: Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley, New York 1994. MR 1270015 | Zbl 1184.90170
[26] U. Rieder: Measurable selection theorems for optimization problems. Manuscripta Math. 24 (1978), 115-131. MR 0493590 | Zbl 0385.28005
[27] H. L. Royden: Real Analysis. Third Edition. Macmillan, New York 1988. MR 1013117 | Zbl 1191.26002
[28] R. H. Stockbridge: Time-average control of martingale problems: a linear programming formulation. Ann. Probab. 18 (1990), 291-314. MR 1043944 | Zbl 0699.49019
[29] R. Sundaram: A First Course in Optimization Theory. Cambridge University Press, Cambridge 1996. MR 1402910 | Zbl 0885.90106
[30] G. Tian, J. Zhou: The maximum theorem and the existence of Nash equilibrium of (generalized) games without lower semicontinuities. J. Math. Anal. Appl. 166 (1992), 351-364. MR 1160931 | Zbl 0761.90110
[31] G. Tian, J. Zhou: Transfer continuities, generalizations of the Weierstrass and maximum theorem: a full characterization. J. Math. Econom. 24 (1995), 281-303. MR 1320200
[32] M. Walker: A generalization of the maximum theorem. Internat. Econom. Rev. 20 (1979), 267-272. MR 0525439 | Zbl 0406.90001
[33] A. Yushkevich: Blackwell optimality in Borelian continuous-in-action Markov decision processes. SIAM J. Control Optim. 35 (1997), 2157-2182. MR 1478659 | Zbl 0892.93059
Search
Partner of
