| Title:
|
Stochastic control optimal in the Kullback sense (English) |
| Author:
|
Šindelář, Jan |
| Author:
|
Vajda, Igor |
| Author:
|
Kárný, Miroslav |
| Language:
|
English |
| Journal:
|
Kybernetika |
| ISSN:
|
0023-5954 |
| Volume:
|
44 |
| Issue:
|
1 |
| Year:
|
2008 |
| Pages:
|
53-60 |
| Summary lang:
|
English |
| . |
| Category:
|
math |
| . |
| Summary:
|
The paper solves the problem of minimization of the Kullback divergence between a partially known and a completely known probability distribution.
It considers two probability distributions of a random vector $(u_1, x_1, \ldots, u_T, x_T )$ on a sample space of $2T$ dimensions. One of the distributions is known, the other is known only partially. Namely, only the conditional probability distributions of $x_\tau$ given $u_1, x_1, \ldots, u_{\tau-1}, x_{\tau-1}, u_{\tau}$ are known for $\tau = 1, \ldots, T$. Our objective is to determine the remaining conditional probability distributions of $u_\tau$ given $u_1, x_1, \ldots, u_{\tau-1}, x_{\tau-1}$ such that the Kullback divergence of the partially known distribution with respect to the completely known distribution is minimal. Explicit solution of this problem has been found previously for Markovian systems in Karný [Karny:96a]. The general solution is given in this paper. (English) |
| Keyword:
|
Kullback divergence |
| Keyword:
|
minimization |
| Keyword:
|
stochastic controller |
| MSC:
|
49N35 |
| MSC:
|
60G35 |
| MSC:
|
90D60 |
| MSC:
|
91A60 |
| MSC:
|
93E03 |
| MSC:
|
93E20 |
| MSC:
|
94A17 |
| idZBL:
|
Zbl 1145.93053 |
| idMR:
|
MR2405055 |
| . |
| Date available:
|
2009-09-24T20:32:02Z |
| Last updated:
|
2012-06-06 |
| Stable URL:
|
http://hdl.handle.net/10338.dmlcz/135833 |
| . |
| Reference:
|
[1] Aoki M.: Optimization of Stochastic Systems: Topics in Discrete-Time Systems.Academic Press, New York – London 1967 Zbl 0168.15802, MR 0234749 |
| Reference:
|
[2] Åström K. J.: Introduction to Stochastic Control.Academic Press, New York – San Francisco – London 1970 Zbl 1191.93141 |
| Reference:
|
[3] Bertsekas D. P.: Dynamic Programming and Stochastic Control.Second edition. Athena Scientific, Belmont, Mass. 2000 Zbl 0549.93064, MR 2182753 |
| Reference:
|
[4] Clark D.: Advances in Model-Based Predictive Control.Oxford University Press, Oxford 1994 |
| Reference:
|
[5] Cover T. M., Thomas J. A.: Elements of Information Theory.Second edition. Wiley-Interscience, New York 2006 Zbl 1140.94001, MR 2239987 |
| Reference:
|
[6] Kárný M.: Towards fully probabilistic control design.Automatica 32 (1996), 12, 1719–1722 Zbl 0868.93022, MR 1427142 |
| Reference:
|
[7] Kulhavý R.: A Kullback–Leibler distance approach to system identification.In: Preprints of the IFAC Symposium on Adaptive Systems in Control and Signal Processing (C. Bányász, ed.), Budapest 1995, pp. 55–66 |
| Reference:
|
[8] Kullback S.: Information Theory and Statistics.Wiley, New York and Chapman & Hall, London 1967 Zbl 0897.62003, MR 0103557 |
| Reference:
|
[9] Kullback S., Leibler R.: On information and sufficiency.Ann. Math. Statist. 22 (1951), 79–87 Zbl 0042.38403, MR 0039968 |
| Reference:
|
[10] Kumar P. R., Varaiya P.: Stochastic Systems: Estimation, Identification and Adaptive Control.Prentice Hall, Englewood Cliffs, N. J. 1986 Zbl 0706.93057 |
| Reference:
|
[11] Kushner H.: Introduction to Stochastic Control.Holt, Rinehard and Winston, New York 1971 Zbl 0293.93018, MR 0280248 |
| Reference:
|
[12] Martin J. J.: Bayesian Decision Problems and Markov Chains.Wiley, New York 1967 Zbl 0164.50102, MR 0221709 |
| Reference:
|
[13] Meditch J. S.: Stochastic Optimal Linear Estimation and Control.Mc. Graw Hill, New York 1969 Zbl 0269.93061 |
| Reference:
|
[14] Vajda I.: Theory of Statistical Inference and Information.Mathematical and statistical methods. Kluwer Academic Publishers, Dordrecht, Boston – London 1989 Zbl 0711.62002 |
| . |
