We study a class of discrete-time stochastic systems composed of a large number of N interacting objects, which are classified in a finite number of classes. The behavior of the objects is controlled by a central decision-maker as follows. At each stage, once the configuration of the system is observed, the controller takes a decision; then a cost is incurred and there is a positive probability the process stops, otherwise the objects move randomly among the classes according to a transition probability. That is, with positive probability, the system is absorbed by a configuration that represents the death of the system, and there it will remain without incurring cost. Due to the large number of objects, the control problem is studied according to the mean field theory. Thus, instead of analyzing a single object, we focus on the proportions of objects occupying each class, and then we study the limit as N goes to infinity.
|Number of pages||24|
|Journal||Discrete Event Dynamic Systems: Theory and Applications|
|State||Published - Sep 2021|
Bibliographical noteFunding Information:
Work partially supported by Consejo Nacional de Ciencia y Tecnología (CONACYT-México) under grant Ciencia Frontera 87787.
© 2021, The Author(s), under exclusive licence to Springer Science+Business Media, LLC part of Springer Nature.
- Control problems
- Mean field theory
- Optimal policies
- Random horizon
- Systems of interacting objects