BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Alain Bensoussan

Alain Bensoussan appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.OCmath.PRmath.APphysics.class-phmath.DSq-fin.MFMachine Learningmath.NA

Catalog footprint

What is connected

16works
8topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

16 published item(s)

preprint2026arXiv

A Class of Degenerate Mean Field Games, Associated FBSDEs and Master Equations

In this paper, we study a class of degenerate mean field games (MFGs) with state-distribution dependent and unbounded functional diffusion coefficients. With a probabilistic method, we study the well-posedness of the forward-backward stochastic differential equations (FBSDEs) associated with the MFG and arising from the maximum principle, and estimate the corresponding Jacobian and Hessian flows. We further establish the classical regularity of the value functional $V$; in particular, we show that when the cost function is $C^3$ in the spatial and control variables and $C^2$ in the distribution argument, then the value functional is $C^1$ in time and $C^2$ in the spatial and distribution variables. As a consequence, the value functional $V$ is the unique classical solution of the degenerate MFG master equation.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Identification of linear dynamical systems and machine learning

The topic of identification of dynamic systems, has been at the core of modern control , following the fundamental works of Kalman. Realization Theory has been one of the major outcomes in this domain, with the possibility of identifying a dynamic system from an input-output relationship. The recent development of machine learning concepts has rejuvanated interest for identification. In this paper, we review briefly the results of realization theory, and develop some methods inspired by Machine Learning concepts.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Machine Learning and Control Theory

We survey in this article the connections between Machine Learning and Control Theory. Control Theory provide useful concepts and tools for Machine Learning. Conversely Machine Learning can be used to solve large control problems. In the first part of the paper, we develop the connections between reinforcement learning and Markov Decision Processes, which are discrete time control problems. In the second part, we review the concept of supervised learning and the relation with static optimization. Deep learning which extends supervised learning, can be viewed as a control problem. In the third part, we present the links between stochastic gradient descent and mean-field theory. Conversely, in the fourth and fifth parts, we review machine learning approaches to stochastic control problems, and focus on the deterministic case, to explain, more easily, the numerical algorithms.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Optimal periodic replenishment policies for spectrally positive Lévy demand processes

We consider a version of the stochastic inventory control problem for a spectrally positive Lévy demand process, in which the inventory can only be replenished at independent exponential times. We show the optimality of a periodic barrier replenishment policy that restocks any shortage below a certain threshold at each replenishment opportunity. The optimal policies and value functions are concisely written in terms of the scale functions. Numerical results are also provided.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Control Problem on Space of Random Variables and Master Equation

We study in this paper a control problem in a space of random variables. We show that its Hamilton Jacobi Bellman equation is related to the Master equation in Mean field theory. P.L. Lions in [14,15] introduced the Hilbert space of square integrable random variables as a natural space for writing the Master equation which appears in the mean field theory. W. Gangbo and A. Święch [10] considered this type of equation in the space of probability measures equipped with the Wasserstein metric and use the concept of Wasserstein gradient. We compare the two approaches and provide some extension of the results of Gangbo and Święch.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Existence and uniqueness of solutions for Bertrand and Cournot mean field games

We study a system of partial differential equations used to describe Bertrand and Cournot competition among a continuum of producers of an exhaustible resource. By deriving new a priori estimates, we prove the existence of classical solutions under general assumptions on the data. Moreover, under an additional hypothesis we prove uniqueness. Keywords: mean field games, Hamilton-Jacobi, Fokker-Planck, coupled systems, optimal control, nonlinear partial differential equations

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Mean-field-game model for Botnet defense in Cyber-security

We initiate the analysis of the response of computer owners to various offers of defence systems against a cyber-hacker (for instance, a botnet attack), as a stochastic game of a large number of interacting agents. We introduce a simple mean-field game that models their behavior. It takes into account both the random process of the propagation of the infection (controlled by the botner herder) and the decision making process of customers. Its stationary version turns out to be exactly solvable (but not at all trivial) under an additional natural assumption that the execution time of the decisions of the customers (say, switch on or out the defence system) is much faster that the infection rates.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

On The Interpretation Of The Master Equation

Since its introduction by P.L. Lions in his lectures and seminars at the College de France, see [9], and also the very helpful notes of Cardialaguet [4] on Lions' lectures, the Master Equation has attracted a lot of interest, and various points of view have been expressed, see for example Carmona-Delarue [5], Bensoussan-Frehse-Yam [2], Buckdahn-Li-Peng-Rainer [3]. There are several ways to introduce this type of equation; and in those mentioned works, they involve an argument which is a probability measure, while P.L. Lions has recently proposed the idea of working with the Hilbert space of square integrable random variables. Hence writing the equation is an issue; while another issue is its origin. In this article, we discuss all these various aspects, and our modeling argument relies heavily on a seminar at College de France delivered by P.L. Lions on November 14, 2014.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Linear-Quadratic Mean Field Games

In this article, we provide a comprehensive study of the linear-quadratic mean field games via the adjoint equation approach; although the problem has been considered in the literature by Huang, Caines and Malhame (HCM, 2007a), their method is based on Dynamic Programming. It turns out that two methods are not equivalent, as far as giving sufficient condition for the existence of a solution is concerned. Due to the linearity of the adjoint equations, the optimal mean field term satisfies a linear forward-backward ordinary differential equation. For the one dimensional case, we show that the equilibrium strategy always exists uniquely. For dimension greater than one, by choosing a suitable norm and then applying the Banach Fixed Point Theorem, a sufficient condition, which is independent of the solution of the standard Riccati differential equation, for the unique existence of the equilibrium strategy is provided. As a by-product, we also establish a neat and instructive sufficient condition for the unique existence of the solution for a class of non-trivial nonsymmetric Riccati equations. Numerical examples of non-existence of the equilibrium strategy and the comparison of HCM's approach will also be provided.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Mean Field Games with a Dominating Player

In this article, we consider mean field games between a dominating player and a group of representative agents, each of which acts similarly and also interacts with each other through a mean field term being substantially influenced by the dominating player. We first provide the general theory and discuss the necessary condition for the optimal controls and game condition by adopting adjoint equation approach. We then present a special case in the context of linear-quadratic framework, in which a necessary and sufficient condition can be asserted by stochastic maximum principle; we finally establish the sufficient condition that guarantees the unique existence of the equilibrium control. The proof of the convergence result of finite player game to mean field counterpart is provided in Appendix.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

The Master Equation in Mean Field Theory

In his lectures at College de France, P.L. Lions introduced the concept of Master equation, see [5] for Mean Field Games. It is introduced in a heuristic fashion, from the system of partial differential equations, associated to a Nash equilibrium for a large, but finite, number of players. The method, also explained in[2], consists in a formal analogy of terms. The interest of this equation is that it contains interesting particular cases, which can be studied directly, in particular the system of HJB-FP (Hamilton-Jacobi-Bellman, Fokker-Planck) equations obtained as the limit of the finite Nash equilibrium game, when the trajectories are independent, see [4]. Usually, in mean field theory, one can bypass the large Nash equilibrium, by introducing the concept of representative agent, whose action is influenced by a distribution of similar agents, and obtains directly the system of HJB-FP equations of interest, see for instance [1]. Apparently, there is no such approach for the Master equation. We show here that it is possible. We first do it for the Mean Field type control problem, for which we interpret completely the Master equation. For the Mean Field Games itself, we solve a related problem, and obtain again the Master equation.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

The Maximum Principle for Global Solutions of Stochastic Stackelberg Differential Games

This paper obtains the maximum principle for both stochastic (global) open-loop and stochastic (global) closed-loop Stackelberg differential games. For the closed-loop case, we use the theory of controlled forward-backward stochastic differential equations to derive the maximum principle for the leader's optimal strategy. In the special case of the open-loop linear quadratic Stackelberg game, we consider the follower's Hamiltonian system as the leader's state equation, derive the related stochastic Riccati equation, and show the existence and uniqueness of the solution to the Riccati equation under appropriate assumptions. However, for the closed-loop linear quadratic Stackelberg game, we can write the related Riccati equation consisting of forward-backward stochastic differential equations, while leaving the existence of its solution as an open problem.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

An analytic approach to the ergodic theory of stochastic variational inequalities

In an earlier work made by the first author with J. Turi (Degenerate Dirichlet Problems Related to the Invariant Measure of Elasto-Plastic Oscillators, AMO, 2008), the solution of a stochastic variational inequality modeling an elasto-perfectly-plastic oscillator has been studied. The existence and uniqueness of an invariant measure have been proven. Nonlocal problems have been introduced in this context. In this work, we present a new characterization of the invariant measure. The key finding is the connection between nonlocal PDEs and local PDEs which can be interpreted with short cycles of the Markov process solution of the stochastic variational inequality.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Asymptotic Analysis of Stochastic Variational Inequalities Modeling an Elasto-Plastic Problem with Vanishing Jumps

In a previous work by the first author with J. Turi (AMO, 08), a stochastic variational inequality has been introduced to model an elasto-plastic oscillator with noise. A major advantage of the stochastic variational inequality is to overcome the need to describe the trajectory by phases (elastic or plastic). This is useful, since the sequence of phases cannot be characterized easily. In particular, there are numerous small elastic phases which may appear as an artefact of the Wiener process. However, it remains important to have informations on these phases. In order to reconcile these contradictory issues, we introduce an approximation of stochastic variational inequalities by imposing artificial small jumps between phases allowing a clear separation of the phases. In this work, we prove that the approximate solution converges on any finite time interval, when the size of jumps tends to 0.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Behavior of the plastic deformation of an elasto-perfectly-plastic oscillator with noise

Earlier works in engineering, partly experimental, partly computational have revealed that asymptotically, when the excitation is a white noise, plastic deformation and total deformation for an elasto-perfectly-plastic oscillator have a variance which increases linearly with time with the same coefficient. In this work, we prove this result and we characterize the corresponding drift coefficient. Our study relies on a stochastic variational inequality governing the evolution between the velocity of the oscillator and the non-linear restoring force. We then define long cycles behavior of the Markov process solution of the stochastic variational inequality which is the key concept to obtain the result. An important question in engineering is to compute this coefficient. Also, we provide numerical simulations which show successful agreement with our theoretical prediction and previous empirical studies made by engineers.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Degenerate Dirichlet Problems Related to the Ergodic Property of an Elasto-Plastic Oscillator Excited by a Filtered White Noise

A stochastic variational inequality is proposed to model an elasto-plastic oscillator excited by a filtered white noise. We prove the ergodic properties of the process and characterize the corresponding invariant measure. This extends Bensoussan-Turi's method (Degenerate Dirichlet Problems Related to the Invariant Measure of Elasto-Plastic Oscillators, AMO, 2008) with a significant additional difficulty of increasing the dimension. Two points boundary value problem in dimension 1 is replaced by elliptic equations in dimension 2. In the present context, Khasminskii's method (Stochastic Stability of Differential Equations, Sijthoff and Noordhof,1980) leads to the study of degenerate Dirichlet problems with partial differential equations and nonlocal boundary conditions.

0 citations0 reviewsNo code linkedOpen access