BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

François Dufour

François Dufour appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.PRmath.OCmath.STStatistics Theoryastro-ph.HESystems and Control

Catalog footprint

What is connected

13works
6topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

13 published item(s)

preprint2016arXiv

Optimal strategies for impulse control of piecewise deterministic Markov processes

This paper deals with the general discounted impulse control problem of a piecewise deterministic Markov process. We investigate a new family of epsilon-optimal strategies. The construction of such strategies is explicit and only necessitates the previous knowledge of the cost of the no-impulse strategy. In particular, it does not require the resolution of auxiliary optimal stopping problem or the computation of the value function at each point of the state space. This approach is based on the iteration of a single-jump-or-intervention operator associated to the piecewise deterministic Markov process.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Optimization of a launcher integration process: a Markov decision process approach

This paper is dedicated to the numerical study of the optimization of an industrial launcher integration process. It is an original case of inventory-production system where a calendar plays a crucial role. The process is modeled using the Markov Decision Processes (MDPs) framework. Classical optimization procedures for MDPs cannot be used because of specificities of the transition law and cost function. Two simulation-based algorithms are tuned to fit this special case. We obtain a non trivial optimal policy that can be applied in practice and significantly outperforms reference policies.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Partially observed optimal stopping problem for discrete-time Markov processes

This paper is dedicated to the investigation of a new numerical method to approximate the optimal stopping problem for a discrete-time continuous state space Markov chain under partial observations. It is based on a two-step discretization procedure based on optimal quantization. First,we discretize the state space of the unobserved variable by quantizing an underlying reference measure. Then we jointly discretize the resulting approximate filter and the observation process. We obtain a fully computable approximation of the value function with explicit error bounds for its convergence towards the true value fonction.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

A Linear Programming Formulation for Constrained Discounted Continuous Control for Piecewise Deterministic Markov Processes

This papers deals with the constrained discounted control of piecewise deterministic Markov process (PDMPs) in general Borel spaces. The control variable acts on the jump rate and transition measure, and the goal is to minimize the total expected discounted cost, composed of positive running and boundary costs, while satisfying some constraints also in this form. The basic idea is, by using the special features of the PDMPs, to re-write the problem via an embedded discrete-time Markov chain associated to the PDMP and re-formulate the problem as an infinite dimensional linear programming (LP) problem, via the occupation measures associated to the discrete-time process. It is important to stress however that our new discrete-time problem is not in the same framework of a general constrained discrete-time Markov Decision Process and, due to that, some conditions are required to get the equivalence between the continuous-time problem and the LP formulation. We provide in the sequel sufficient conditions for the solvability of the associated LP problem, based on a generalization of Theorem 4.1 in [8]. In the Appendix we present the proof of this generalization which, we believe, is of interest on its own. The paper is concluded with some examples to illustrate the obtained results.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Limits on the Number of Galactic Young Supernova Remnants Emitting in the Decay Lines of 44Ti

We revise the assumptions of the parameters involved in predicting the number of supernova remnants detectable in the nuclear lines of the decay chain of 44Ti. Specifically, we consider the distribution of the supernova progenitors, the supernova rate in the Galaxy, the ratios of supernova types, the Galactic production of 44Ti, and the 44Ti yield from supernovae of different types, to derive credible bounds on the expected number of detectable remnants. We find that, within 1 sigma uncertainty, the Galaxy should contain an average of 5.1+2.4-2.0 remnants detectable to a survey with a 44Ti decay line flux limit of 10E-5 photons/cm2/s, with a probability of detecting a single remnant of (2.7+10.0-2.4)%, and an expected number of detections between 2 and 9 remnants, making the single detection of Cas A unlikely but consistent with our models. Our results show that the probability of detecting the brightest 44Ti flux source at the high absolute Galactic longitude of Cas A or above is ~10%. Using the detected flux of Cas A, we attempt to constrain the Galactic supernova rate and Galactic production of 44Ti, but find the detection to be only weakly informative. We conclude that even future surveys having 200 times more sensitivity than state-of-the art surveys can be guaranteed to detect only a few new remnants, with an expected number of detections between 8 and 21 at a limiting 44Ti decay flux of 10E-7 photons/cm2/s.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Optimal stopping for partially observed piecewise-deterministic Markov processes

This paper deals with the optimal stopping problem under partial observation for piecewise-deterministic Markov processes. We first obtain a recursive formulation of the optimal filter process and derive the dynamic programming equation of the partially observed optimal stopping problem. Then, we propose a numerical method, based on the quantization of the discrete-time filter process and the inter-jump times, to approximate the value function and to compute an actual $ε$-optimal stopping time. We prove the convergence of the algorithms and bound the rates of convergence.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Nonparametric estimation of the conditional distribution of the inter-jumping times for piecewise-deterministic Markov processes

This paper presents a nonparametric method for estimating the conditional density associated to the jump rate of a piecewise-deterministic Markov process. In our framework, the estimation needs only one observation of the process within a long time interval. Our method relies on a generalization of Aalen's multiplicative intensity model. We prove the uniform consistency of our estimator, under some reasonable assumptions related to the primitive characteristics of the process. A simulation example illustrates the behavior of our estimator.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Nonparametric estimation of the jump rate for non-homogeneous marked renewal processes

This paper is devoted to the nonparametric estimation of the jump rate and the cumulative rate for a general class of non-homogeneous marked renewal processes, defined on a separable metric space. In our framework, the estimation needs only one observation of the process within a long time. Our approach is based on a generalization of the multiplicative intensity model, introduced by Aalen in the seventies. We provide consistent estimators of these two functions, under some assumptions related to the ergodicity of an embedded chain and the characteristics of the process. The paper is illustrated by a numerical example.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Numerical method for expectations of piecewise-determistic Markov processes

We present a numerical method to compute expectations of functionals of a piecewise-deterministic Markov process. We discuss time dependent functionals as well as deterministic time horizon problems. Our approach is based on the quantization of an underlying discrete-time Markov chain. We obtain bounds for the rate of convergence of the algorithm. The approximation we propose is easily computable and is flexible with respect to some of the parameters defining the problem. Two examples illustrate the paper.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Numerical method for impulse control of Piecewise Deterministic Markov Processes

This paper presents a numerical method to calculate the value function for a general discounted impulse control problem for piecewise deterministic Markov processes. Our approach is based on a quantization technique for the underlying Markov chain defined by the post jump location and inter-arrival time. Convergence results are obtained and more importantly we are able to give a convergence rate of the algorithm. The paper is illustrated by a numerical example.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Numerical methods for the exit time of a piecewise-deterministic Markov process

We present a numerical method to compute the survival function and the moments of the exit time for a piecewise-deterministic Markov process (PDMP). Our approach is based on the quantization of an underlying discrete-time Markov chain related to the PDMP. The approximation we propose is easily computable and is even flexible with respect to the exit time we consider. We prove the convergence of the algorithm and obtain bounds for the rate of convergence in the case of the moments. An academic example and a model from the reliability field illustrate the paper.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Optimal stopping for the predictive maintenance of a structure subject to corrosion

We present a numerical method to compute the optimal maintenance time for a complex dynamic system applied to an example of maintenance of a metallic structure subject to corrosion. An arbitrarily early intervention may be uselessly costly, but a late one may lead to a partial/complete failure of the system, which has to be avoided. One must therefore find a balance between these too simple maintenance policies. To achieve this aim, we model the system by a stochastic hybrid process. The maintenance problem thus corresponds to an optimal stopping problem. We propose a numerical method to solve the optimal stopping problem and optimize the maintenance time for this kind of processes.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Numerical method for optimal stopping of piecewise deterministic Markov processes

We propose a numerical method to approximate the value function for the optimal stopping problem of a piecewise deterministic Markov process (PDMP). Our approach is based on quantization of the post jump location---inter-arrival time Markov chain naturally embedded in the PDMP, and path-adapted time discretization grids. It allows us to derive bounds for the convergence rate of the algorithm and to provide a computable $ε$-optimal stopping time. The paper is illustrated by a numerical example.

0 citations0 reviewsNo code linkedOpen access