Source author record

Juan-Pablo Ortega

Juan-Pablo Ortega appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

math.SG Neural and Evolutionary Computing q-fin.PR math.DS math.PR math.ST q-fin.CP q-fin.RM Statistics Theory eess.SY Emerging Technologies Machine Learning Methodology q-fin.ST Systems and Control

Catalog footprint

What is connected

13works

15topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2021arXiv

Approximation Bounds for Random Neural Networks and Reservoir Systems

This work studies approximation based on single-hidden-layer feedforward and recurrent neural networks with randomly generated internal weights. These methods, in which only the last layer of weights and a few hyperparameters are optimized, have been successfully applied in a wide range of static and dynamic learning problems. Despite the popularity of this approach in empirical tasks, important theoretical questions regarding the relation between the unknown function, the weight distribution, and the approximation rate have remained open. In this work it is proved that, as long as the unknown function, functional, or dynamical system is sufficiently regular, it is possible to draw the internal weights of the random (recurrent) neural network from a generic distribution (not depending on the unknown object) and quantify the error in terms of the number of neurons and the hyperparameters. In particular, this proves that echo state networks with randomly generated weights are capable of approximating a wide class of dynamical systems arbitrarily well and thus provides the first mathematical explanation for their empirically observed success at learning dynamical systems.

preprint2016arXiv

Singular ridge regression with homoscedastic residuals: generalization error with estimated parameters

This paper characterizes the conditional distribution properties of the finite sample ridge regression estimator and uses that result to evaluate total regression and generalization errors that incorporate the inaccuracies committed at the time of parameter estimation. The paper provides explicit formulas for those errors. Unlike other classical references in this setup, our results take place in a fully singular setup that does not assume the existence of a solution for the non-regularized regression problem. In exchange, we invoke a conditional homoscedasticity hypothesis on the regularized regression residuals that is crucial in our developments.

preprint2015arXiv

Nonlinear memory capacity of parallel time-delay reservoir computers in the processing of multidimensional signals

This paper addresses the reservoir design problem in the context of delay-based reservoir computers for multidimensional input signals, parallel architectures, and real-time multitasking. First, an approximating reservoir model is presented in those frameworks that provides an explicit functional link between the reservoir parameters and architecture and its performance in the execution of a specific task. Second, the inference properties of the ridge regression estimator in the multivariate context is used to assess the impact of finite sample training on the decrease of the reservoir capacity. Finally, an empirical study is conducted that shows the adequacy of the theoretical results with the empirical performances exhibited by various reservoir architectures in the execution of several nonlinear tasks with multidimensional inputs. Our results confirm the robustness properties of the parallel reservoir architecture with respect to task misspecification and parameter choice that had already been documented in the literature.

preprint2015arXiv

Quantitative evaluation of the performance of discrete-time reservoir computers in the forecasting, filtering, and reconstruction of stochastic stationary signals

This paper extends the notion of information processing capacity for non-independent input signals in the context of reservoir computing (RC). The presence of input autocorrelation makes worthwhile the treatment of forecasting and filtering problems for which we explicitly compute this generalized capacity as a function of the reservoir parameter values using a streamlined model. The reservoir model leading to these developments is used to show that, whenever that approximation is valid, this computational paradigm satisfies the so called separation and fading memory properties that are usually associated with good information processing performances. We show that several standard memory, forecasting, and filtering problems that appear in the parametric stochastic time series context can be readily formulated and tackled via RC which, as we show, significantly outperforms standard techniques in some instances.

preprint2014arXiv

Optimal nonlinear information processing capacity in delay-based reservoir computers

Reservoir computing is a recently introduced brain-inspired machine learning paradigm capable of excellent performances in the processing of empirical data. We focus in a particular kind of time-delay based reservoir computers that have been physically implemented using optical and electronic systems and have shown unprecedented data processing rates. Reservoir computing is well-known for the ease of the associated training scheme but also for the problematic sensitivity of its performance to architecture parameters. This article addresses the reservoir design problem, which remains the biggest challenge in the applicability of this information processing scheme. More specifically, we use the information available regarding the optimal reservoir working regimes to construct a functional link between the reservoir parameters and its performance. This function is used to explore various properties of the device and to choose the optimal reservoir architecture, thus replacing the tedious and time consuming parameter scannings used so far in the literature.

preprint2013arXiv

Quadratic hedging schemes for non-Gaussian GARCH models

We propose different schemes for option hedging when asset returns are modeled using a general class of GARCH models. More specifically, we implement local risk minimization and a minimum variance hedge approximation based on an extended Girsanov principle that generalizes Duan's (1995) delta hedge. Since the minimal martingale measure fails to produce a probability measure in this setting, we construct local risk minimization hedging strategies with respect to a pricing kernel. These approaches are investigated in the context of non-Gaussian driven models. Furthermore, we analyze these methods for non-Gaussian GARCH diffusion limit processes and link them to the corresponding discrete time counterparts. A detailed numerical analysis based on S&P 500 European Call options is provided to assess the empirical performance of the proposed schemes. We also test the sensitivity of the hedging strategies with respect to the risk neutral measure used by recomputing some of our results with an exponential affine pricing kernel.

preprint2013arXiv

Stability of Hamiltonian relative equilibria in symmetric magnetically confined rigid bodies

This work studies the symmetries, the associated momentum map, and relative equilibria of a mechanical system consisting of a small axisymmetric magnetic body-dipole in an also axisymmetric external magnetic field that additionally exhibits a mirror symmetry; we call this system the ``orbitron". We study the nonlinear stability of a branch of equatorial quasiorbital relative equilibria using the energy-momentum method and we provide sufficient conditions for their $\mathbb{T}^2$--stability that complete partial stability relations already existing in the literature. These stability prescriptions are explicitly written down in terms of the some of the field parameters, which can be used in the design of stable solutions. We propose new linear methods to determine instability regions in the context of relative equilibria that we use to conclude the sharpness of some of the nonlinear stability conditions obtained.

preprint2012arXiv

Finite sample forecasting with estimated temporally aggregated linear processes

We propose a finite sample based predictor for estimated linear one dimensional time series models and compute the associated total forecasting error. The expression for the error that we present takes into account the estimation error. Unlike existing solutions in the literature, our formulas require neither assumptions on the second order stationarity of the sample nor Monte Carlo simulations for their evaluation. This result is used to prove the pertinence of a new hybrid scheme that we put forward for the forecast of linear temporal aggregates. This novel strategy consists of carrying out the parameter estimation based on disaggregated data and the prediction based on the corresponding aggregated model and data. We show that in some instances this scheme has a better performance than the "all-disaggregated" approach presented as optimal in the literature.

preprint2011arXiv

Hedging of time discrete auto-regressive stochastic volatility options

Numerous empirical proofs indicate the adequacy of the time discrete auto-regressive stochastic volatility models introduced by Taylor in the description of the log-returns of financial assets. The pricing and hedging of contingent products that use these models for their underlying assets is a non-trivial exercise due to the incomplete nature of the corresponding market. In this paper we apply two volatility estimation techniques available in the literature for these models, namely Kalman filtering and the hierarchical-likelihood approach, in order to implement various pricing and dynamical hedging strategies. Our study shows that the local risk minimization scheme developed by Föllmer, Schweizer, and Sondermann is particularly appropriate in this setup, especially for at and in the money options or for low hedging frequencies.

preprint2011arXiv

Multivariate GARCH estimation via a Bregman-proximal trust-region method

The estimation of multivariate GARCH time series models is a difficult task mainly due to the significant overparameterization exhibited by the problem and usually referred to as the "curse of dimensionality". For example, in the case of the VEC family, the number of parameters involved in the model grows as a polynomial of order four on the dimensionality of the problem. Moreover, these parameters are subjected to convoluted nonlinear constraints necessary to ensure, for instance, the existence of stationary solutions and the positive semidefinite character of the conditional covariance matrices used in the model design. So far, this problem has been addressed in the literature only in low dimensional cases with strong parsimony constraints. In this paper we propose a general formulation of the estimation problem in any dimension and develop a Bregman-proximal trust-region method for its solution. The Bregman-proximal approach allows us to handle the constraints in a very efficient and natural way by staying in the primal space and the Trust-Region mechanism stabilizes and speeds up the scheme. Preliminary computational experiments are presented and confirm the very good performances of the proposed approach.

preprint2010arXiv

GARCH options via local risk minimization

We apply a quadratic hedging scheme developed by Foellmer, Schweizer, and Sondermann to European contingent products whose underlying asset is modeled using a GARCH process and show that local risk-minimizing strategies with respect to the physical measure do exist, even though an associated minimal martingale measure is only available in the presence of bounded innovations. More importantly, since those local risk-minimizing strategies are in general convoluted and difficult to evaluate, we introduce Girsanov-like risk-neutral measures for the log-prices that yield more tractable and useful results. Regarding this subject, we focus on GARCH time series models with Gaussian innovations and we provide specific sufficient conditions that have to do with the finiteness of the kurtosis, under which those martingale measures are appropriate in the context of quadratic hedging. When this equivalent martingale measure is adapted to the price representation we are able to recover out of it the classical pricing formulas of Duan and Heston-Nandi, as well as hedging schemes that improve the performance of those proposed in the literature.

preprint2008arXiv

Reduction, reconstruction, and skew-product decomposition of symmetric stochastic differential equations

We present reduction and reconstruction procedures for the solutions of symmetric stochastic differential equations, similar to those available for ordinary differential equations. Additionally, we use the local tangent-normal decomposition, available when the symmetry group is proper, to construct local skew-product splittings in a neighborhood of any point in the open and dense principal orbit type. The general methods introduced in the first part of the paper are then adapted to the Hamiltonian case, which is studied with special care and illustrated with several examples. The Hamiltonian category deserves a separate study since in that situation the presence of symmetries implies in most cases the existence of conservation laws, mathematically described via momentum maps, that should be taken into account in the analysis.

preprint2004arXiv

Asymptotic and Lyapunov stability of Poisson equilibria

This paper includes results centered around three topics, all of them related with the nonlinear stability of equilibria in Poisson dynamical systems. Firstly, we prove an energy-Casimir type sufficient condition for stability that uses functions that are not necessarily conserved by the flow and that takes into account certain asymptotically stable behavior that may occur in the Poisson category. This method is adapted to Poisson systems obtained via a reduction procedure and we show in examples that the kind of stability that we propose is appropriate when dealing with the stability of the equilibria of some constrained systems. Finally, we discuss two situations in which the use of continuous Casimir functions in stability studies is equivalent to the topological stability methods introduced by Patrick {\it et al.}