BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Jean-Jacques Slotine

Jean-Jacques Slotine appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.OCSystems and ControlMachine Learningphysics.soc-phRoboticsmath.DSNeurons and CognitionSocial and Information NetworksBiological Physicscond-mat.dis-nncond-mat.stat-mecheess.SYmath.FANeural and Evolutionary Computingnlin.AOmath-phmath.CAmath.MPnlin.PSphysics.data-an

Catalog footprint

What is connected

33works
20topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

33 published item(s)

preprint2024arXiv

Constrained Least Action and Quantum Mechanics

The wave-particle duality and its probabilistic interpretation are at the heart of quantum mechanics. Here we show that, in some standard contexts like the double slit experiment, a deterministic interpretation can be provided. This interpretation arises from the fact that if one mininizes a deterministic action {\it subject to spatial inequality contraints}, in general the solution is not unique. Thus, the probabilistic setting is replaced in part by the non-uniqueness of solutions of certain constrained optimization problems, itself often a result of the non-Lipschitzness of the constrained dynamics. While the approach leaves the results of associated Feynman integrals unchanged, it may considerably simplify their computation as the problems grow more complex, since only specific deterministic paths computed from the constrained minimization need to be included in the integral.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Avoiding Dense and Dynamic Obstacles in Enclosed Spaces: Application to Moving in Crowds

This paper presents a closed-form approach to constrain a flow within a given volume and around objects. The flow is guaranteed to converge and to stop at a single fixed point. We show that the obstacle avoidance problem can be inverted to enforce that the flow remains enclosed within a volume defined by a polygonal surface. We formally guarantee that such a flow will never contact the boundaries of the enclosing volume and obstacles, and will asymptotically converge towards an attractor. We further create smooth motion fields around obstacles with edges (e.g. tables). Both obstacles and enclosures may be time-varying, i.e. moving, expanding and shrinking. The technique enables a robot to navigate within an enclosed corridor while avoiding static and moving obstacles. It was applied on an autonomous robot (QOLO) in a static complex indoor environment, and also tested in simulations with dense crowds. The final proof of concept was performed in an outdoor environment in Lausanne. The QOLO-robot successfully traversed a marketplace in the center of town in presence of a diverse crowd with a non-uniform motion pattern.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Contracting differential equations in weighted Banach spaces

Geodesic contraction in vector-valued differential equations is readily verified by linearized operators which are uniformly negative-definite in the Riemannian metric. In the infinite-dimensional setting, however, such analysis is generally restricted to norm-contracting systems. We develop a generalization of geodesic contraction rates to Banach spaces using a smoothly-weighted semi-inner product structure on tangent spaces. We show that negative contraction rates in bijectively weighted spaces imply asymptotic norm-contraction, and apply recent results on asymptotic contractions in Banach spaces to establish the existence of fixed points. We show that contraction in surjectively weighted spaces verify non-equilibrium asymptotic properties, such as convergence to finite- and infinite-dimensional subspaces, submanifolds, limit cycles, and phase-locking phenomena. We use contraction rates in weighted Sobolev spaces to establish existence and continuous data dependence in nonlinear PDEs, and pose a method for constructing weak solutions using vanishing one-sided Lipschitz approximations. We discuss applications to control and order reduction of PDEs.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Contracting dynamical systems in Banach spaces

Contraction rates of time-varying maps induced by dynamical systems illuminate a wide range of asymptotic properties with applications in stability analysis and control theory. In finite-dimensional smoothly varying inner-product spaces such as $\mathbb{R}^n$ and $\mathbb{C}^n$ with Riemannian metrics, contraction rates can be estimated by upper-bounding the real numerical range of the vector field's Jacobian. However, vector spaces with norms other than $L^2$ commonly arise in the stability analysis of infinite-dimensional systems such as those arising from partial differential equations and continuum mechanics. To this end, we present a unified approach to contraction analysis in Banach spaces using the theory of weighted semi-inner products. We generalize contraction in a geodesic distance to asymptotic stability of perturbations in smoothly varying semi-inner products, and show that the latter is a dynamical invariant similar to the coordinate-invariance of Lyapunov exponents. We show that contraction in particular weighted spaces verifies asymptotic convergence to subspaces and submanifolds, present applications to limit-cycle analysis and phase-locking phenomena, and pose general conditions for inheritance of contraction properties within coupled systems. We discuss contraction rates in Sobolev spaces for retention of regularity in partial differential equations, and suggest a type of weak solution defined by a vanishing contractive term. Lastly, we present an application to machine learning, using weighted semi-inner products to derive stability conditions for functional gradient descent in a Banach space.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Control-oriented meta-learning

Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments. Adaptive control laws can endow even nonlinear systems with good trajectory tracking performance, provided that any uncertain dynamics terms are linearly parameterizable with known nonlinear features. However, it is often difficult to specify such features a priori, such as for aerodynamic disturbances on rotorcraft or interaction forces between a manipulator arm and various objects. In this paper, we turn to data-driven modeling with neural networks to learn, offline from past data, an adaptive controller with an internal parametric model of these nonlinear features. Our key insight is that we can better prepare the controller for deployment with control-oriented meta-learning of features in closed-loop simulation, rather than regression-oriented meta-learning of features to fit input-output data. Specifically, we meta-learn the adaptive controller with closed-loop tracking simulation as the base-learner and the average tracking error as the meta-objective. With both fully-actuated and underactuated nonlinear planar rotorcraft subject to wind, we demonstrate that our adaptive controller outperforms other controllers trained with regression-oriented meta-learning when deployed in closed-loop for trajectory tracking control.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Fast Obstacle Avoidance Based on Real-Time Sensing

Humans are remarkable at navigating and moving through dynamic and complex spaces, such as crowded streets. For robots to do the same, it is crucial that they are endowed with highly reactive obstacle avoidance robust to partial and poor sensing. We address the issue of enabling obstacle avoidance based on sparse and asynchronous perception. The proposed control scheme combines a high-level input command provided by either a planner or a human operator with fast reactive obstacle avoidance. The sampling-based sensor data can be combined with an analytical reconstruction of the obstacles for real-time collision avoidance. We can ensure that the agent does not get stuck when a feasible path exists between obstacles. The algorithm was evaluated experimentally on static laser data from cluttered, indoor office environments. Additionally, it was used in a shared control mode in a dynamic and complex outdoor environment in the center of Lausanne. The proposed control scheme successfully avoided collisions in both scenarios. During the experiments, the controller on the onboard computer took 1 millisecond to evaluate over 30000 data points.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Generalization in Supervised Learning Through Riemannian Contraction

We prove that Riemannian contraction in a supervised learning setting implies generalization. Specifically, we show that if an optimizer is contracting in some Riemannian metric with rate $λ> 0$, it is uniformly algorithmically stable with rate $\mathcal{O}(1/λn)$, where $n$ is the number of labelled examples in the training set. The results hold for stochastic and deterministic optimization, in both continuous and discrete-time, for convex and non-convex loss surfaces. The associated generalization bounds reduce to well-known results in the particular case of gradient descent over convex or strongly convex loss surfaces. They can be shown to be optimal in certain linear settings, such as kernel ridge regression under gradient flow.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Optimizing Trajectories with Closed-Loop Dynamic SQP

Indirect trajectory optimization methods such as Differential Dynamic Programming (DDP) have found considerable success when only planning under dynamic feasibility constraints. Meanwhile, nonlinear programming (NLP) has been the state-of-the-art approach when faced with additional constraints (e.g., control bounds, obstacle avoidance). However, a na$ï$ve implementation of NLP algorithms, e.g., shooting-based sequential quadratic programming (SQP), may suffer from slow convergence -- caused from natural instabilities of the underlying system manifesting as poor numerical stability within the optimization. Re-interpreting the DDP closed-loop rollout policy as a sensitivity-based correction to a second-order search direction, we demonstrate how to compute analogous closed-loop policies (i.e., feedback gains) for constrained problems. Our key theoretical result introduces a novel dynamic programming-based constraint-set recursion that augments the canonical "cost-to-go" backward pass. On the algorithmic front, we develop a hybrid-SQP algorithm incorporating DDP-style closed-loop rollouts, enabled via efficient parallelized computation of the feedback gains. Finally, we validate our theoretical and algorithmic contributions on a set of increasingly challenging benchmarks, demonstrating significant improvements in convergence speed over standard open-loop SQP.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Unmatched Control Barrier Functions: Certainty Equivalence Adaptive Safety

This work applies universal adaptive control to control barrier functions to achieve forward invariance of a safe set despite the presence of unmatched parametric uncertainties. The approach combines two ideas. The first is to construct a family of control barrier functions that ensures the system is safe for all possible models. The second is to use online parameter adaptation to methodically select a control barrier function and corresponding safety controller from the allowable set. While such a combination does not necessarily yield forward invariance without additional requirements on the barrier function, we show that such invariance can be established by simply adjusting the adaptation gain online. It is also shown that the developed method is applicable to systems with safety constraints that have a relative degree greater than one. This work thus represents the first adaptive safety approach that successfully employs the certainty equivalence principle for general state constraints without sacrificing safety guarantees.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

An Ode to an ODE

We present a new paradigm for Neural ODE algorithms, called ODEtoODE, where time-dependent parameters of the main flow evolve according to a matrix flow on the orthogonal group O(d). This nested system of two flows, where the parameter-flow is constrained to lie on the compact manifold, provides stability and effectiveness of training and provably solves the gradient vanishing-explosion problem which is intrinsically related to training deep neural network architectures such as Neural ODEs. Consequently, it leads to better downstream models, as we show on the example of training reinforcement learning policies with evolution strategies, and in the supervised learning setting, by comparing with previous SOTA baselines. We provide strong convergence results for our proposed mechanism that are independent of the depth of the network, supporting our empirical studies. Our results show an intriguing connection between the theory of deep neural networks and the field of matrix flows on compact manifolds.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Time Dependence in Non-Autonomous Neural ODEs

Neural Ordinary Differential Equations (ODEs) are elegant reinterpretations of deep networks where continuous time can replace the discrete notion of depth, ODE solvers perform forward propagation, and the adjoint method enables efficient, constant memory backpropagation. Neural ODEs are universal approximators only when they are non-autonomous, that is, the dynamics depends explicitly on time. We propose a novel family of Neural ODEs with time-varying weights, where time-dependence is non-parametric, and the smoothness of weight trajectories can be explicitly controlled to allow a tradeoff between expressiveness and efficiency. Using this enhanced expressiveness, we outperform previous Neural ODE variants in both speed and representational capacity, ultimately outperforming standard ResNet and CNN models on select image classification and video prediction tasks.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Analytical SLAM Without Linearization

This paper solves the classical problem of simultaneous localization and mapping (SLAM) in a fashion which avoids linearized approximations altogether. Based on creating virtual synthetic measurements, the algorithm uses a linear time- varying (LTV) Kalman observer, bypassing errors and approximations brought by the linearization process in traditional extended Kalman filtering (EKF) SLAM. Convergence rates of the algorithm are established using contraction analysis. Different combinations of sensor information can be exploited, such as bearing measurements, range measurements, optical flow, or time-to-contact. As illustrated in simulations, the proposed algorithm can solve SLAM problems in both 2D and 3D scenarios with guaranteed convergence rates in a full nonlinear context.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Manifold Learning with Contracting Observers for Data-driven Time-series Analysis

Analyzing signals arising from dynamical systems typically requires many modeling assumptions and parameter estimation. In high dimensions, this modeling is particularly difficult due to the "curse of dimensionality". In this paper, we propose a method for building an intrinsic representation of such signals in a purely data-driven manner. First, we apply a manifold learning technique, diffusion maps, to learn the intrinsic model of the latent variables of the dynamical system, solely from the measurements. Second, we use concepts and tools from control theory and build a linear contracting observer to estimate the latent variables in a sequential manner from new incoming measurements. The effectiveness of the presented framework is demonstrated by applying it to a toy problem and to a music analysis application. In these examples we show that our method reveals the intrinsic variables of the analyzed dynamical systems.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Qualitative stability of nonlinear networked systems

In many large systems, such as those encountered in biology or economics, the dynamics are nonlinear and are only known very coarsely. It is often the case, however, that the signs (excitation or inhibition) of individual interactions are known. This paper extends to nonlinear systems the classical criteria of linear sign stability introduced in the 70's, yielding simple sufficient conditions to determine stability using only the sign patterns of the interactions.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Spectrum of Controlling and Observing Complex Networks

Observing and controlling complex networks are of paramount interest for understanding complex physical, biological and technological systems. Recent studies have made important advances in identifying sensor or driver nodes, through which we can observe or control a complex system. Yet, the observational uncertainty induced by measurement noise and the energy required for control continue to be significant challenges in practical applications. Here we show that the variability of control energy and observational uncertainty for different directions of the state space depend strongly on the number of driver nodes. In particular, we find that if all nodes are directly driven, control is energetically feasible, as the maximum energy increases sublinearly with the system size. If, however, we aim to control a system through a single node, control in some directions is energetically prohibitive, increasing exponentially with the system size. For the cases in between, the maximum energy decays exponentially when the number of driver nodes increases. We validate our findings in several model and real networks, arriving to a series of fundamental laws to describe the control energy that together deepen our understanding of complex systems.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

A Quorum Sensing Inspired Algorithm for Dynamic Clustering

Quorum sensing is a decentralized biological process, through which a community of cells with no global awareness coordinate their functional behaviors based solely on cell-medium interactions and local decisions. This paper draws inspirations from quorum sensing and colony competition to derive a new algorithm for data clustering. The algorithm treats each data as a single cell, and uses knowledge of local connectivity to cluster cells into multiple colonies simultaneously. It simulates auto-inducers secretion in quorum sensing to tune the influence radius for each cell. At the same time, sparsely distributed core cells spread their influences to form colonies, and interactions between colonies eventually determine each cell's identity. The algorithm has the flexibility to analyze not only static but also time-varying data, which surpasses the capacity of many existing algorithms. Its stability and convergence properties are established. The algorithm is tested on several applications, including both synthetic and real benchmarks data sets, alleles clustering, community detection, image segmentation. In particular, the algorithm's distinctive capability to deal with time-varying data allows us to experiment it on novel applications such as robotic swarms grouping and switching model identification. We believe that the algorithm's promising performance would stimulate many more exciting applications.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Emergence of bimodality in controlling complex networks

Our ability to control complex systems is a fundamental challenge of contemporary science. Recently introduced tools to identify the driver nodes, nodes through which we can achieve full control, predict the existence of multiple control configurations, prompting us to classify each node in a network based on their role in control. Accordingly a node is critical, intermittent or redundant if it acts as a driver node in all, some or none of the control configurations. Here we develop an analytical framework to identify the category of each node, leading to the discovery of two distinct control modes in complex systems: centralized vs distributed control. We predict the control mode for an arbitrary network and show that one can alter it through small structural perturbations. The uncovered bimodality has implications from network security to organizational research and offers new insights into the dynamics and control of complex systems.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Individual dynamics induces symmetry in network controllability

Controlling complex networked systems to a desired state is a key research goal in contemporary science. Despite recent advances in studying the impact of network topology on controllability, a comprehensive understanding of the synergistic effect of network topology and individual dynamics on controllability is still lacking. Here we offer a theoretical study with particular interest in the diversity of dynamic units characterized by different types of individual dynamics. Interestingly, we find a global symmetry accounting for the invariance of controllability with respect to exchanging the densities of any two different types of dynamic units, irrespective of the network topology. The highest controllability arises at the global symmetry point, at which different types of dynamic units are of the same density. The lowest controllability occurs when all self-loops are either completely absent or present with identical weights. These findings further improve our understanding of network controllability and have implications for devising the optimal control of complex networked systems in a wide range of fields.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Network motifs emerge from interconnections that favor stability

Network motifs are overrepresented interconnection patterns found in real-world networks. What functional advantages may they offer for building complex systems? We show that most network motifs emerge from interconnections patterns that best exploit the intrinsic stability characteristics of individual nodes. This feature is observed at different scales in a network, from nodes to modules, suggesting an efficient mechanism to stably build complex systems.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Contraction analysis of nonlinear random dynamical systems

In order to bring contraction analysis into the very fruitful and topical fields of stochastic and Bayesian systems, we extend here the theory describes in \cite{Lohmiller98} to random differential equations. We propose new definitions of contraction (almost sure contraction and contraction in mean square) which allow to master the evolution of a stochastic system in two manners. The first one guarantees eventual exponential convergence of the system for almost all draws, whereas the other guarantees the exponential convergence in $L_2$ of to a unique trajectory. We then illustrate the relative simplicity of this extension by analyzing usual deterministic properties in the presence of noise. Specifically, we analyze stochastic gradient descent, impact of noise on oscillators synchronization and extensions of combination properties of contracting systems to the stochastic case. This is a first step towards combining the interesting and simplifying properties of contracting systems with the probabilistic approach.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Effect of correlations on network controllability

A dynamical system is controllable if by imposing appropriate external signals on a subset of its nodes, it can be driven from any initial state to any desired state in finite time. Here we study the impact of various network characteristics on the minimal number of driver nodes required to control a network. We find that clustering and modularity have no discernible impact, but the symmetries of the underlying matching problem can produce linear, quadratic or no dependence on degree correlation coefficients, depending on the nature of the underlying correlations. The results are supported by numerical simulations and help narrow the observed gap between the predicted and the observed number of driver nodes in real networks.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Large Gain Stability of Extremum Seeking and Higher-Order Averaging Theory

Convergence of Extremum Seeking (ES) algorithms has been established in the limit of small gains. Using averaging theory and contraction analysis, we propose a framework for computing explicit bounds on the departure of the ES scheme from its ideal dominant-order average dynamics. The bounds remain valid for possibly large gains. They allow us to establish stability and estimate convergence rates, and they open the way to selecting "optimal" finite gains for the ES scheme.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Nonlinear Observer Design and Synchronization Analysis for Classical Models of Neural Oscillators

This work explores four nonlinear classical models of neural oscillators, the Hodgkin-Huxley model, the Fitzhugh-Nagumo model, the Morris-Lecar model, and the Hindmarsh-Rose model. Nonlinear contraction theory is used to develop observers and perform synchronization analysis on these systems. Neural oscillation and signaling models are based on the biological function of the neuron, with behavior mediated through the channeling of ions across the cell membrane. The variable assumed to be measured is the membrane potential, which may be obtained empirically through the use of a neuronal force-clamp system, or may be transmitted through the axon to other neurons. All other variables are estimated by using partial state or full state observers. Basic observer rate convergence analysis is performed for the Fitzhugh Nagumo system, partial state observer design is performed for the Morris-Lecar system, and basic synchronization analysis is performed for both the Fitzhugh-Nagumo and the Hodgkin-Huxley systems.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Stochastic Contraction in Riemannian Metrics

Stochastic contraction analysis is a recently developed tool for studying the global stability properties of nonlinear stochastic systems, based on a differential analysis of convergence in an appropriate metric. To date, stochastic contraction results and sharp associated performance bounds have been established only in the specialized context of state-independent metrics, which restricts their applicability. This paper extends stochastic contraction analysis to the case of general time- and state-dependent Riemannian metrics, in both discrete-time and continuous-time settings, thus extending its applicability to a significantly wider range of nonlinear stochastic dynamics.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Synchronization and Noise: A Mechanism for Regularization in Neural Systems

To learn and reason in the presence of uncertainty, the brain must be capable of imposing some form of regularization. Here we suggest, through theoretical and computational arguments, that the combination of noise with synchronization provides a plausible mechanism for regularization in the nervous system. The functional role of regularization is considered in a general context in which coupled computational systems receive inputs corrupted by correlated noise. Noise on the inputs is shown to impose regularization, and when synchronization upstream induces time-varying correlations across noise variables, the degree of regularization can be calibrated over time. The proposed mechanism is explored first in the context of a simple associative learning problem, and then in the context of a hierarchical sensory coding task. The resulting qualitative behavior coincides with experimental data from visual cortex.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Synchronization and quorum sensing in a swarm of humanoid robots

With the advent of inexpensive simple humanoid robots, new classes of robotic questions can be considered experimentally. One of these is collective behavior of groups of humanoid robots, and in particular robot synchronization and swarming. The goal of this work is to robustly synchronize a group of humanoid robots, and to demonstrate the approach experimentally on a choreography of 8 robots. We aim to be robust to network latencies, and to allow robots to join or leave the group at any time (for example a fallen robot should be able to stand up to rejoin the choreography). Contraction theory is used to allow each robot in the group to synchronize to a common virtual oscillator, and quorum sensing strategies are exploited to fit within the available bandwidth. The humanoids used are Nao's, developed by Aldebaran Robotics.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

A contraction theory-based analysis of the stability of the Extended Kalman Filter

The contraction properties of the Extended Kalman Filter, viewed as a deterministic observer for nonlinear systems, are analyzed. This yields new conditions under which exponential convergence of the state error can be guaranteed. As contraction analysis studies the evolution of an infinitesimal discrepancy between neighboring trajectories, and thus stems from a differential framework, the sufficient convergence conditions are different from the ones that previously appeared in the literature, which were derived in a Lyapunov framework. This article sheds another light on the theoretical properties of this popular observer.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Control centrality and hierarchical structure in complex networks

We introduce the concept of control centrality to quantify the ability of a single node to control a directed weighted network. We calculate the distribution of control centrality for several real networks and find that it is mainly determined by the network's degree distribution. We rigorously prove that in a directed network without loops the control centrality of a node is uniquely determined by its layer index or topological position in the underlying hierarchical structure of the network. Inspired by the deep relation between control centrality and hierarchical structure in a general directed network, we design an efficient attack strategy against the controllability of malicious networks.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Multiclass Learning with Simplex Coding

In this paper we discuss a novel framework for multiclass learning, defined by a suitable coding/decoding strategy, namely the simplex coding, that allows to generalize to multiple classes a relaxation approach commonly used in binary classification. In this framework, a relaxation error analysis can be developed avoiding constraints on the considered hypotheses class. Moreover, we show that in this setting it is possible to derive the first provably consistent regularized method with training/tuning complexity which is independent to the number of classes. Tools from convex analysis are introduced that can be used beyond the scope of this paper.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Collective stability of networks of winner-take-all circuits

The neocortex has a remarkably uniform neuronal organization, suggesting that common principles of processing are employed throughout its extent. In particular, the patterns of connectivity observed in the superficial layers of the visual cortex are consistent with the recurrent excitation and inhibitory feedback required for cooperative-competitive circuits such as the soft winner-take-all (WTA). WTA circuits offer interesting computational properties such as selective amplification, signal restoration, and decision making. But, these properties depend on the signal gain derived from positive feedback, and so there is a critical trade-off between providing feedback strong enough to support the sophisticated computations, while maintaining overall circuit stability. We consider the question of how to reason about stability in very large distributed networks of such circuits. We approach this problem by approximating the regular cortical architecture as many interconnected cooperative-competitive modules. We demonstrate that by properly understanding the behavior of this small computational module, one can reason over the stability and convergence of very large networks composed of these modules. We obtain parameter ranges in which the WTA circuit operates in a high-gain regime, is stable, and can be aggregated arbitrarily to form large stable networks. We use nonlinear Contraction Theory to establish conditions for stability in the fully nonlinear case, and verify these solutions using numerical simulations. The derived bounds allow modes of operation in which the WTA network is multi-stable and exhibits state-dependent persistent activities. Our approach is sufficiently general to reason systematically about the stability of any network, biological or technological, composed of networks of small modules that express competition through shared inhibition.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Synchronization and Redundancy: Implications for Robustness of Neural Learning and Decision Making

Learning and decision making in the brain are key processes critical to survival, and yet are processes implemented by non-ideal biological building blocks which can impose significant error. We explore quantitatively how the brain might cope with this inherent source of error by taking advantage of two ubiquitous mechanisms, redundancy and synchronization. In particular we consider a neural process whose goal is to learn a decision function by implementing a nonlinear gradient dynamics. The dynamics, however, are assumed to be corrupted by perturbations modeling the error which might be incurred due to limitations of the biology, intrinsic neuronal noise, and imperfect measurements. We show that error, and the associated uncertainty surrounding a learned solution, can be controlled in large part by trading off synchronization strength among multiple redundant neural systems against the noise amplitude. The impact of the coupling between such redundant systems is quantified by the spectrum of the network Laplacian, and we discuss the role of network topology in synchronization and in reducing the effect of noise. A range of situations in which the mechanisms we model arise in brain science are discussed, and we draw attention to experimental evidence suggesting that cortical circuits capable of implementing the computations of interest here can be found on several scales. Finally, simulations comparing theoretical bounds to the relevant empirical quantities show that the theoretical estimates we derive can be tight.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Generalized cyclic algorithms for formation acquisition and control

This paper presents a new approach to distributed nonlinear control for formation acquisition and maintenance, inspired by recent results on cyclic topologies and based on tools from contraction theory. First, simple nonlinear control laws are derived to achieve global exponential convergence to basic symmetric formations. Next, convergence to more complex structures is obtained using control laws based on the idea of convergence primitives, linear combinations of basic control elements. All control laws use only local information and communication to achieve a desired global behavior.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

On Synchronization of Coupled Hopf-Kuramoto Oscillators with Phase Delays

This paper presents new methods and results on almost global synchronization of coupled Hopf nonlinear oscillators, which are commonly used as the dynamic model of engineered central pattern generators (CPGs). On balanced graphs, any positive coupling gain is proven to induce almost global asymptotic synchronization, and a threshold value for truly global exponential synchronization is also computed. Furthermore, a hierarchical connection between coupled Hopf oscillators and Kuramoto oscillators is identified. Finally, a new result on the synchronization of Kuramoto oscillators with arbitrary time-varying heterogeneous frequencies and delays is derived.

0 citations0 reviewsNo code linkedOpen access