Source author record

Mihailo R. Jovanović

Mihailo R. Jovanović appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

23works
16topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

23 published item(s)

preprint2026arXiv

Stability of Primal-Dual Gradient Flow Dynamics for Multi-Block Convex Optimization Problems

We examine stability properties of primal-dual gradient flow dynamics for composite convex optimization problems with multiple, possibly nonsmooth, terms in the objective function under the generalized consensus constraint. The proposed dynamics are based on the proximal augmented Lagrangian and they provide a viable alternative to ADMM which faces significant challenges from both analysis and implementation viewpoints in large-scale multi-block scenarios. In contrast to customized algorithms with individualized convergence guarantees, we develop a systematic approach for solving a broad class of challenging composite optimization problems. We leverage various structural properties to establish global (exponential) convergence guarantees for the proposed dynamics. Our assumptions are much weaker than those required to prove (exponential) stability of primal-dual dynamics as well as (linear) convergence of discrete-time methods such as standard two-block and multi-block ADMM and EXTRA algorithms. Finally, we show necessity of some of our structural assumptions for exponential stability and provide computational experiments to demonstrate the convenience of the proposed approach for parallel and distributed computing applications.

preprint2026arXiv

Tannenbaum's gain-margin optimization meets Polyak's heavy-ball algorithm

This paper highlights an apparent, yet relatively unknown link between algorithm design in optimization theory and controller synthesis in robust control. Specifically, quadratic optimization can be recast as a regulation problem within the framework of $\mathcal{H}_\infty$ control. From this vantage point, the optimality of Polyak's fastest heavy-ball algorithm can be ascertained as a solution to a gain margin optimization problem. The approach is independent of Polyak's original and brilliant argument, and relies on foundational work by Tannenbaum, who introduced and solved gain margin optimization via Nevanlinna--Pick interpolation theory. The link between first-order optimization methods and robust control sheds new light on the limits of algorithmic performance of such methods, and suggests a framework where similar computational tasks can be systematically studied and algorithms optimized. In particular, it raises the question as to whether periodically scheduled algorithms can achieve faster rates for quadratic optimization, in a manner analogous to periodic control that extends the gain margin beyond that of time-invariant control. This turns out not to be the case, due to the analytic obstruction of a transmission zero that is inherent in causal schemes. Interestingly, this obstruction can be removed with implicit algorithms, cast as feedback regulation problems with causal, but not strictly causal dynamics, thereby devoid of the transmission zero at infinity and able to achieve superior convergence rates.

preprint2022arXiv

Independent Policy Gradient for Large-Scale Markov Potential Games: Sharper Rates, Function Approximation, and Game-Agnostic Convergence

We examine global non-asymptotic convergence properties of policy gradient methods for multi-agent reinforcement learning (RL) problems in Markov potential games (MPG). To learn a Nash equilibrium of an MPG in which the size of state space and/or the number of players can be very large, we propose new independent policy gradient algorithms that are run by all players in tandem. When there is no uncertainty in the gradient evaluation, we show that our algorithm finds an $ε$-Nash equilibrium with $O(1/ε^2)$ iteration complexity which does not explicitly depend on the state space size. When the exact gradient is not available, we establish $O(1/ε^5)$ sample complexity bound in a potentially infinitely large state space for a sample-based algorithm that utilizes function approximation. Moreover, we identify a class of independent policy gradient algorithms that enjoys convergence for both zero-sum Markov games and Markov cooperative games with the players that are oblivious to the types of games being played. Finally, we provide computational experiments to corroborate the merits and the effectiveness of our theoretical developments.

preprint2020arXiv

A second order primal-dual method for nonsmooth convex composite optimization

We develop a second order primal-dual method for optimization problems in which the objective function is given by the sum of a strongly convex twice differentiable term and a possibly nondifferentiable convex regularizer. After introducing an auxiliary variable, we utilize the proximal operator of the nonsmooth regularizer to transform the associated augmented Lagrangian into a function that is once, but not twice, continuously differentiable. The saddle point of this function corresponds to the solution of the original optimization problem. We employ a generalization of the Hessian to define second order updates on this function and prove global exponential stability of the corresponding differential inclusion. Furthermore, we develop a globally convergent customized algorithm that utilizes the primal-dual augmented Lagrangian as a merit function. We show that the search direction can be computed efficiently and prove quadratic/superlinear asymptotic convergence. We use the $\ell_1$-regularized model predictive control problem and the problem of designing a distributed controller for a spatially-invariant system to demonstrate the merits and the effectiveness of our method.

preprint2020arXiv

Proximal gradient flow and Douglas-Rachford splitting dynamics: global exponential stability via integral quadratic constraints

Many large-scale and distributed optimization problems can be brought into a composite form in which the objective function is given by the sum of a smooth term and a nonsmooth regularizer. Such problems can be solved via a proximal gradient method and its variants, thereby generalizing gradient descent to a nonsmooth setup. In this paper, we view proximal algorithms as dynamical systems and leverage techniques from control theory to study their global properties. In particular, for problems with strongly convex objective functions, we utilize the theory of integral quadratic constraints to prove the global exponential stability of the equilibrium points of the differential equations that govern the evolution of proximal gradient and Douglas-Rachford splitting flows. In our analysis, we use the fact that these algorithms can be interpreted as variable-metric gradient methods on the suitable envelopes and exploit structural properties of the nonlinear terms that arise from the gradient of the smooth part of the objective function and the proximal operator associated with the nonsmooth regularizer. We also demonstrate that these envelopes can be obtained from the augmented Lagrangian associated with the original nonsmooth problem and establish conditions for global exponential convergence even in the absence of strong convexity.

preprint2020arXiv

Robustness of accelerated first-order algorithms for strongly convex optimization problems

We study the robustness of accelerated first-order algorithms to stochastic uncertainties in gradient evaluation. Specifically, for unconstrained, smooth, strongly convex optimization problems, we examine the mean-squared error in the optimization variable when the iterates are perturbed by additive white noise. This type of uncertainty may arise in situations where an approximation of the gradient is sought through measurements of a real system or in a distributed computation over a network. Even though the underlying dynamics of first-order algorithms for this class of problems are nonlinear, we establish upper bounds on the mean-squared deviation from the optimal solution that are tight up to constant factors. Our analysis quantifies fundamental trade-offs between noise amplification and convergence rates obtained via any acceleration scheme similar to Nesterov's or heavy-ball methods. To gain additional analytical insight, for strongly convex quadratic problems, we explicitly evaluate the steady-state variance of the optimization variable in terms of the eigenvalues of the Hessian of the objective function. We demonstrate that the entire spectrum of the Hessian, rather than just the extreme eigenvalues, influence robustness of noisy algorithms. We specialize this result to the problem of distributed averaging over undirected networks and examine the role of network size and topology on the robustness of noisy accelerated algorithms.

preprint2020arXiv

Transient growth analysis of oblique shock wave/boundary-layer interactions at Mach 5.92

We study physical mechanisms that trigger transient growth in a high-speed spatially-developing laminar boundary layer that interacts with an oblique shock wave. We utilize an approach based on power-iteration, with the global forward and adjoint linearized equations, to quantify the transient growth in compressible boundary layers with flow separation. For a Mach 5.92 boundary layer with no oblique shock wave, we show that the dominant transient response consists of oblique waves, which arise from the inviscid Orr mechanism, the lift-up effect, and the first-mode instability. We also demonstrate that the presence of the oblique shock wave significantly increases transient growth over short time intervals through a mechanism that is not related to a slowly growing global instability. The resulting response takes the form of spanwise periodic streamwise elongated streaks and our analysis of the linearized inviscid transport equations shows that base flow deceleration near the reattachment location contributes to their amplification. The large transient growth of streamwise streaks demonstrates the importance of non-modal effects in the amplification of flow perturbations and identifies a route for the emergence of similar spatial structures in transitional hypersonic flows with shock wave/boundary-layers interaction.

preprint2019arXiv

Stochastic dynamical modeling of turbulent flows

Advanced measurement techniques and high performance computing have made large data sets available for a wide range of turbulent flows that arise in engineering applications. Drawing on this abundance of data, dynamical models can be constructed to reproduce structural and statistical features of turbulent flows, opening the way to the design of effective model-based flow control strategies. This review describes a framework for completing second-order statistics of turbulent flows by models that are based on the Navier-Stokes equations linearized around the turbulent mean velocity. Systems theory and convex optimization are combined to address the inherent uncertainty in the dynamics and the statistics of the flow by seeking a suitable parsimonious correction to the prior linearized model. Specifically, dynamical couplings between states of the linearized model dictate structural constraints on the statistics of flow fluctuations. Thence, colored-in-time stochastic forcing that drives the linearized model is sought to account for and reconcile dynamics with available data (i.e., partially known second order statistics). The number of dynamical degrees of freedom that are directly affected by stochastic excitation is minimized as a measure of model parsimony. The spectral content of the resulting colored-in-time stochastic contribution can alternatively be seen to arise from a low-rank structural perturbation of the linearized dynamical generator, pointing to suitable dynamical corrections that may account for the absence of the nonlinear interactions in the linearized model.

preprint2016arXiv

On the optimal control problem for a class of monotone bilinear systems

We consider a class of monotone systems in which the control signal multiplies the state. Among other applications, such bilinear systems can be used to model the evolutionary dynamics of HIV in the presence of combination drug therapy. For this class of systems, we formulate an infinite horizon optimal control problem, prove that the optimal control signal is constant over time, and show that it can be computed by solving a finite-dimensional non-smooth convex optimization problem. We provide an explicit expression for the subdifferential set of the objective function and use a subgradient algorithm to design the optimal controller. We further extend our results to characterize the optimal robust controller for systems with uncertain dynamics and show that computing the robust controller is no harder than computing the nominal controller. We illustrate our results with an example motivated by combination drug therapy.

preprint2014arXiv

Self-sustaining turbulence in a restricted nonlinear model of plane Couette flow

This paper demonstrates the maintenance of self-sustaining turbulence in a restricted nonlinear (RNL) model of plane Couette flow. The RNL system is derived directly from the Navier Stokes equations and permits computationally tractable studies of the dynamical system obtained using stochastic structural stability theory (S3T), which is a second order approximation of the statistical state dynamics of the flow. The RNL model shares the dynamical restrictions of the S3T model but can be easily implemented through reducing a DNS code to the equations governing the RNL system. Comparisons of turbulence arising from DNS and RNL simulations demonstrate that the RNL system supports self-sustaining turbulence with a mean flow as well as structural and dynamical features that are consistent with DNS. These results demonstrate that the simplified RNL/S3T system captures fundamental aspects of fully developed turbulence in wall-bounded shear flows and motivates use of the RNL/S3T system for further study of wall turbulence.

preprint2013arXiv

Algorithms for leader selection in stochastically forced consensus networks

We are interested in assigning a pre-specified number of nodes as leaders in order to minimize the mean-square deviation from consensus in stochastically forced networks. This problem arises in several applications including control of vehicular formations and localization in sensor networks. For networks with leaders subject to noise, we show that the Boolean constraints (a node is either a leader or it is not) are the only source of nonconvexity. By relaxing these constraints to their convex hull we obtain a lower bound on the global optimal value. We also use a simple but efficient greedy algorithm to identify leaders and to compute an upper bound. For networks with leaders that perfectly follow their desired trajectories, we identify an additional source of nonconvexity in the form of a rank constraint. Removal of the rank constraint and relaxation of the Boolean constraints yields a semidefinite program for which we develop a customized algorithm well-suited for large networks. Several examples ranging from regular lattices to random graphs are provided to illustrate the effectiveness of the developed algorithms.

preprint2013arXiv

Computation of frequency responses for linear time-invariant PDEs on a compact interval

We develop mathematical framework and computational tools for calculating frequency responses of linear time-invariant PDEs in which an independent spatial variable belongs to a compact interval. In conventional studies this computation is done numerically using spatial discretization of differential operators in the evolution equation. In this paper, we introduce an alternative method that avoids the need for finite-dimensional approximation of the underlying operators in the evolution model. This method recasts the frequency response operator as a two point boundary value problem and uses state-of-the-art automatic spectral collocation techniques for solving integral representations of the resulting boundary value problems with accuracy comparable to machine precision. Our approach has two advantages over currently available schemes: first, it avoids numerical instabilities encountered in systems with differential operators of high order and, second, it alleviates difficulty in implementing boundary conditions. We provide examples from Newtonian and viscoelastic fluid dynamics to illustrate utility of the proposed method.

preprint2013arXiv

Design of Optimal Sparse Feedback Gains via the Alternating Direction Method of Multipliers

We design sparse and block sparse feedback gains that minimize the variance amplification (i.e., the $H_2$ norm) of distributed systems. Our approach consists of two steps. First, we identify sparsity patterns of feedback gains by incorporating sparsity-promoting penalty functions into the optimal control problem, where the added terms penalize the number of communication links in the distributed controller. Second, we optimize feedback gains subject to structural constraints determined by the identified sparsity patterns. In the first step, the sparsity structure of feedback gains is identified using the alternating direction method of multipliers, which is a powerful algorithm well-suited to large optimization problems. This method alternates between promoting the sparsity of the controller and optimizing the closed-loop performance, which allows us to exploit the structure of the corresponding objective functions. In particular, we take advantage of the separability of the sparsity-promoting penalty functions to decompose the minimization problem into sub-problems that can be solved analytically. Several examples are provided to illustrate the effectiveness of the developed approach.

preprint2013arXiv

Design of optimal sparse interconnection graphs for synchronization of oscillator networks

We study the optimal design of a conductance network as a means for synchronizing a given set of oscillators. Synchronization is achieved when all oscillator voltages reach consensus, and performance is quantified by the mean-square deviation from the consensus value. We formulate optimization problems that address the trade-off between synchronization performance and the number and strength of oscillator couplings. We promote the sparsity of the coupling network by penalizing the number of interconnection links. For identical oscillators, we establish convexity of the optimization problem and demonstrate that the design problem can be formulated as a semidefinite program. Finally, for special classes of oscillator networks we derive explicit analytical expressions for the optimal conductance values.

preprint2013arXiv

Sparsity-promoting dynamic mode decomposition

Dynamic mode decomposition (DMD) represents an effective means for capturing the essential features of numerically or experimentally generated flow fields. In order to achieve a desirable tradeoff between the quality of approximation and the number of modes that are used to approximate the given fields, we develop a sparsity-promoting variant of the standard DMD algorithm. In our method, sparsity is induced by regularizing the least-squares deviation between the matrix of snapshots and the linear combination of DMD modes with an additional term that penalizes the $\ell_1$-norm of the vector of DMD amplitudes. The globally optimal solution of the resulting regularized convex optimization problem is computed using the alternating direction method of multipliers, an algorithm well-suited for large problems. Several examples of flow fields resulting from numerical simulations and physical experiments are used to illustrate the effectiveness of the developed method.

preprint2013arXiv

Worst-case amplification of disturbances in inertialess Couette flow of viscoelastic fluids

Amplification of deterministic disturbances in inertialess shear-driven channel flows of viscoelastic fluids is examined by analyzing the frequency responses from spatio-temporal body forces to the velocity and polymer stress fluctuations. In strongly elastic flows, we show that disturbances with large streamwise length scales may be significantly amplified even in the absence of inertia. For fluctuations without streamwise variations, we derive explicit analytical expressions for the dependence of the worst-case amplification (from different forcing to different velocity and polymer stress components) on the Weissenberg number ($We$), the maximum extensibility of the polymer chains ($L$), the viscosity ratio, and the spanwise wavenumber. For the Oldroyd-B model, the amplification of the most energetic components of velocity and polymer stress fields scales as $We^2$ and $We^4$. On the other hand, finite extensibility of polymer molecules limits the largest achievable amplification even in flows with infinitely large Weissenberg numbers: in the presence of wall-normal and spanwise forces the amplification of the streamwise velocity and polymer stress fluctuations is bounded by quadratic and quartic functions of $L$. This high amplification signals low robustness to modeling imperfections of inertialess channel flows of viscoelastic fluids. The underlying physical mechanism involves interactions of polymer stress fluctuations with a base shear, and it represents a close analog of the lift-up mechanism that initiates a bypass transition in inertial flows of Newtonian fluids.

preprint2012arXiv

Model-based design of transverse wall oscillations for turbulent drag reduction

Over the last two decades, both experiments and simulations have demonstrated that transverse wall oscillations with properly selected amplitude and frequency can reduce turbulent drag by as much as 40%. In this paper, we develop a model-based approach for designing oscillations that suppress turbulence in a channel flow. We utilize eddy-viscosity-enhanced linearization of the turbulent flow with control in conjunction with turbulence modeling to determine skin-friction drag in a simulation-free manner. The Boussinesq eddy viscosity hypothesis is used to quantify the effect of fluctuations on the mean velocity in the flow subject to control. In contrast to the traditional approach that relies on numerical simulations, we determine the turbulent viscosity from the second order statistics of the linearized model driven by white-in-time stochastic forcing. The spatial power spectrum of the forcing is selected to ensure that the linearized model for the uncontrolled flow reproduces the turbulent energy spectrum. The resulting correction to the turbulent mean velocity induced by small amplitude wall movements is then used to identify the optimal frequency of drag reducing oscillations. In addition, the control net efficiency and the turbulent flow structures that we obtain agree well with the results of numerical simulations and experiments. This demonstrates the predictive power of our model-based approach to controlling turbulent flows and is expected to pave the way for successful flow control at higher Reynolds numbers than currently possible.

preprint2011arXiv

Coherence in Large-Scale Networks: Dimension-Dependent Limitations of Local Feedback

We consider distributed consensus and vehicular formation control problems. Specifically we address the question of whether local feedback is sufficient to maintain coherence in large-scale networks subject to stochastic disturbances. We define macroscopic performance measures which are global quantities that capture the notion of coherence; a notion of global order that quantifies how closely the formation resembles a solid object. We consider how these measures scale asymptotically with network size in the topologies of regular lattices in 1, 2 and higher dimensions, with vehicular platoons corresponding to the 1 dimensional case. A common phenomenon appears where a higher spatial dimension implies a more favorable scaling of coherence measures, with a dimensions of 3 being necessary to achieve coherence in consensus and vehicular formations under certain conditions. In particular, we show that it is impossible to have large coherent one dimensional vehicular platoons with only local feedback. We analyze these effects in terms of the underlying energetic modes of motion, showing that they take the form of large temporal and spatial scales resulting in an accordion-like motion of formations. A conclusion can be drawn that in low spatial dimensions, local feedback is unable to regulate large-scale disturbances, but it can in higher spatial dimensions. This phenomenon is distinct from, and unrelated to string instability issues which are commonly encountered in control problems for automated highways.

preprint2011arXiv

Nonmodal amplification of stochastic disturbances in strongly elastic channel flows

Nonmodal amplification of stochastic disturbances in elasticity-dominated channel flows of Oldroyd-B fluids is analyzed in this work. For streamwise-constant flows with high elasticity numbers $μ$ and finite Weissenberg numbers $We$, we show that the linearized dynamics can be decomposed into slow and fast subsystems, and establish analytically that the steady-state variances of velocity and polymer stress fluctuations scale as $O (We^2)$ and $O (We^4)$, respectively. This demonstrates that large velocity variance can be sustained even in weakly inertial stochastically driven channel flows of viscoelastic fluids. We further show that the wall-normal and spanwise forces have the strongest impact on the flow fluctuations, and that the influence of these forces is largest on the fluctuations in streamwise velocity and the streamwise component of the polymer stress tensor. The underlying physical mechanism involves polymer stretching that introduces a lift-up of flow fluctuations similar to vortex tilting in inertia-dominated flows. The validity of our analytical results is confirmed in stochastic simulations. The phenomenon examined here provides a possible route for the early stages of a bypass transition to elastic turbulence and might be exploited to enhance mixing in microfluidic devices.

preprint2011arXiv

Optimal Control of Vehicular Formations with Nearest Neighbor Interactions

We consider the design of optimal localized feedback gains for one-dimensional formations in which vehicles only use information from their immediate neighbors. The control objective is to enhance coherence of the formation by making it behave like a rigid lattice. For the single-integrator model with symmetric gains, we establish convexity, implying that the globally optimal controller can be computed efficiently. We also identify a class of convex problems for double-integrators by restricting the controller to symmetric position and uniform diagonal velocity gains. To obtain the optimal non-symmetric gains for both the single- and the double-integrator models, we solve a parameterized family of optimal control problems ranging from an easily solvable problem to the problem of interest as the underlying parameter increases. When this parameter is kept small, we employ perturbation analysis to decouple the matrix equations that result from the optimality conditions, thereby rendering the unique optimal feedback gain. This solution is used to initialize a homotopy-based Newton's method to find the optimal localized gain. To investigate the performance of localized controllers, we examine how the coherence of large-scale stochastically forced formations scales with the number of vehicles. We establish several explicit scaling relationships and show that the best performance is achieved by a localized controller that is both non-symmetric and spatially-varying.

preprint2010arXiv

Controlling the onset of turbulence by streamwise traveling waves. Part 1: Receptivity analysis

We examine the efficacy of streamwise traveling waves generated by a zero-net-mass-flux surface blowing and suction for controlling the onset of turbulence in a channel flow. For small amplitude actuation, we utilize weakly nonlinear analysis to determine base flow modifications and to assess the resulting net power balance. Receptivity analysis of the velocity fluctuations around this base flow is then employed to design the traveling waves. Our simulation-free approach reveals that, relative to the flow with no control, the downstream traveling waves with properly designed speed and frequency can significantly reduce receptivity which makes them well-suited for controlling the onset of turbulence. In contrast, the velocity fluctuations around the upstream traveling waves exhibit larger receptivity to disturbances. Our theoretical predictions, obtained by perturbation analysis (in the wave amplitude) of the linearized Navier-Stokes equations with spatially periodic coefficients, are verified using full-scale simulations of the nonlinear flow dynamics in companion paper, Lieu, Moarref & Jovanović (2010).

preprint2010arXiv

Controlling the onset of turbulence by streamwise traveling waves. Part 2. Direct numerical simulations

This work builds on and confirms the theoretical findings of Part 1 of this paper, Moarref & Jovanović (2010). We use direct numerical simulations of the Navier-Stokes equations to assess the efficacy of blowing and suction in the form of streamwise traveling waves for controlling the onset of turbulence in a channel flow. We highlight the effects of the modified base flow on the dynamics of velocity fluctuations and net power balance. Our simulations verify the theoretical predictions of Part 1 that the upstream traveling waves promote turbulence even when the uncontrolled flow stays laminar. On the other hand, the downstream traveling waves with parameters selected in Part 1 are capable of reducing the fluctuations' kinetic energy, thereby maintaining the laminar flow. In flows driven by a fixed pressure gradient, a positive net efficiency as large as 25 % relative to the uncontrolled turbulent flow can be achieved with downstream waves. Furthermore, we show that these waves can also relaminarize fully developed turbulent flows at low Reynolds numbers. We conclude that the theory developed in Part 1 for the linearized flow equations with uncertainty has considerable ability to predict full-scale phenomena.

preprint2009arXiv

Frequency responses of streamwise-constant perturbations in channel flows of Oldroyd-B fluids

Non-modal amplification of disturbances in streamwise-constant channel flows of Oldroyd-B fluids is studied from an input-output point of view by analyzing the responses of the velocity components to spatio-temporal body forces. These inputs into the governing equations are assumed to be harmonic in the spanwise direction and stochastic in the wall-normal direction and in time. An explicit Reynolds number scaling of frequency responses from different forcing to different velocity components is developed, showing the same $Re$-dependence as in Newtonian fluids. It is found that some of the frequency response components peak at non-zero temporal frequencies. This is in contrast to Newtonian fluids, where peaks are always observed at zero frequency, suggesting that viscoelastic effects introduce additional timescales and promote development of flow patterns with smaller time constants than in Newtonian fluids. The temporal frequencies, corresponding to the peaks in the components of frequency response, decrease with an increase in viscosity ratio (ratio of solvent viscosity to total viscosity) and show maxima for non-zero elasticity number. Our analysis of the Reynolds-Orr equation demonstrates that the energy-exchange term involving the streamwise/wall-normal polymer stress component $τ_{xy}$ and the wall-normal gradient of the streamwise velocity $\partial_y u$ becomes increasingly important relative to the Reynolds stress term as the elasticity number increases, and is thus the main driving force for amplification in flows with strong viscoelastic effects.