Source author record

Qiyu Sun

Qiyu Sun appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

36works
20topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

36 published item(s)

preprint2022arXiv

Aggressive Quadrotor Flight Using Curiosity-Driven Reinforcement Learning

The ability to perform aggressive movements, which are called aggressive flights, is important for quadrotors during navigation. However, aggressive quadrotor flights are still a great challenge to practical applications. The existing solutions to aggressive flights heavily rely on a predefined trajectory, which is a time-consuming preprocessing step. To avoid such path planning, we propose a curiosity-driven reinforcement learning method for aggressive flight missions and a similarity-based curiosity module is introduced to speed up the training procedure. A branch structure exploration (BSE) strategy is also applied to guarantee the robustness of the policy and to ensure the policy trained in simulations can be performed in real-world experiments directly. The experimental results in simulations demonstrate that our reinforcement learning algorithm performs well in aggressive flight tasks, speeds up the convergence process and improves the robustness of the policy. Besides, our algorithm shows a satisfactory simulated to real transferability and performs well in real-world experiments.

preprint2022arXiv

Carleman Linearization of Nonlinear Systems and Its Finite-Section Approximations

The Carleman linearization is one of the mainstream approaches to lift a finite-dimensional nonlinear dynamical system into an infinite-dimensional linear system with the promise of providing accurate approximations of the original nonlinear system over larger regions around the equilibrium for longer time horizons with respect to the conventional first-order linearization approach. Finite-section approximations of the lifted system has been widely used to study dynamical and control properties of the original nonlinear system. In this context, some of the outstanding problems are to determine under what conditions, as the finite-section order (i.e., truncation length) increases, the trajectory of the resulting approximate linear system from the finite-section scheme converges to that of the original nonlinear system and whether the time interval over which the convergence happens can be quantified explicitly. In this paper, we provide explicit error bounds for the finite-section approximation and prove that the convergence is indeed exponential with respect to the finite-section order. For a class of nonlinear systems, it is shown that one can achieve exponential convergence over the entire time horizon up to infinity. Our results are practically plausible as our proposed error bound estimates can be used to compute proper truncation lengths for a given application, e.g., determining proper sampling period for model predictive control and reachability analysis for safety verifications. We validate our theoretical findings through several illustrative simulations.

preprint2022arXiv

CoDGraD: A Code-based Distributed Gradient Descent Scheme for Decentralized Convex Optimization

In this paper, we consider a large network containing many regions such that each region is equipped with a worker with some data processing and communication capability. For such a network, some workers may become stragglers due to the failure or heavy delay on computing or communicating. To resolve the above straggling problem, a coded scheme that introduces certain redundancy for every worker was recently proposed, and a gradient coding paradigm was developed to solve convex optimization problems when the network has a centralized fusion center. In this paper, we propose an iterative distributed algorithm, referred as Code-Based Distributed Gradient Descent algorithm (CoDGraD), to solve convex optimization problems over distributed networks. In each iteration of the proposed algorithm, an active worker shares the coded local gradient and approximated solution of the convex optimization problem with non-straggling workers at the adjacent regions only. In this paper, we also provide the consensus and convergence analysis for the CoDGraD algorithm and we demonstrate its performance via numerical simulations.

preprint2022arXiv

Graph Fourier transform based on singular value decomposition of directed Laplacian

Graph Fourier transform (GFT) is a fundamental concept in graph signal processing. In this paper, based on singular value decomposition of Laplacian, we introduce a novel definition of GFT on directed graphs, and use singular values of Laplacian to carry the notion of graph frequencies. % of the proposed GFT. The proposed GFT is consistent with the conventional GFT in the undirected graph setting, and on directed circulant graphs, the proposed GFT is the classical discrete Fourier transform, up to some rotation, permutation and phase adjustment. We show that frequencies and frequency components of the proposed GFT can be evaluated by solving some constrained minimization problems with low computational cost. Numerical demonstrations indicate that the proposed GFT could represent graph signals with different modes of variation efficiently.

preprint2022arXiv

Graph Fourier transforms on directed product graphs

Graph Fourier transform (GFT) is one of the fundamental tools in graph signal processing to decompose graph signals into different frequency components and to represent graph signals with strong correlation by different modes of variation effectively. The GFT on undirected graphs has been well studied and several approaches have been proposed to define GFTs on directed graphs. In this paper, based on the singular value decompositions of some graph Laplacians, we propose two GFTs on the Cartesian product graph of two directed graphs. We show that the proposed GFTs could represent spatial-temporal data sets on directed networks with strong correlation efficiently, and in the undirected graph setting they are essentially the joint GFT in the literature. In this paper, we also consider the bandlimiting procedure in the spectral domain of the proposed GFTs, and demonstrate its performance to denoise the temperature data set in the region of Brest (France) on January 2014.

preprint2022arXiv

Learn to Adapt for Monocular Depth Estimation

Monocular depth estimation is one of the fundamental tasks in environmental perception and has achieved tremendous progress in virtue of deep learning. However, the performance of trained models tends to degrade or deteriorate when employed on other new datasets due to the gap between different datasets. Though some methods utilize domain adaptation technologies to jointly train different domains and narrow the gap between them, the trained models cannot generalize to new domains that are not involved in training. To boost the transferability of depth estimation models, we propose an adversarial depth estimation task and train the model in the pipeline of meta-learning. Our proposed adversarial task mitigates the issue of meta-overfitting, since the network is trained in an adversarial manner and aims to extract domain invariant representations. In addition, we propose a constraint to impose upon cross-task depth consistency to compel the depth estimation to be identical in different adversarial tasks, which improves the performance of our method and smoothens the training process. Experiments demonstrate that our method adapts well to new datasets after few training steps during the test procedure.

preprint2022arXiv

Perception and Navigation in Autonomous Systems in the Era of Learning: A Survey

Autonomous systems possess the features of inferring their own state, understanding their surroundings, and performing autonomous navigation. With the applications of learning systems, like deep learning and reinforcement learning, the visual-based self-state estimation, environment perception and navigation capabilities of autonomous systems have been efficiently addressed, and many new learning-based algorithms have surfaced with respect to autonomous visual perception and navigation. In this review, we focus on the applications of learning-based monocular approaches in ego-motion perception, environment perception and navigation in autonomous systems, which is different from previous reviews that discussed traditional methods. First, we delineate the shortcomings of existing classical visual simultaneous localization and mapping (vSLAM) solutions, which demonstrate the necessity to integrate deep learning techniques. Second, we review the visual-based environmental perception and understanding methods based on deep learning, including deep learning-based monocular depth estimation, monocular ego-motion prediction, image enhancement, object detection, semantic segmentation, and their combinations with traditional vSLAM frameworks. Then, we focus on the visual navigation based on learning systems, mainly including reinforcement learning and deep reinforcement learning. Finally, we examine several challenges and promising directions discussed and concluded in related research of learning systems in the era of computer science and robotics.

preprint2022arXiv

Unsupervised Monocular Depth Estimation in Highly Complex Environments

With the development of computational intelligence algorithms, unsupervised monocular depth and pose estimation framework, which is driven by warped photometric consistency, has shown great performance in the daytime scenario. While in some challenging environments, like night and rainy night, the essential photometric consistency hypothesis is untenable because of the complex lighting and reflection, so that the above unsupervised framework cannot be directly applied to these complex scenarios. In this paper, we investigate the problem of unsupervised monocular depth estimation in highly complex scenarios and address this challenging problem by adopting an image transfer-based domain adaptation framework. We adapt the depth model trained on day-time scenarios to be applicable to night-time scenarios, and constraints on both feature space and output space promote the framework to learn the key features for depth decoding. Meanwhile, we further tackle the effects of unstable image transfer quality on domain adaptation, and an image adaptation approach is proposed to evaluate the quality of transferred images and re-weight the corresponding losses, so as to improve the performance of the adapted depth model. Extensive experiments show the effectiveness of the proposed unsupervised framework in estimating the dense depth map from highly complex images.

preprint2022arXiv

Wiener filters on graphs and distributed polynomial approximation algorithms

In this paper, we consider Wiener filters to reconstruct deterministic and (wide-band) stationary graph signals from their observations corrupted by random noises, and we propose distributed algorithms to implement Wiener filters and inverse filters on networks in which agents are equipped with a data processing subsystem for limited data storage and computation power, and with a one-hop communication subsystem for direct data exchange only with their adjacent agents. The proposed distributed polynomial approximation algorithm is an exponential convergent quasi-Newton method based on Jacobi polynomial approximation and Chebyshev interpolation polynomial approximation to analytic functions on a cube. Our numerical simulations show that Wiener filtering procedure performs better on denoising (wide-band) stationary signals than the Tikhonov regularization approach does, and that the proposed polynomial approximation algorithms converge faster than the Chebyshev polynomial approximation algorithm and gradient decent algorithm do in the implementation of an inverse filtering procedure associated with a polynomial filter of commutative graph shifts.

preprint2020arXiv

Monocular Depth Estimation Based On Deep Learning: An Overview

Depth information is important for autonomous systems to perceive environments and estimate their own state. Traditional depth estimation methods, like structure from motion and stereo vision matching, are built on feature correspondences of multiple viewpoints. Meanwhile, the predicted depth maps are sparse. Inferring depth information from a single image (monocular depth estimation) is an ill-posed problem. With the rapid development of deep neural networks, monocular depth estimation based on deep learning has been widely studied recently and achieved promising performance in accuracy. Meanwhile, dense depth maps are estimated from single images by deep neural networks in an end-to-end manner. In order to improve the accuracy of depth estimation, different kinds of network frameworks, loss functions and training strategies are proposed subsequently. Therefore, we survey the current monocular depth estimation methods based on deep learning in this review. Initially, we conclude several widely used datasets and evaluation indicators in deep learning-based depth estimation. Furthermore, we review some representative existing methods according to different training manners: supervised, unsupervised and semi-supervised. Finally, we discuss the challenges and provide some ideas for future researches in monocular depth estimation.

preprint2020arXiv

Preconditioned Gradient Descent Algorithm for Inverse Filtering on Spatially Distributed Networks

Graph filters and their inverses have been widely used in denoising, smoothing, sampling, interpolating and learning. Implementation of an inverse filtering procedure on spatially distributed networks (SDNs) is a remarkable challenge, as each agent on an SDN is equipped with a data processing subsystem with limited capacity and a communication subsystem with confined range due to engineering limitations. In this letter, we introduce a preconditioned gradient descent algorithm to implement the inverse filtering procedure associated with a graph filter having small geodesic-width. The proposed algorithm converges exponentially, and it can be implemented at vertex level and applied to time-varying inverse filtering on SDNs.

preprint2020arXiv

Random sampling and reconstruction of concentrated signals in a reproducing kernel space

In this paper, we consider (random) sampling of signals concentrated on a bounded Corkscrew domain $Ω$ of a metric measure space, and reconstructing concentrated signals approximately from their (un)corrupted sampling data taken on a sampling set contained in $Ω$. We establish a weighted stability of bi-Lipschitz type for a (random) sampling scheme on the set of concentrated signals in a reproducing kernel space. The weighted stability of bi-Lipschitz type provides a weak robustness to the sampling scheme, however due to the nonconvexity of the set of concentrated signals, it does not imply the unique signal reconstruction. From (un)corrupted samples taken on a finite sampling set contained in $Ω$, we propose an algorithm to find approximations to signals concentrated on a bounded Corkscrew domain $Ω$. Random sampling is a sampling scheme where sampling positions are randomly taken according to a probability distribution. Next we show that, with high probability, signals concentrated on a bounded Corkscrew domain $Ω$ can be reconstructed approximately from their uncorrupted (or randomly corrupted) samples taken at i.i.d. random positions drawn on $Ω$, provided that the sampling size is at least of the order $μ(Ω) \ln (μ(Ω))$, where $μ(Ω)$ is the measure of the concentrated domain $Ω$. Finally, we demonstrate the performance of proposed approximations to the original concentrated signal when the sampling procedure is taken either with small density or randomly with large size.

preprint2020arXiv

When Autonomous Systems Meet Accuracy and Transferability through AI: A Survey

With widespread applications of artificial intelligence (AI), the capabilities of the perception, understanding, decision-making and control for autonomous systems have improved significantly in the past years. When autonomous systems consider the performance of accuracy and transferability, several AI methods, like adversarial learning, reinforcement learning (RL) and meta-learning, show their powerful performance. Here, we review the learning-based approaches in autonomous systems from the perspectives of accuracy and transferability. Accuracy means that a well-trained model shows good results during the testing phase, in which the testing set shares a same task or a data distribution with the training set. Transferability means that when a well-trained model is transferred to other testing domains, the accuracy is still good. Firstly, we introduce some basic concepts of transfer learning and then present some preliminaries of adversarial learning, RL and meta-learning. Secondly, we focus on reviewing the accuracy or transferability or both of them to show the advantages of adversarial learning, like generative adversarial networks (GANs), in typical computer vision tasks in autonomous systems, including image style transfer, image superresolution, image deblurring/dehazing/rain removal, semantic segmentation, depth estimation, pedestrian detection and person re-identification (re-ID). Then, we further review the performance of RL and meta-learning from the aspects of accuracy or transferability or both of them in autonomous systems, involving pedestrian tracking, robot navigation and robotic manipulation. Finally, we discuss several challenges and future topics for using adversarial learning, RL and meta-learning in autonomous systems.

preprint2016arXiv

Phase Retrieval From the Magnitudes of Affine Linear Measurements

In this paper, we consider the phase retrieval problem in which one aims to recover a signal from the magnitudes of affine measurements. Let $\{{\mathbf a}_j\}_{j=1}^m \subset {\mathbb H}^d$ and ${\mathbf b}=(b_1, \ldots, b_m)^\top\in{\mathbb H}^m$, where ${\mathbb H}={\mathbb R}$ or ${\mathbb C}$. We say $\{{\mathbf a}_j\}_{j=1}^m$ and $\mathbf b$ are affine phase retrievable for ${\mathbb H}^d$ if any ${\mathbf x}\in{\mathbb H}^d$ can be recovered from the magnitudes of the affine measurements $\{|<{\mathbf a}_j,{\mathbf x}>+b_j|,\, 1\leq j\leq m\}$. We develop general framework for affine phase retrieval and prove necessary and sufficient conditions for $\{{\mathbf a}_j\}_{j=1}^m$ and $\mathbf b$ to be affine phase retrievable. We establish results on minimal measurements and generic measurements for affine phase retrieval as well as on sparse affine phase retrieval. In particular, we also highlight some notable differences between affine phase retrieval and the standard phase retrieval in which one aims to recover a signal $\mathbf x$ from the magnitudes of its linear measurements. In standard phase retrieval, one can only recover $\mathbf x$ up to a unimodular constant, while affine phase retrieval removes this ambiguity. We prove that unlike standard phase retrieval, the affine phase retrievable measurements $\{{\mathbf a}_j\}_{j=1}^m$ and $\mathbf b$ do not form an open set in ${\mathbb H}^{m\times d}\times {\mathbb H}^m$. Also in the complex setting, the standard phase retrieval requires $4d-O(\log_2d)$ measurements, while the affine phase retrieval only needs $m=3d$ measurements.

preprint2016arXiv

Phase Retrieval of Real-Valued Signals in a Shift-Invariant Space

Phase retrieval arises in various fields of science and engineering and it is well studied in a finite-dimensional setting. In this paper, we consider an infinite-dimensional phase retrieval problem to reconstruct real-valued signals living in a shift-invariant space from its phaseless samples taken either on the whole line or on a set with finite sampling rate. We find the equivalence between nonseparability of signals in a linear space and its phase retrievability with phaseless samples taken on the whole line. For a spline signal of order $N$, we show that it can be well approximated, up to a sign, from its noisy phaseless samples taken on a set with sampling rate $2N-1$. We propose an algorithm to reconstruct nonseparable signals in a shift-invariant space generated by a compactly supported continuous function. The proposed algorithm is robust against bounded sampling noise and it could be implemented in a distributed manner.

preprint2015arXiv

Nonlinear frames and sparse reconstructions in Banach spaces

In the first part of this paper, we consider nonlinear extension of frame theory by introducing bi-Lipschitz maps $F$ between Banach spaces. Our linear model of bi-Lipschitz maps is the analysis operator associated with Hilbert frames, $p$-frames, Banach frames, g-frames and fusion frames. In general Banach space setting, stable algorithm to reconstruct a signal $x$ from its noisy measurement $F(x)+ε$ may not exist. In this paper, we establish exponential convergence of two iterative reconstruction algorithms when $F$ is not too far from some bounded below linear operator with bounded pseudo-inverse, and when $F$ is a well-localized map between two Banach spaces with dense Hilbert subspaces. The crucial step to prove the later conclusion is a novel fixed point theorem for a well-localized map on a Banach space. In the second part of this paper, we consider stable reconstruction of sparse signals in a union ${\bf A}$ of closed linear subspaces of a Hilbert space ${\bf H}$ from their nonlinear measurements. We create an optimization framework called sparse approximation triple $({\bf A}, {\bf M}, {\bf H})$, and show that the minimizer $$x^*={\rm argmin}_{\hat x\in {\mathbf M}\ {\rm with} \ \|F(\hat x)-F(x^0)\|\le ε} \|\hat x\|_{\mathbf M}$$ provides a suboptimal approximation to the original sparse signal $x^0\in {\bf A}$ when the measurement map $F$ has the sparse Riesz property and almost linear property on ${\mathbf A}$. The above two new properties is also discussed in this paper when $F$ is not far away from a linear measurement operator $T$ having the restricted isometry property.

preprint2015arXiv

Spatially Distributed Sampling and Reconstruction

A spatially distributed system contains a large amount of agents with limited sensing, data processing, and communication capabilities. Recent technological advances have opened up possibilities to deploy spatially distributed systems for signal sampling and reconstruction. In this paper, we introduce a graph structure for a distributed sampling and reconstruction system by coupling agents in a spatially distributed system with innovative positions of signals. A fundamental problem in sampling theory is the robustness of signal reconstruction in the presence of sampling noises. For a distributed sampling and reconstruction system, the robustness could be reduced to the stability of its sensing matrix. In a traditional centralized sampling and reconstruction system, the stability of the sensing matrix could be verified by its central processor, but the above procedure is infeasible in a distributed sampling and reconstruction system as it is decentralized. In this paper, we split a distributed sampling and reconstruction system into a family of overlapping smaller subsystems, and we show that the stability of the sensing matrix holds if and only if its quasi-restrictions to those subsystems have uniform stability. This new stability criterion could be pivotal for the design of a robust distributed sampling and reconstruction system against supplement, replacement and impairment of agents, as we only need to check the uniform stability of affected subsystems. In this paper, we also propose an exponentially convergent distributed algorithm for signal reconstruction, that provides a suboptimal approximation to the original signal in the presence of bounded sampling noises.

preprint2014arXiv

Sampling and Galerkin reconstruction in reproducing kernel spaces

In this paper, we consider sampling in a reproducing kernel subspace of $L^p$. We introduce a pre-reconstruction operator associated with a sampling scheme and propose a Galerkin reconstruction in general Banach space setting. We show that the proposed Galerkin method provides a quasi-optimal approximation, and the corresponding Galerkin equations could be solved by an iterative approximation-projection algorithm. We also present detailed analysis and numerical simulations of the Galerkin method for reconstructing signals with finite rate of innovation.

preprint2014arXiv

Sparsity and Spatial Localization Measures for Spatially Distributed Systems

We consider the class of spatially decaying systems, where the underlying dynamics are spatially decaying and the sensing and controls are spatially distributed. This class of systems arise in various applications where there is a notion of spatial distance with respect to which couplings between the subsystems can be quantified using a class of coupling weight functions. We exploit spatial decay property of the underlying dynamics of the system to introduce a class of sparsity and spatial localization measures for spatially distributed systems. We develop a new methodology based on concepts of $q$-Banach algebras of spatially decaying operators that enable us to establish a relationship between spatial decay properties of spatially decaying systems and their sparsity and spatial localization features. Moreover, it is shown that the inverse-closedness property of operator algebras plays a central role in exploiting various structural properties of spatially decaying systems. We characterize conditions for exponentially stability of spatially decaying system over $q$-Banach algebras and prove that the unique solutions of the Lyapunov and Riccati equations over a proper $q$-Banach algebra also belong to the same $q$-Banach algebra. It is shown that the quadratically optimal state feedback controllers for spatially decaying systems are sparse and spatially localized in the sense that they have near-optimal sparse information structures.

preprint2013arXiv

Localized nonlinear functional equations and two sampling problems in signal processing

Let $1\le p\le \infty$. In this paper, we consider solving a nonlinear functional equation $$f(x)=y,$$ where $x, y$ belong to $\ell^p$ and $f$ has continuous bounded gradient in an inverse-closed subalgebra of ${\mathcal B}(\ell^2)$, the Banach algebra of all bounded linear operators on the Hilbert space $\ell^2$. We introduce strict monotonicity property for functions $f$ on Banach spaces $\ell^p$ so that the above nonlinear functional equation is solvable and the solution $x$ depends continuously on the given data $y$ in $\ell^p$. We show that the Van-Cittert iteration converges in $\ell^p$ with exponential rate and hence it could be used to locate the true solution of the above nonlinear functional equation. We apply the above theory to handle two problems in signal processing: nonlinear sampling termed with instantaneous companding and subsequently average sampling; and local identification of innovation positions and qualification of amplitudes of signals with finite rate of innovation.

preprint2013arXiv

Recovery of bilevel causal signals with finite rate of innovation using positive sampling kernels

Bilevel signal $x$ with maximal local rate of innovation $R$ is a continuous-time signal that takes only two values 0 and 1 and that there is at most one transition position in any time period of 1/R.In this note, we introduce a recovery method for bilevel causal signals $x$ with maximal local rate of innovation $R$ from their uniform samples $x*h(nT), n\ge 1$, where the sampling kernel $h$ is causal and positive on $(0, T)$, and the sampling rate $τ:=1/T$ is at (or above) the maximal local rate of innovation $R$. We also discuss stability of the bilevel signal recovery procedure in the presence of bounded noises.

preprint2013arXiv

The $abc$-problem for Gabor systems

A Gabor system generated by a window function $ϕ$ and a rectangular lattice $a \Z\times \Z/b$ is given by $${\mathcal G}(ϕ, a \Z\times \Z/b):=\{e^{-2πi n t/b} ϕ(t- m a):\ (m, n)\in \Z\times \Z\}.$$ One of fundamental problems in Gabor analysis is to identify window functions $ϕ$ and time-frequency shift lattices $a \Z\times \Z/b$ such that the corresponding Gabor system ${\mathcal G}(ϕ, a \Z\times \Z/b)$ is a Gabor frame for $L^2(\R)$, the space of all square-integrable functions on the real line $\R$. In this paper, we provide a full classification of triples $(a,b,c)$ for which the Gabor system ${\mathcal G}(χ_I, a \Z\times \Z/b)$ generated by the ideal window function $χ_I$ on an interval $I$ of length $c$ is a Gabor frame for $L^2(\R)$. For the classification of such triples $(a, b, c)$ (i.e., the $abc$-problem for Gabor systems), we introduce maximal invariant sets of some piecewise linear transformations and establish the equivalence between Gabor frame property and triviality of maximal invariant sets. We then study dynamic system associated with the piecewise linear transformations and explore various properties of their maximal invariant sets. By performing holes-removal surgery for maximal invariant sets to shrink and augmentation operation for a line with marks to expand, we finally parameterize those triples $(a, b, c)$ for which maximal invariant sets are trivial. The novel techniques involving non-ergodicity of dynamical systems associated with some novel non-contractive and non-measure-preserving transformations lead to our arduous answer to the $abc$-problem for Gabor systems.

preprint2012arXiv

A unified formulation of Gaussian vs. sparse stochastic processes - Part I: Continuous-domain theory

We introduce a general distributional framework that results in a unifying description and characterization of a rich variety of continuous-time stochastic processes. The cornerstone of our approach is an innovation model that is driven by some generalized white noise process, which may be Gaussian or not (e.g., Laplace, impulsive Poisson or alpha stable). This allows for a conceptual decoupling between the correlation properties of the process, which are imposed by the whitening operator L, and its sparsity pattern which is determined by the type of noise excitation. The latter is fully specified by a Levy measure. We show that the range of admissible innovation behavior varies between the purely Gaussian and super-sparse extremes. We prove that the corresponding generalized stochastic processes are well-defined mathematically provided that the (adjoint) inverse of the whitening operator satisfies some Lp bound for p>=1. We present a novel operator-based method that yields an explicit characterization of all Levy-driven processes that are solutions of constant-coefficient stochastic differential equations. When the underlying system is stable, we recover the family of stationary CARMA processes, including the Gaussian ones. The approach remains valid when the system is unstable and leads to the identification of potentially useful generalizations of the Levy processes, which are sparse and non-stationary. Finally, we show how we can apply finite difference operators to obtain a stationary characterization of these processes that is maximally decoupled and stable, irrespective of the location of the poles in the complex plane.

preprint2012arXiv

Divergence of mock and scrambled Fourier series

We study divergence properties of Fourier series on Cantor-type fractal measures, also called mock Fourier series. We show that in some cases the $L^1$-norm of the corresponding Dirichlet kernel grows exponentially fast, and therefore the Fourier series are not even pointwise convergent. We apply these results to the Lebesgue measure to show that a certain rearrangement of the exponential functions, which we call scrambled Fourier series, have a corresponding Dirichlet kernel whose $L^1$-norm grows exponentially fast, which is much worse than the known logarithmic bound. The divergence properties are related to the Mahler measure of certain polynomials and to spectral properties of Ruelle operators.

preprint2011arXiv

Sparse approximation property and stable recovery of sparse signals from noisy measurements

In this paper, we introduce a sparse approximation property of order $s$ for a measurement matrix ${\bf A}$: $$\|{\bf x}_s\|_2\le D \|{\bf A}{\bf x}\|_2+ β\frac{σ_s({\bf x})}{\sqrt{s}} \quad {\rm for\ all} \ {\bf x},$$ where ${\bf x}_s$ is the best $s$-sparse approximation of the vector ${\bf x}$ in $\ell^2$, $σ_s({\bf x})$ is the $s$-sparse approximation error of the vector ${\bf x}$ in $\ell^1$, and $D$ and $β$ are positive constants. The sparse approximation property for a measurement matrix can be thought of as a weaker version of its restricted isometry property and a stronger version of its null space property. In this paper, we show that the sparse approximation property is an appropriate condition on a measurement matrix to consider stable recovery of any compressible signal from its noisy measurements. In particular, we show that any compressible signalcan be stably recovered from its noisy measurements via solving an $\ell^1$-minimization problem if the measurement matrix has the sparse approximation property with $β\in (0,1)$, and conversely the measurement matrix has the sparse approximation property with $β\in (0,\infty)$ if any compressible signal can be stably recovered from its noisy measurements via solving an $\ell^1$-minimization problem.

preprint2011arXiv

Stability of Localized Integral Operators on Weighted $L^p$ spaces

In this paper, we consider localized integral operators whose kernels have mild singularity near the diagonal and certain Holder regularity and decay off the diagonal. Our model example is the Bessel potential operator ${\mathcal J}_γ, γ>0$. We show that if such a localized integral operator has stability on a weighted function space $L^p_w$ for some $p\in [1, \infty)$ and Muckenhoupt $A_p$-weight $w$, then it has stability on weighted function spaces $L^{p'}_{w'}$ for all $1\le p'<\infty$ and Muckenhoupt $A_{p'}$-weights $w'$.

preprint2010arXiv

Left-Inverses of Fractional Laplacian and Sparse Stochastic Processes

The fractional Laplacian $(-\triangle)^{γ/2}$ commutes with the primary coordination transformations in the Euclidean space $\RR^d$: dilation, translation and rotation, and has tight link to splines, fractals and stable Levy processes. For $0<γ<d$, its inverse is the classical Riesz potential $I_γ$ which is dilation-invariant and translation-invariant. In this work, we investigate the functional properties (continuity, decay and invertibility) of an extended class of differential operators that share those invariance properties. In particular, we extend the definition of the classical Riesz potential $I_γ$ to any non-integer number $γ$ larger than $d$ and show that it is the unique left-inverse of the fractional Laplacian $(-\triangle)^{γ/2}$ which is dilation-invariant and translation-invariant. We observe that, for any $1\le p\le \infty$ and $γ\ge d(1-1/p)$, there exists a Schwartz function $f$ such that $I_γf$ is not $p$-integrable. We then introduce the new unique left-inverse $I_{γ, p}$ of the fractional Laplacian $(-\triangle)^{γ/2}$ with the property that $I_{γ, p}$ is dilation-invariant (but not translation-invariant) and that $I_{γ, p}f$ is $p$-integrable for any Schwartz function $f$. We finally apply that linear operator $I_{γ, p}$ with $p=1$ to solve the stochastic partial differential equation $(-\triangle)^{γ/2} Φ=w$ with white Poisson noise as its driving term $w$.

preprint2010arXiv

Uncertainty Principles and Balian-Low type Theorems in Principal Shift-Invariant Spaces

In this paper, we consider the time-frequency localization of the generator of a principal shift-invariant space on the real line which has additional shift-invariance. We prove that if a principal shift-invariant space on the real line is translation-invariant then any of its orthonormal (or Riesz) generators is non-integrable. However, for any $n\ge2$, there exist principal shift-invariant spaces on the real line that are also $\nZ$-invariant with an integrable orthonormal (or a Riesz) generator $ϕ$, but $ϕ$ satisfies $\int_{\mathbb R} |ϕ(x)|^2 |x|^{1+ε} dx=\infty$ for any $ε>0$ and its Fourier transform $\hatϕ$ cannot decay as fast as $ (1+|ξ|)^{-r}$ for any $r>1/2$. Examples are constructed to demonstrate that the above decay properties for the orthormal generator in the time domain and in the frequency domain are optimal.

preprint2009arXiv

Sampling and Reconstruction of Signals in a Reproducing Kernel Subspace of $L^p({\Bbb R}^d)$

In this paper, we consider sampling and reconstruction of signals in a reproducing kernel subspace of $L^p(\Rd), 1\le p\le \infty$, associated with an idempotent integral operator whose kernel has certain off-diagonal decay and regularity. The space of $p$-integrable non-uniform splines and the shift-invariant spaces generated by finitely many localized functions are our model examples of such reproducing kernel subspaces of $L^p(\Rd)$. We show that a signal in such reproducing kernel subspaces can be reconstructed in a stable way from its samples taken on a relatively-separated set with sufficiently small gap. We also study the exponential convergence, consistency, and the asymptotic pointwise error estimate of the iterative approximation-projection algorithm and the iterative frame algorithm for reconstructing a signal in those reproducing kernel spaces from its samples with sufficiently small gap.

preprint2008arXiv

Stability of Localized Operators

Let $\ell^p, 1\le p\le \infty$, be the space of all $p$-summable sequences and $C_a$ be the convolution operator associated with a summable sequence $a$. It is known that the $\ell^p$- stability of the convolution operator $C_a$ for different $1\le p\le \infty$ are equivalent to each other, i.e., if $C_a$ has $\ell^p$-stability for some $1\le p\le \infty$ then $C_a$ has $\ell^q$-stability for all $1\le q\le \infty$. In the study of spline approximation, wavelet analysis, time-frequency analysis, and sampling, there are many localized operators of non-convolution type whose stability is one of the basic assumptions. In this paper, we consider the stability of those localized operators including infinite matrices in the Sjöstrand class, synthesis operators with generating functions enveloped by shifts of a function in the Wiener amalgam space, and integral operators with kernels having certain regularity and decay at infinity. We show that the $\ell^p$- stability (or $L^p$-stability) of those three classes of localized operators are equivalent to each other, and we also prove that the left inverse of those localized operators are well localized.