Source author record

Akram Aldroubi

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

math.FA Information Theory Machine Learning math.IT eess.SP math.CA Computer Vision eess.IV math.CV math.DS math.OA math.PR Other Computer Science

Catalog footprint

Research overview

13works

13topics

4close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2022arXiv

Radon cumulative distribution transform subspace modeling for image classification

We present a new supervised image classification method applicable to a broad class of image deformation models. The method makes use of the previously described Radon Cumulative Distribution Transform (R-CDT) for image data, whose mathematical properties are exploited to express the image data in a form that is more suitable for machine learning. While certain operations such as translation, scaling, and higher-order transformations are challenging to model in native image space, we show the R-CDT can capture some of these variations and thus render the associated image classification problems easier to solve. The method -- utilizing a nearest-subspace algorithm in R-CDT space -- is simple to implement, non-iterative, has no hyper-parameters to tune, is computationally efficient, label efficient, and provides competitive accuracies to state-of-the-art neural networks for many types of classification problems. In addition to the test accuracy performances, we show improvements (with respect to neural network-based methods) in terms of computational efficiency (it can be implemented without the use of GPUs), number of training samples needed for training, as well as out-of-distribution generalization. The Python code for reproducing our results is available at https://github.com/rohdelab/rcdt_ns_classifier.

preprint2022arXiv

Recovery of rapidly decaying source terms from dynamical samples in evolution equations

We analyze the problem of recovering a source term of the form $h(t)=\sum_{j}h_jϕ(t-t_j)χ_{[t_j, \infty)}(t)$ from space-time samples of the solution $u$ of an initial value problem in a Hilbert space of functions. In the expression of $h$ , the terms $h_j$ belong to the Hilbert space, while $ϕ$ is a generic real-valued function with exponential decay at $\infty$ . The design of the sampling strategy takes into account noise in measurements and the existence of a background source.

preprint2022arXiv

Signed Cumulative Distribution Transform for Parameter Estimation of 1-D Signals

We describe a method for signal parameter estimation using the signed cumulative distribution transform (SCDT), a recently introduced signal representation tool based on optimal transport theory. The method builds upon signal estimation using the cumulative distribution transform (CDT) originally introduced for positive distributions. Specifically, we show that Wasserstein-type distance minimization can be performed simply using linear least squares techniques in SCDT space for arbitrary signal classes, thus providing a global minimizer for the estimation problem even when the underlying signal is a nonlinear function of the unknown parameters. Comparisons to current signal estimation methods using $L_p$ minimization shows the advantage of the method.

preprint2021arXiv

Partitioning signal classes using transport transforms for data analysis and machine learning

A relatively new set of transport-based transforms (CDT, R-CDT, LOT) have shown their strength and great potential in various image and data processing tasks such as parametric signal estimation, classification, cancer detection among many others. It is hence worthwhile to elucidate some of the mathematical properties that explain the successes of these transforms when they are used as tools in data analysis, signal processing or data classification. In particular, we give conditions under which classes of signals that are created by algebraic generative models are transformed into convex sets by the transport transforms. Such convexification of the classes simplify the classification and other data analysis and processing problems when viewed in the transform domain. More specifically, we study the extent and limitation of the convexification ability of these transforms under an algebraic generative modeling framework. We hope that this paper will serve as an introduction to these transforms and will encourage mathematicians and other researchers to further explore the theoretical underpinnings and algorithmic tools that will help understand the successes of these transforms and lay the groundwork for further successful applications.

preprint2021arXiv

Sampling the flow of a bandlimited function

We analyze the problem of reconstruction of a bandlimited function $f$ from the space-time samples of its states $f_t=ϕ_t\ast f$ resulting from the convolution with a kernel $ϕ_t$ . It is well-known that, in natural phenomena, uniform space-time samples of $f$ are not sufficient to reconstruct $f$ in a stable way. To enable stable reconstruction, a space-time sampling with periodic nonuniformly spaced samples must be used as was shown by Lu and Vetterli. We show that the stability of reconstruction, as measured by a condition number, controls the maximal gap between the spacial samples. We provide a quantitative statement of this result. In addition, instead of irregular space-time samples, we show that uniform dynamical samples at sub-Nyquist spatial rate allow one to stably reconstruct the function $\widehat f$ away from certain, explicitly described blind spots. We also consider several classes of finite dimensional subsets of bandlimited functions in which the stable reconstruction is possible, even inside the blind spots. We obtain quantitative estimates for it using Remez-Turán type inequalities. En route, we obtain a Remez-Turán inequality for prolate spheroidal wave functions. To illustrate our results, we present some numerics and explicit estimates for the heat flow problem.

preprint2021arXiv

The Signed Cumulative Distribution Transform for 1-D Signal Analysis and Classification

This paper presents a new mathematical signal transform that is especially suitable for decoding information related to non-rigid signal displacements. We provide a measure theoretic framework to extend the existing Cumulative Distribution Transform [ACHA 45 (2018), no. 3, 616-641] to arbitrary (signed) signals on $\overline{\mathbb{R}}$ . We present both forward (analysis) and inverse (synthesis) formulas for the transform, and describe several of its properties including translation, scaling, convexity, linear separability and others. Finally, we describe a metric in transform space, and demonstrate the application of the transform in classifying (detecting) signals under random displacements.

preprint2016arXiv

Dynamical sampling and systems from iterative actions of operators

We review some of the recent developments and prove new results concerning frames and Bessel systems generated by iterations of the form $\{A^ng: g\in G,\, n=0,1,2,\dots \}$ , where $A$ is a bounded linear operators on a separable complex Hilbert space $\mathcal{H}$ and $G$ is a countable set of vectors in $\mathcal{H}$ . The system of iterations mentioned above was motivated from the so called dynamical sampling problem. In dynamical sampling, an unknown function $f$ and its future states $A^nf$ are coarsely sampled at each time level $n$ , $0\leq n< L$ , where $A$ is an evolution operator that drives the system. The goal is to recover $f$ from these space-time samples.

preprint2013arXiv

Exact Reconstruction of Spatially Undersampled Signals in Evolutionary Systems

We consider the problem of spatiotemporal sampling in which an initial state $f$ of an evolution process $f_t=A_tf$ is to be recovered from a combined set of coarse samples from varying time levels $\{t_1,\dots,t_N\}$ . This new way of sampling, which we call dynamical sampling, differs from standard sampling since at any fixed time $t_i$ there are not enough samples to recover the function $f$ or the state $f_{t_i}$ . Although dynamical sampling is an inverse problem, it differs from the typical inverse problems in which $f$ is to be recovered from $A_Tf$ for a single time $T$ . In this paper, we consider signals that are modeled by $\ell^2(\mathbb Z)$ or a shift invariant space $V\subset L^2(\mathbb R)$ .

preprint2012arXiv

Nearness to Local Subspace Algorithm for Subspace and Motion Segmentation

There is a growing interest in computer science, engineering, and mathematics for modeling signals in terms of union of subspaces and manifolds. Subspace segmentation and clustering of high dimensional data drawn from a union of subspaces are especially important with many practical applications in computer vision, image and signal processing, communications, and information theory. This paper presents a clustering algorithm for high dimensional data that comes from a union of lower dimensional subspaces of equal and known dimensions. Such cases occur in many data clustering problems, such as motion segmentation and face recognition. The algorithm is reliable in the presence of noise, and applied to the Hopkins 155 Dataset, it generates the best results to date for motion segmentation. The two motion, three motion, and overall segmentation rates for the video sequences are 99.43%, 98.69%, and 99.24%, respectively.

preprint2011arXiv

A Dimension Reduction Scheme for the Computation of Optimal Unions of Subspaces

Given a set of points \F in a high dimensional space, the problem of finding a union of subspaces \cup_i V_i\subset \R^N that best explains the data \F increases dramatically with the dimension of \R^N. In this article, we study a class of transformations that map the problem into another one in lower dimension. We use the best model in the low dimensional space to approximate the best solution in the original high dimensional space. We then estimate the error produced between this solution and the optimal solution in the high dimensional space.

preprint2010arXiv

On the existence of Optimal Subspace Clustering Models

Given a set of vectors $\F=\{f_1,\dots,f_m\}$ in a Hilbert space $\HH$, and given a family $\CC$ of closed subspaces of $\HH$, the {\it subspace clustering problem} consists in finding a union of subspaces in $\CC$ that best approximates (models) the data $\F$. This problem has applications and connections to many areas of mathematics, computer science and engineering such as the Generalized Principle Component Analysis (GPCA), learning theory, compressed sensing, and sampling with finite rate of innovation. In this paper, we characterize families of subspaces $\CC$ for which such a best approximation exists. In finite dimensions the characterization is in terms of the convex hull of an augmented set $\CC^+$. In infinite dimensions however, the characterization is in terms of a new but related notion of contact hull. As an application, the existence of best approximations from $π(G)$ -invariant families $\CC$ of unitary representations of abelian groups is derived.

preprint2010arXiv

Uncertainty Principles and Balian-Low type Theorems in Principal Shift-Invariant Spaces

In this paper, we consider the time-frequency localization of the generator of a principal shift-invariant space on the real line which has additional shift-invariance. We prove that if a principal shift-invariant space on the real line is translation-invariant then any of its orthonormal (or Riesz) generators is non-integrable. However, for any $n\ge2$ , there exist principal shift-invariant spaces on the real line that are also $\nZ$-invariant with an integrable orthonormal (or a Riesz) generator $ϕ$ , but $ϕ$ satisfies $\int_{\mathbb R} |ϕ(x)|^2 |x|^{1+ε} dx=\infty$ for any $ε>0$ and its Fourier transform $\hatϕ$ cannot decay as fast as $(1+|ξ|)^{-r}$ for any $r>1/2$ . Examples are constructed to demonstrate that the above decay properties for the orthormal generator in the time domain and in the frequency domain are optimal.

preprint2008arXiv

Invariance of a Shift-Invariant Space

A shift-invariant space is a space of functions that is invariant under integer translations. Such spaces are often used as models for spaces of signals and images in mathematical and engineering applications. This paper characterizes those shift-invariant subspaces S that are also invariant under additional (non-integer) translations. For the case of finitely generated spaces, these spaces are characterized in terms of the generators of the space. As a consequence, it is shown that principal shift-invariant spaces with a compactly supported generator cannot be invariant under any non-integer translations.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Akram Aldroubi

Research overview

Is this your work?

13 publications

Radon cumulative distribution transform subspace modeling for image classification

Recovery of rapidly decaying source terms from dynamical samples in evolution equations

Signed Cumulative Distribution Transform for Parameter Estimation of 1-D Signals

Partitioning signal classes using transport transforms for data analysis and machine learning

Sampling the flow of a bandlimited function

The Signed Cumulative Distribution Transform for 1-D Signal Analysis and Classification

Dynamical sampling and systems from iterative actions of operators

Exact Reconstruction of Spatially Undersampled Signals in Evolutionary Systems

Nearness to Local Subspace Algorithm for Subspace and Motion Segmentation

A Dimension Reduction Scheme for the Computation of Optimal Unions of Subspaces

On the existence of Optimal Subspace Clustering Models

Uncertainty Principles and Balian-Low type Theorems in Principal Shift-Invariant Spaces

Invariance of a Shift-Invariant Space

See the researcher in context

Building this map preview