Source author record

João M. Pereira

João M. Pereira appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Machine Learning math.FA math.NA Numerical Analysis

Catalog footprint

What is connected

4works

4topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2022arXiv

Tensor Moments of Gaussian Mixture Models: Theory and Applications

Gaussian mixture models (GMMs) are fundamental tools in statistical and data sciences. We study the moments of multivariate Gaussians and GMMs. The $d$-th moment of an $n$-dimensional random variable is a symmetric $d$-way tensor of size $n^d$, so working with moments naively is assumed to be prohibitively expensive for $d>2$ and larger values of $n$. In this work, we develop theory and numerical methods for \emph{implicit computations} with moment tensors of GMMs, reducing the computational and storage costs to $\mathcal{O}(n^2)$ and $\mathcal{O}(n^3)$, respectively, for general covariance matrices, and to $\mathcal{O}(n)$ and $\mathcal{O}(n)$, respectively, for diagonal ones. We derive concise analytic expressions for the moments in terms of symmetrized tensor products, relying on the correspondence between symmetric tensors and homogeneous polynomials, and combinatorial identities involving Bell polynomials. The primary application of this theory is to estimating GMM parameters (means and covariances) from a set of observations, when formulated as a moment-matching optimization problem. If there is a known and common covariance matrix, we also show it is possible to debias the data observations, in which case the problem of estimating the unknown means reduces to symmetric CP tensor decomposition. Numerical results validate and illustrate the numerical efficiency of our approaches. This work potentially opens the door to the competitiveness of the method of moments as compared to expectation maximization methods for parameter estimation of GMMs.

preprint2020arXiv

Robust Marine Buoy Placement for Ship Detection Using Dropout K-Means

Marine buoys aid in the battle against Illegal, Unreported and Unregulated (IUU) fishing by detecting fishing vessels in their vicinity. Marine buoys, however, may be disrupted by natural causes and buoy vandalism. In this paper, we formulate marine buoy placement as a clustering problem, and propose dropout k-means and dropout k-median to improve placement robustness to buoy disruption. We simulated the passage of ships in the Gabonese waters near West Africa using historical Automatic Identification System (AIS) data, then compared the ship detection probability of dropout k-means to classic k-means and dropout k-median to classic k-median. With 5 buoys, the buoy arrangement computed by classic k-means, dropout k-means, classic k-median and dropout k-median have ship detection probabilities of 38%, 45%, 48% and 52%.

preprint2015arXiv

Pseudo prolate spheroidal functions

Let $D_{T}$ and $B_{Ω}$ denote the operators which cut the time content outside $T$ and the frequency content outside $Ω$, respectively. The prolate spheroidal functions are the eigenfunctions of the operator $P_{T,Ω}=D_{T}B_{Ω}D_{T}$. With the aim of formulating in precise mathematical terms the notion of Nyquist rate, Landau and Pollack have shown that, asymptotically, the number of such functions with eigenvalue close to one is $\approx \frac{\left\vert T\right\vert \left\vert Ω\right\vert }{2π}$. We have recently revisited this problem with a new approach: instead of counting the number of eigenfunctions with eigenvalue close to one, we count the maximum number of orthogonal $ε$-pseudoeigenfunctions with $ε$-pseudoeigenvalue one. Precisely, we count how many orthogonal functions have a maximum of energy $ε$ outside the domain $T\times Ω$, in the sense that $\left\Vert P_{T,Ω}f-f\right\Vert ^{2}\leq ε$. We have recently discovered that the sharp asymptotic number is $\approx (1-ε)^{-1}\frac{\left\vert T\right\vert \left\vert Ω\right\vert }{2π}$. The proof involves an explicit construction of the pseudoeigenfunctions of $P_{T,Ω}$. When $T$ and $Ω$ are intervals we call them pseudo prolate spheroidal functions. In this paper we explain how they are constructed.

preprint2014arXiv

Measures of localization and quantitative Nyquist densities

We obtain a refinement of the degrees of freedom estimate of Landau and Pollak. More precisely, we estimate, in terms of $ε$, the increase in the degrees of freedom resulting upon allowing the functions to contain a certain prescribed amount of energy $ε$ outside a region delimited by a set $T$ in time and a set $Ω$ in frequency. In this situation, the lower asymptotic Nyquist density $\vert T\vert \vert Ω\vert /2π$ is increased to $(1+ε)\vert T\vert \vert Ω\vert /2π$. At the technical level, we prove a pseudospectra version of the classical spectral dimension result of Landau and Pollak, in the multivariate setting of Landau. Analogous results are obtained for Gabor localization operators in a compact region of the time-frequency plane.