Source author record

Armenak Petrosyan

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

Machine Learning math.FA math.OC

Catalog footprint

Research overview

3works

3topics

4close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2022arXiv

Nonconvex regularization for sparse neural networks

Convex $\ell_1$ regularization using an infinite dictionary of neurons has been suggested for constructing neural networks with desired approximation guarantees, but can be affected by an arbitrary amount of over-parametrization. This can lead to a loss of sparsity and result in networks with too many active neurons for the given data, in particular if the number of data samples is large. As a remedy, in this paper, a nonconvex regularization method is investigated in the context of shallow ReLU networks: We prove that in contrast to the convex approach, any resulting (locally optimal) network is finite even in the presence of infinite data (i.e., if the data distribution is known and the limiting case of infinite samples is considered). Moreover, we show that approximation guarantees and existing bounds on the network size for finite data are maintained.

preprint2020arXiv

Neural network integral representations with the ReLU activation function

In this effort, we derive a formula for the integral representation of a shallow neural network with the ReLU activation function. We assume that the outer weighs admit a finite $L_1$ -norm with respect to Lebesgue measure on the sphere. For univariate target functions we further provide a closed-form formula for all possible representations. Additionally, in this case our formula allows one to explicitly solve the least $L_1$ -norm neural network representation for a given function.

preprint2016arXiv

Dynamical sampling and systems from iterative actions of operators

We review some of the recent developments and prove new results concerning frames and Bessel systems generated by iterations of the form $\{A^ng: g\in G,\, n=0,1,2,\dots \}$ , where $A$ is a bounded linear operators on a separable complex Hilbert space $\mathcal{H}$ and $G$ is a countable set of vectors in $\mathcal{H}$ . The system of iterations mentioned above was motivated from the so called dynamical sampling problem. In dynamical sampling, an unknown function $f$ and its future states $A^nf$ are coarsely sampled at each time level $n$ , $0\leq n< L$ , where $A$ is an evolution operator that drives the system. The goal is to recover $f$ from these space-time samples.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.