BZPEERPapers, people, evidence and research pathsDiscover
Research tools
Network
Opportunities
Account
Source author record
Myung-Sin Song appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.
Catalog footprint
Research graph
Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.
BZPEER is loading the nearby papers, people, topics and institutions for this page.
Published work
In this paper we show how specific families of positive definite kernels serve as powerful tools in analyses of iteration algorithms for multiple layer feedforward Neural Network models. Our focus is on particular kernels that adapt well to learning algorithms for data-sets/features which display intrinsic self-similarities at feedforward iterations of scaling.
We study non-linear data-dimension reduction. We are motivated by the classical linear framework of Principal Component Analysis. In nonlinear case, we introduce instead a new kernel-Principal Component Analysis, manifold and feature space transforms. Our results extend earlier work for probabilistic Karhunen-Loève transforms on compression of wavelet images. Our object is algorithms for optimization, selection of efficient bases, or components, which serve to minimize entropy and error; and hence to improve digital representation of images, and hence of optimal storage, and transmission. We prove several new theorems for data-dimension reduction. Moreover, with the use of frames in Hilbert space, and a new Hilbert-Schmidt analysis, we identify when a choice of Gaussian kernel is optimal.
We study certain infinite-dimensional probability measures in connection with frame analysis. Earlier work on frame-measures has so far focused on the case of finite-dimensional frames. We point out that there are good reasons for a sharp distinction between stochastic analysis involving frames in finite vs infinite dimensions. For the case of infinite-dimensional Hilbert space $\mathcal{H}$, we study three cases of measures. We first show that, for $\mathcal{H}$ infinite dimensional, 1 one must resort to infinite dimensional measure spaces which properly contain $\mathcal{H}$. The three cases we consider are: (i) Gaussian frame measures, (ii) Markov path-space measures, and (iii) determinantal measures.
We consider conditions on a given system $\mathcal{F}$ of vectors in Hilbert space $\mathcal{H}$, forming a frame, which turn $\mathcal{H}$ into a reproducing kernel Hilbert space. It is assumed that the vectors in $\mathcal{F}$ are functions on some set $Ω$. We then identify conditions on these functions which automatically give $\mathcal{H}$ the structure of a reproducing kernel Hilbert space of functions on $Ω$. We further give an explicit formula for the kernel, and for the corresponding isometric isomorphism. Applications are given to Hilbert spaces associated to families of Gaussian processes.
We give a number of explicit matrix-algorithms for analysis/synthesis in multi-phase filtering; i.e., the operation on discrete-time signals which allow a separation into frequency-band components, one for each of the ranges of bands, say $N$, starting with low-pass, and then corresponding filtering in the other band-ranges. If there are $N$ bands, the individual filters will be combined into a single matrix action; so a representation of the combined operation on all $N$ bands by an $N \times N$ matrix, where the corresponding matrix-entries are periodic functions; or their extensions to functions of a complex variable. Hence our setting entails a fixed $N \times N$ matrix over a prescribed algebra of functions of a complex variable. In the case of polynomial filters, the factorizations will always be finite. A novelty here is that we allow for a wide family of non-polynomial filter-banks. Working modulo $N$ in the time domain, our approach also allows for a natural matrix-representation of both down-sampling and up-sampling. The implementation encompasses the combined operation on input, filtering, down-sampling, transmission, up-sampling, an action by dual filters, and synthesis, merges into a single matrix operation. Hence our matrix-factorizations break down the global filtering-process into elementary steps. To accomplish this, we offer a number of adapted matrix factorization-algorithms, such that each factor in our product representation implements in a succession of steps the filtering across pairs of frequency-bands; and so it is of practical significance in implementing signal processing, including filtering of digitized images. Our matrix-factorizations are especially useful in the case of the processing a fixed, but large, number of bands.
We show how some orthonormal bases can be generated by representations of the Cuntz algebra; these include Fourier bases on fractal measures, generalized Walsh bases on the unit interval and piecewise exponential bases on the middle third Cantor set.
With the use of tensor product of Hilbert space, and a diagonalization procedure from operator theory, we derive an approximation formula for a general class of stochastic integrals. Further we establish a generalized Fourier expansion for these stochastic integrals. In our extension, we circumvent some of the limitations of the more widely used stochastic integral due to Wiener and Ito, i.e., stochastic integration with respect to Brownian motion. Finally we discuss the connection between the two approaches, as well as a priori estimates and applications.
In this paper we outline several points of view on the interplay between discrete and continuous wavelet transforms; stressing both pure and applied aspects of both. We outline some new links between the two transform technologies based on the theory of representations of generators and relations. By this we mean a finite system of generators which are represented by operators in Hilbert space. We further outline how these representations yield sub-band filter banks for signal and image processing algorithms.