BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Zoltan Szabo

Zoltan Szabo appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.GTmath.SGMachine Learningmath.STStatistics TheoryInformation Theorymath.FAmath.ITMethodologyComputation and LanguageComputer Visionmath.COmath.DSmath.OCmath.QA

Catalog footprint

What is connected

35works
15topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

35 published item(s)

preprint2022arXiv

Functional Output Regression with Infimal Convolution: Exploring the Huber and $ε$-insensitive Losses

The focus of the paper is functional output regression (FOR) with convoluted losses. While most existing work consider the square loss setting, we leverage extensions of the Huber and the $ε$-insensitive loss (induced by infimal convolution) and propose a flexible framework capable of handling various forms of outliers and sparsity in the FOR family. We derive computationally tractable algorithms relying on duality to tackle the resulting tasks in the context of vector-valued reproducing kernel Hilbert spaces. The efficiency of the approach is demonstrated and contrasted with the classical squared loss setting on both synthetic and real-world benchmarks.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

An Adaptive Test of Independence with Analytic Kernel Embeddings

A new computationally efficient dependence measure, and an adaptive statistical test of independence, are proposed. The dependence measure is the difference between analytic embeddings of the joint distribution and the product of the marginals, evaluated at a finite set of locations (features). These features are chosen so as to maximize a lower bound on the test power, resulting in a test that is data-efficient, and that runs in linear time (with respect to the sample size n). The optimized features can be interpreted as evidence to reject the null hypothesis, indicating regions in the joint domain where the joint distribution and the product of the marginals differ most. Consistency of the independence test is established, for an appropriate choice of features. In real-world benchmarks, independence tests using the optimized features perform comparably to the state-of-the-art quadratic-time HSIC test, and outperform competing O(n) and O(n log n) tests.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Interpretable Distribution Features with Maximum Testing Power

Two semimetrics on probability distributions are proposed, given as the sum of differences of expectations of analytic functions evaluated at spatial or frequency locations (i.e, features). The features are chosen so as to maximize the distinguishability of the distributions, by optimizing a lower bound on test power for a statistical test using these features. The result is a parsimonious and interpretable indication of how and where two distributions differ locally. An empirical estimate of the test power criterion converges with increasing sample size, ensuring the quality of the returned features. In real-world benchmarks on high-dimensional text and image data, linear-time tests using the proposed semimetrics achieve comparable performance to the state-of-the-art quadratic-time maximum mean discrepancy test, while returning human-interpretable features that explain the test results.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Learning Theory for Distribution Regression

We focus on the distribution regression problem: regressing to vector-valued outputs from probability measures. Many important machine learning and statistical tasks fit into this framework, including multi-instance learning and point estimation problems without analytical solution (such as hyperparameter or entropy estimation). Despite the large number of available heuristics in the literature, the inherent two-stage sampled nature of the problem makes the theoretical analysis quite challenging, since in practice only samples from sampled distributions are observable, and the estimates have to rely on similarities computed between sets of points. To the best of our knowledge, the only existing technique with consistency guarantees for distribution regression requires kernel density estimation as an intermediate step (which often performs poorly in practice), and the domain of the distributions to be compact Euclidean. In this paper, we study a simple, analytically computable, ridge regression-based alternative to distribution regression, where we embed the distributions to a reproducing kernel Hilbert space, and learn the regressor from the embeddings to the outputs. Our main contribution is to prove that this scheme is consistent in the two-stage sampled setup under mild conditions (on separable topological domains enriched with kernels): we present an exact computational-statistical efficiency trade-off analysis showing that our estimator is able to match the one-stage sampled minimax optimal rate [Caponnetto and De Vito, 2007; Steinwart et al., 2009]. This result answers a 17-year-old open question, establishing the consistency of the classical set kernel [Haussler, 1999; Gaertner et. al, 2002] in regression. We also cover consistency for more recent kernels on distributions, including those due to [Christmann and Steinwart, 2010].

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Bayesian Manifold Learning: The Locally Linear Latent Variable Model (LL-LVM)

We introduce the Locally Linear Latent Variable Model (LL-LVM), a probabilistic model for non-linear manifold discovery that describes a joint distribution over observations, their manifold coordinates and locally linear maps conditioned on a set of neighbourhood relationships. The model allows straightforward variational optimisation of the posterior distribution on coordinates and locally linear maps from the latent space to the observation space given the data. Thus, the LL-LVM encapsulates the local-geometry preserving intuitions that underlie non-probabilistic methods such as locally linear embedding (LLE). Its probabilistic semantics make it easy to evaluate the quality of hypothesised neighbourhood relationships, select the intrinsic dimensionality of the manifold, construct out-of-sample extensions and to combine the manifold model with additional probabilistic models that capture the structure of coordinates within the manifold.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Gradient-free Hamiltonian Monte Carlo with Efficient Kernel Exponential Families

We propose Kernel Hamiltonian Monte Carlo (KMC), a gradient-free adaptive MCMC algorithm based on Hamiltonian Monte Carlo (HMC). On target densities where classical HMC is not an option due to intractable gradients, KMC adaptively learns the target's gradient structure by fitting an exponential family model in a Reproducing Kernel Hilbert Space. Computational costs are reduced by two novel efficient approximations to this gradient. While being asymptotically exact, KMC mimics HMC in terms of sampling efficiency, and offers substantial mixing improvements over state-of-the-art gradient free samplers. We support our claims with experimental studies on both toy and real-world applications, including Approximate Bayesian Computation and exact-approximate MCMC.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Optimal Rates for Random Fourier Features

Kernel methods represent one of the most powerful tools in machine learning to tackle problems expressed in terms of function values and derivatives due to their capability to represent and model complex relations. While these methods show good versatility, they are computationally intensive and have poor scalability to large data as they require operations on Gram matrices. In order to mitigate this serious computational limitation, recently randomized constructions have been proposed in the literature, which allow the application of fast linear algorithms. Random Fourier features (RFF) are among the most popular and widely applied constructions: they provide an easily computable, low-dimensional feature representation for shift-invariant kernels. Despite the popularity of RFFs, very little is understood theoretically about their approximation quality. In this paper, we provide a detailed finite-sample theoretical analysis about the approximation quality of RFFs by (i) establishing optimal (in terms of the RFF dimension, and growing set size) performance guarantees in uniform norm, and (ii) presenting guarantees in $L^r$ ($1\le r<\infty$) norms. We also propose an RFF approximation to derivatives of a kernel with a theoretical study on its approximation quality.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Two-stage Sampled Learning Theory on Distributions

We focus on the distribution regression problem: regressing to a real-valued response from a probability distribution. Although there exist a large number of similarity measures between distributions, very little is known about their generalization performance in specific learning tasks. Learning problems formulated on distributions have an inherent two-stage sampled difficulty: in practice only samples from sampled distributions are observable, and one has to build an estimate on similarities computed between sets of points. To the best of our knowledge, the only existing method with consistency guarantees for distribution regression requires kernel density estimation as an intermediate step (which suffers from slow convergence issues in high dimensions), and the domain of the distributions to be compact Euclidean. In this paper, we provide theoretical guarantees for a remarkably simple algorithmic alternative to solve the distribution regression problem: embed the distributions to a reproducing kernel Hilbert space, and learn a ridge regressor from the embeddings to the outputs. Our main contribution is to prove the consistency of this technique in the two-stage sampled setting under mild conditions (on separable, topological domains endowed with kernels). For a given total number of observations, we derive convergence rates as an explicit function of the problem difficulty. As a special case, we answer a 15-year-old open question: we establish the consistency of the classical set kernel [Haussler, 1999; Gartner et. al, 2002] in regression, and cover more recent kernels on distributions, including those due to [Christmann and Steinwart, 2010].

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Unoriented knot Floer homology and the unoriented four-ball genus

In an earlier work, we introduced a family of t-modified knot Floer homologies, defined by modifying the construction of knot Floer homology HFK-minus. The resulting groups were then used to define concordance homomorphisms indexed by t in [0,2]. In the present work we elaborate on the special case t=1, and call the corresponding modified knot Floer homology the unoriented knot Floer homology. Using elementary methods (based on grid diagrams and normal forms for surface cobordisms), we show that the resulting concordance homomorphism gives a lower bound for the smooth 4-dimensional crosscap number of a knot K --- the minimal first Betti number of a smooth (possibly non-orientable) surface in the 4-disk that meets the boundary 3-sphere along the given knot K.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Information Theoretical Estimators Toolbox

We present ITE (information theoretical estimators) a free and open source, multi-platform, Matlab/Octave toolbox that is capable of estimating many different variants of entropy, mutual information, divergence, association measures, cross quantities, and kernels on distributions. Thanks to its highly modular design, ITE supports additionally (i) the combinations of the estimation techniques, (ii) the easy construction and embedding of novel information theoretical estimators, and (iii) their immediate application in information theoretical optimization problems. ITE also includes a prototype application in a central problem class of signal processing, independent subspace analysis and its extensions.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Emotional Expression Classification using Time-Series Kernels

Estimation of facial expressions, as spatio-temporal processes, can take advantage of kernel methods if one considers facial landmark positions and their motion in 3D space. We applied support vector classification with kernels derived from dynamic time-warping similarity measures. We achieved over 99% accuracy - measured by area under ROC curve - using only the 'motion pattern' of the PCA compressed representation of the marker point vector, the so-called shape parameters. Beyond the classification of full motion patterns, several expressions were recognized with over 90% accuracy in as few as 5-6 frames from their onset, about 200 milliseconds.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Automated Word Puzzle Generation via Topic Dictionaries

We propose a general method for automated word puzzle generation. Contrary to previous approaches in this novel field, the presented method does not rely on highly structured datasets obtained with serious human annotation effort: it only needs an unstructured and unannotated corpus (i.e., document collection) as input. The method builds upon two additional pillars: (i) a topic model, which induces a topic dictionary from the input corpus (examples include e.g., latent semantic analysis, group-structured dictionaries or latent Dirichlet allocation), and (ii) a semantic similarity measure of word pairs. Our method can (i) generate automatically a large number of proper word puzzles of different types, including the odd one out, choose the related word and separate the topics puzzle. (ii) It can easily create domain-specific puzzles by replacing the corpus component. (iii) It is also capable of automatically generating puzzles with parameterizable levels of difficulty suitable for, e.g., beginners or intermediate learners.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Collaborative Filtering via Group-Structured Dictionary Learning

Structured sparse coding and the related structured dictionary learning problems are novel research areas in machine learning. In this paper we present a new application of structured dictionary learning for collaborative filtering based recommender systems. Our extensive numerical experiments demonstrate that the presented technique outperforms its state-of-the-art competitors and has several advantages over approaches that do not put structured constraints on the dictionary elements.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Distributed High Dimensional Information Theoretical Image Registration via Random Projections

Information theoretical measures, such as entropy, mutual information, and various divergences, exhibit robust characteristics in image registration applications. However, the estimation of these quantities is computationally intensive in high dimensions. On the other hand, consistent estimation from pairwise distances of the sample points is possible, which suits random projection (RP) based low dimensional embeddings. We adapt the RP technique to this task by means of a simple ensemble method. To the best of our knowledge, this is the first distributed, RP based information theoretical image registration approach. The efficiency of the method is demonstrated through numerical examples.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

On combinatorial link Floer homology

Link Floer homology is an invariant for links defined using a suitable version of Lagrangian Floer homology. In an earlier paper, this invariant was given a combinatorial description with mod 2 coefficients. In the present paper, we give a self-contained presentation of the basic properties of link Floer homology, including an elementary proof of its invariance. We also fix signs for the differentials, so that the theory is defined with integer coefficients.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Towards Nonstationary, Nonparametric Independent Process Analysis with Unknown Source Component Dimensions

The goal of this paper is to extend independent subspace analysis (ISA) to the case of (i) nonparametric, not strictly stationary source dynamics and (ii) unknown source component dimensions. We make use of functional autoregressive (fAR) processes to model the temporal evolution of the hidden sources. An extension of the ISA separation principle--which states that the ISA problem can be solved by traditional independent component analysis (ICA) and clustering of the ICA elements--is derived for the solution of the defined fAR independent process analysis task (fAR-IPA): applying fAR identification we reduce the problem to ISA. A local averaging approach, the Nadaraya-Watson kernel regression technique is adapted to obtain strongly consistent fAR estimation. We extend the Amari-index to different dimensional components and illustrate the efficiency of the fAR-IPA approach by numerical examples.

0 citations0 reviewsNo code linkedOpen access
preprint2007arXiv

Independent Process Analysis without A Priori Dimensional Information

Recently, several algorithms have been proposed for independent subspace analysis where hidden variables are i.i.d. processes. We show that these methods can be extended to certain AR, MA, ARMA and ARIMA tasks. Central to our paper is that we introduce a cascade of algorithms, which aims to solve these tasks without previous knowledge about the number and the dimensions of the hidden processes. Our claim is supported by numerical simulations. As a particular application, we search for subspaces of facial components.

0 citations0 reviewsNo code linkedOpen access
preprint2007arXiv

Odd Khovanov homology

We describe an invariant of links in the three-sphere which is closely related to Khovanov's Jones polynomial homology. Our construction replaces the symmetric algebra appearing in Khovanov's definition with an exterior algebra. The two invariants have the same reduction modulo 2, but differ over the rationals. There is a reduced version which is a link invariant whose graded Euler characteristic is the normalized Jones polynomial.

0 citations0 reviewsNo code linkedOpen access
preprint2007arXiv

Undercomplete Blind Subspace Deconvolution via Linear Prediction

We present a novel solution technique for the blind subspace deconvolution (BSSD) problem, where temporal convolution of multidimensional hidden independent components is observed and the task is to uncover the hidden components using the observation only. We carry out this task for the undercomplete case (uBSSD): we reduce the original uBSSD task via linear prediction to independent subspace analysis (ISA), which we can solve. As it has been shown recently, applying temporal concatenation can also reduce uBSSD to ISA, but the associated ISA problem can easily become `high dimensional' [1]. The new reduction method circumvents this dimensionality problem. We perform detailed studies on the efficiency of the proposed technique by means of numerical simulations. We have found several advantages: our method can achieve high quality estimations for smaller number of samples and it can cope with deeper temporal convolutions.

0 citations0 reviewsNo code linkedOpen access
preprint2006arXiv

Real and Complex Independent Subspace Analysis by Generalized Variance

Here, we address the problem of Independent Subspace Analysis (ISA). We develop a technique that (i) builds upon joint decorrelation for a set of functions, (ii) can be related to kernel based techniques, (iii) can be interpreted as a self-adjusting, self-grouping neural network solution, (iv) can be used both for real and for complex problems, and (v) can be a first step towards large scale problems. Our numerical examples extend to a few 100 dimensional ISA tasks.

0 citations0 reviewsNo code linkedOpen access
preprint2005arXiv

Knot Floer homology and rational surgeries

Let $K$ be a rationally null-homologous knot in a three-manifold $Y$. We construct a version of knot Floer homology in this context, including a description of the Floer homology of a three-manifold obtained as Morse surgery on the knot $K$. As an application, we express the Heegaard Floer homology of rational surgeries on $Y$ along a null-homologous knot $K$ in terms of the filtered homotopy type of the knot invariant for $K$. This has applications to Dehn surgery problems for knots in $S^3$. In a different direction, we use the techniques developed here to calculate the Heegaard Floer homology of an arbitrary Seifert fibered three-manifold.

0 citations0 reviewsNo code linkedOpen access
preprint2004arXiv

Holomorphic disks and genus bounds

We prove that, like the Seiberg-Witten monopole homology, the Heegaard Floer homology for a three-manifold determines its Thurston norm. As a consequence, we show that knot Floer homology detects the genus of a knot. This leads to new proofs of certain results previously obtained using Seiberg-Witten monopole Floer homology (in collaboration with Kronheimer and Mrowka). It also leads to a purely Morse-theoretic interpretation of the genus of a knot. The method of proof shows that the canonical element of Heegaard Floer homology associated to a weakly symplectically fillable contact structure is non-trivial. In particular, for certain three-manifolds, Heegaard Floer homology gives obstructions to the existence of taut foliations.

0 citations0 reviewsNo code linkedOpen access
preprint2003arXiv

Heegaard Floer homology and alternating knots

In an earlier paper, we introduced a knot invariant for a null-homologous knot K in an oriented three-manifold Y, which is closely related to the Heegaard Floer homology of Y. In this paper we investigate some properties of these knot homology groups for knots in the three-sphere. We give a combinatorial description for the generators of the chain complex and their gradings. With the help of this description, we determine the knot homology for alternating knots, showing that in this special case, it depends only on the signature and the Alexander polynomial of the knot (generalizing a result of Rasmussen for two-bridge knots). Applications include new restrictions on the Alexander polynomial of alternating knots.

0 citations0 reviewsNo code linkedOpen access
preprint2003arXiv

Knot Floer homology and the four-ball genus

We use the knot filtration on the Heegaard Floer complex to define an integer invariant tau(K) for knots. Like the classical signature, this invariant gives a homomorphism from the knot concordance group to Z. As such, it gives lower bounds for the slice genus (and hence also the unknotting number) of a knot; but unlike the signature, tau gives sharp bounds on the four-ball genera of torus knots. As another illustration, we calculate the invariant for several ten-crossing knots.

0 citations0 reviewsNo code linkedOpen access