Norm-Free Radon-Nikodym Approach to Machine Learning

preprint2015arXivOpen access

Abstract

For Machine Learning (ML) classification problem, where a vector of x\mathbf{x}--observations (values of attributes) is mapped to a single yy value (class label), a generalized Radon--Nikodym type of solution is proposed. Quantum--mechanics --like probability states ψ2(x)ψ^2(\mathbf{x}) are considered and "Cluster Centers", corresponding to the extremums of <yψ2(x)>/<ψ2(x)><yψ^2(\mathbf{x})>/<ψ^2(\mathbf{x})>, are found from generalized eigenvalues problem. The eigenvalues give possible y[i]y^{[i]} outcomes and corresponding to them eigenvectors ψ[i](x)ψ^{[i]}(\mathbf{x}) define "Cluster Centers". The projection of a ψψ state, localized at given x\mathbf{x} to classify, on these eigenvectors define the probability of y[i]y^{[i]} outcome, thus avoiding using a norm (L2L^2 or other types), required for "quality criteria" in a typical Machine Learning technique. A coverage of each `Cluster Center" is calculated, what potentially allows to separate system properties (described by y[i]y^{[i]} outcomes) and system testing conditions (described by C[i]C^{[i]} coverage). As an example of such application yy distribution estimator is proposed in a form of pairs (y[i],C[i])(y^{[i]},C^{[i]}), that can be considered as Gauss quadratures generalization. This estimator allows to perform yy probability distribution estimation in a strongly non--Gaussian case.

Explore this paper’s authors, topics and related work.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Reviews 0

Write a reviewWrite

No reviews yet.

Discussion 0

Add a commentWrite

No comments yet.