BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Velimir M. Ilic

Velimir M. Ilic appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math-phmath.MPInformation Theorymath.ITArtificial IntelligenceComputation and Languagecond-mat.stat-mechMachine Learning

Catalog footprint

What is connected

13works
8topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

13 published item(s)

preprint2019arXiv

On the equivalence between four versions of thermostatistics based on strongly pseudo-additive entropies

The class of SPA entropies, which can be represented as an increasing continuous transformation of Shannon and Rényi entropies, have intensively been studied in previous decades. Although their mathematical structure has thoroughly been explored and established by GSK axioms, the analysis of their thermostatistical properties have mostly been limited to special cases which belong to two parameter Sharma-Mittal entropy class, such as Tsallis, Renyi and Gaussian entropies. In this paper we present a general analysis of SPA entropies thermostatistics by taking into account both linear and escort constraints on internal energy. We develop two types of dualities between the thermostatistics formalisms. By the first one, the formalism of Rényi entropy is transformed in the formalism of SPA entropy under general energy constraint and, by the second one, the generalized thermostatistics which corresponds to the linear constraint is transformed into the one which corresponds to the escort constraint. Thus, we establish the equivalence between four different thermostatistics formalisms based on Rényi and SPA entropies coupled with linear and escort constraints and we provide the transformation formulas. In this way we obtain a general framework which is applicable to the wide class of entropies and constraints previously discussed in the literature. As an example, we rederive maximum entropy distributions for Sharma-Mittal entropy and we establish new relationships between the corresponding thermodynamic potentials. We obtain, as special cases, previously developed expressions for maximum entropy distributions and thermodynamic quantities for Tsallis, Rényi and Gaussian entropies. In addition, the results are applied for derivation of thermostatistical relationships for supra-extensive entropy, which has not previously been considered.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Comments on "On q-non-extensive statistics with non-Tsallisian entropy"

Recently, in [P. Jizba and J. Korbel, Physica A 444, 2016, 808-827], four generalized Shannon-Khinchin [GSK] axioms have been proposed and a generalized entropy which uniquely satisfies the GSK axioms has been derived. In this comment, we show that the unique class of the entropies derived in the aforementioned paper is not correct, as it violates the fourth GSK axiom, and we derive the correct one. Nevertheless, the class of entropies proposed in the commented paper still can serve as a basis for generalized statistical mechanics. We propose a new axiomatic system which characterizes the class of entropies.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

A unified characterization of generalized information and certainty measures

In this paper we consider the axiomatic characterization of information and certainty measures in a unified way. We present the general axiomatic system which captures the common properties of a large number of the measures previously considered by numerous authors. We provide the corresponding characterization theorems and define a new generalized measure called the Inforcer, which is the quasi-linear mean of the function associated to the event probability following the general composition law. In particular, we pay attention to the polynomial composition and the corresponding polynomially composable Inforcer measure. The most common measures appearing in literature can be obtained by specific choice of parameters appearing in our generic measures and they are listed in tables.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Comments on "A two-parameter generalization of Shannon-Khinchin Axioms and the uniqueness theorem"

Wada and Suyari proposed a two-parameter generalization of Shannon-Khinchin axioms (TGSK axioms) [T. Wada and H. Suyari, Physics Letters A, 368(3)]. We derive a new class of entropies which differs from Wada-Suyari's class by fixing the incorrectness which occurs in the mentioned paper. Also, we consider a two-parameter class of entropies derived from the maxent principle proposed in [Kaniadakis, G. and Lissia, M. and Scarfone, AM, Physica A: Statistical Mechanics and its Applications, 340(1)]. We rederived this class by changing initial condition, obtaining the same class as our class derived from TGSK axioms.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Cross-moments computation for stochastic context-free grammars

In this paper we consider the problem of efficient computation of cross-moments of a vector random variable represented by a stochastic context-free grammar. Two types of cross-moments are discussed. The sample space for the first one is the set of all derivations of the context-free grammar, and the sample space for the second one is the set of all derivations which generate a string belonging to the language of the grammar. In the past, this problem was widely studied, but mainly for the cross-moments of scalar variables and up to the second order. This paper presents new algorithms for computing the cross-moments of an arbitrary order, and the previously developed ones are derived as special cases.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Comments on "Generalization of Shannon-Khinchin axioms to nonextensive systems and the uniqueness theorem for the nonextensive entropy"

Recently, Suyari has proposed a generalization of Shannon-Khinchin axioms, which determines a class of entropies containing the well-known Tsalis and Havrda-Charvat entropies [H. Suyari, IEEE Trans. Inf. Theory, vol. 50, pp. 1783-1787, Aug. 2004]. In this comment we show that the class of entropy functions determined by Suyari's axioms is wider than the one proposed by Suyari and give a counterexample. Additionally, we generalize Suyari's axioms characterizing recently introduced class of entropies obtained by averaging pseudoadditive information content introduced in [V. Ilic and M. Stankovic, "Comments on "Nonextensive Entropies derived from Form Invariance of Pseudoadditivity"" Submited, 2012].

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Comments on "Nonextensive Entropies derived from Form Invariance of Pseudoadditivity"

Recently, Suyari has defined nonextensive information content measure with unique class of functions which satisfies certain set of axioms. Nonextensive entropy is then defined as the appropriate expectation value of nonextensive information content [H. Suyari, Phys. Rev E 65 066118 (2002)]. In this comment we show that the class of functions determined by Suyari's axioms is actually wider than the one given by Suyari and we determine the class. Particularly, an information content corresponding to Havrda-Charvat entropy satisfies Suyari's axioms and does not belong to the class given by Suyari but belongs to our class. Moreover, some of the conditions from Suyari's set of axioms are redundant, and some of them can be replaced with more intuitive weaker ones. We give a modification of Suyari's axiomatic system with these weaker assumptions and define the corresponding information content measure.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Gradient Computation In Linear-Chain Conditional Random Fields Using The Entropy Message Passing Algorithm

The paper proposes a numerically stable recursive algorithm for the exact computation of the linear-chain conditional random field gradient. It operates as a forward algorithm over the log-domain expectation semiring and has the purpose of enhancing memory efficiency when applied to long observation sequences. Unlike the traditional algorithm based on the forward-backward recursions, the memory complexity of our algorithm does not depend on the sequence length. The experiments on real data show that it can be useful for the problems which deal with long sequences.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

The computation of first order moments on junction trees

We review some existing methods for the computation of first order moments on junction trees using Shafer-Shenoy algorithm. First, we consider the problem of first order moments computation as vertices problem in junction trees. In this way, the problem is solved using the memory space of an order of the junction tree edge-set cardinality. After that, we consider two algorithms, Lauritzen-Nilsson algorithm, and Mauá et al. algorithm, which computes the first order moments as the normalization problem in junction tree, using the memory space of an order of the junction tree leaf-set cardinality.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Entropy Semiring Forward-backward Algorithm for HMM Entropy Computation

The paper presents Entropy Semiring Forwardbackward algorithm (ESRFB) and its application for memory efficient computation of the subsequence constrained entropy and state sequence entropy of a Hidden Markov Model (HMM) when an observation sequence is given. ESRFB is based on forward-backward recursion over the entropy semiring, having the lower memory requirement than the algorithm developed by Mann and MacCallum, with the same time complexity. Furthermore, when it is used with forward pass only, it is applicable for the computation of HMM entropy for a given observation sequence, with the same time and memory complexity as the previously developed algorithm by Hernando et al

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Entropy Message Passing

The paper proposes a new message passing algorithm for cycle-free factor graphs. The proposed "entropy message passing" (EMP) algorithm may be viewed as sum-product message passing over the entropy semiring, which has previously appeared in automata theory. The primary use of EMP is to compute the entropy of a model. However, EMP can also be used to compute expressions that appear in expectation maximization and in gradient descent algorithms.

0 citations0 reviewsNo code linkedOpen access