Researcher profile

Velimir M. Ilic

Velimir M. Ilic contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
9works
0followers
7topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

9 published item(s)

preprint2019arXiv

On the equivalence between four versions of thermostatistics based on strongly pseudo-additive entropies

The class of SPA entropies, which can be represented as an increasing continuous transformation of Shannon and Rényi entropies, have intensively been studied in previous decades. Although their mathematical structure has thoroughly been explored and established by GSK axioms, the analysis of their thermostatistical properties have mostly been limited to special cases which belong to two parameter Sharma-Mittal entropy class, such as Tsallis, Renyi and Gaussian entropies. In this paper we present a general analysis of SPA entropies thermostatistics by taking into account both linear and escort constraints on internal energy. We develop two types of dualities between the thermostatistics formalisms. By the first one, the formalism of Rényi entropy is transformed in the formalism of SPA entropy under general energy constraint and, by the second one, the generalized thermostatistics which corresponds to the linear constraint is transformed into the one which corresponds to the escort constraint. Thus, we establish the equivalence between four different thermostatistics formalisms based on Rényi and SPA entropies coupled with linear and escort constraints and we provide the transformation formulas. In this way we obtain a general framework which is applicable to the wide class of entropies and constraints previously discussed in the literature. As an example, we rederive maximum entropy distributions for Sharma-Mittal entropy and we establish new relationships between the corresponding thermodynamic potentials. We obtain, as special cases, previously developed expressions for maximum entropy distributions and thermodynamic quantities for Tsallis, Rényi and Gaussian entropies. In addition, the results are applied for derivation of thermostatistical relationships for supra-extensive entropy, which has not previously been considered.

preprint2013arXiv

Comments on "A two-parameter generalization of Shannon-Khinchin Axioms and the uniqueness theorem"

Wada and Suyari proposed a two-parameter generalization of Shannon-Khinchin axioms (TGSK axioms) [T. Wada and H. Suyari, Physics Letters A, 368(3)]. We derive a new class of entropies which differs from Wada-Suyari's class by fixing the incorrectness which occurs in the mentioned paper. Also, we consider a two-parameter class of entropies derived from the maxent principle proposed in [Kaniadakis, G. and Lissia, M. and Scarfone, AM, Physica A: Statistical Mechanics and its Applications, 340(1)]. We rederived this class by changing initial condition, obtaining the same class as our class derived from TGSK axioms.

preprint2013arXiv

Cross-moments computation for stochastic context-free grammars

In this paper we consider the problem of efficient computation of cross-moments of a vector random variable represented by a stochastic context-free grammar. Two types of cross-moments are discussed. The sample space for the first one is the set of all derivations of the context-free grammar, and the sample space for the second one is the set of all derivations which generate a string belonging to the language of the grammar. In the past, this problem was widely studied, but mainly for the cross-moments of scalar variables and up to the second order. This paper presents new algorithms for computing the cross-moments of an arbitrary order, and the previously developed ones are derived as special cases.

preprint2012arXiv

Comments on "Generalization of Shannon-Khinchin axioms to nonextensive systems and the uniqueness theorem for the nonextensive entropy"

Recently, Suyari has proposed a generalization of Shannon-Khinchin axioms, which determines a class of entropies containing the well-known Tsalis and Havrda-Charvat entropies [H. Suyari, IEEE Trans. Inf. Theory, vol. 50, pp. 1783-1787, Aug. 2004]. In this comment we show that the class of entropy functions determined by Suyari's axioms is wider than the one proposed by Suyari and give a counterexample. Additionally, we generalize Suyari's axioms characterizing recently introduced class of entropies obtained by averaging pseudoadditive information content introduced in [V. Ilic and M. Stankovic, "Comments on "Nonextensive Entropies derived from Form Invariance of Pseudoadditivity"" Submited, 2012].

preprint2012arXiv

Comments on "Nonextensive Entropies derived from Form Invariance of Pseudoadditivity"

Recently, Suyari has defined nonextensive information content measure with unique class of functions which satisfies certain set of axioms. Nonextensive entropy is then defined as the appropriate expectation value of nonextensive information content [H. Suyari, Phys. Rev E 65 066118 (2002)]. In this comment we show that the class of functions determined by Suyari's axioms is actually wider than the one given by Suyari and we determine the class. Particularly, an information content corresponding to Havrda-Charvat entropy satisfies Suyari's axioms and does not belong to the class given by Suyari but belongs to our class. Moreover, some of the conditions from Suyari's set of axioms are redundant, and some of them can be replaced with more intuitive weaker ones. We give a modification of Suyari's axiomatic system with these weaker assumptions and define the corresponding information content measure.

preprint2012arXiv

Gradient Computation In Linear-Chain Conditional Random Fields Using The Entropy Message Passing Algorithm

The paper proposes a numerically stable recursive algorithm for the exact computation of the linear-chain conditional random field gradient. It operates as a forward algorithm over the log-domain expectation semiring and has the purpose of enhancing memory efficiency when applied to long observation sequences. Unlike the traditional algorithm based on the forward-backward recursions, the memory complexity of our algorithm does not depend on the sequence length. The experiments on real data show that it can be useful for the problems which deal with long sequences.

preprint2012arXiv

The computation of first order moments on junction trees

We review some existing methods for the computation of first order moments on junction trees using Shafer-Shenoy algorithm. First, we consider the problem of first order moments computation as vertices problem in junction trees. In this way, the problem is solved using the memory space of an order of the junction tree edge-set cardinality. After that, we consider two algorithms, Lauritzen-Nilsson algorithm, and Mauá et al. algorithm, which computes the first order moments as the normalization problem in junction tree, using the memory space of an order of the junction tree leaf-set cardinality.

preprint2011arXiv

Entropy Semiring Forward-backward Algorithm for HMM Entropy Computation

The paper presents Entropy Semiring Forwardbackward algorithm (ESRFB) and its application for memory efficient computation of the subsequence constrained entropy and state sequence entropy of a Hidden Markov Model (HMM) when an observation sequence is given. ESRFB is based on forward-backward recursion over the entropy semiring, having the lower memory requirement than the algorithm developed by Mann and MacCallum, with the same time complexity. Furthermore, when it is used with forward pass only, it is applicable for the computation of HMM entropy for a given observation sequence, with the same time and memory complexity as the previously developed algorithm by Hernando et al