Source author record

Huihui Zhang

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

Artificial Intelligence Machine Learning math.CA math.CO math.FA

Catalog footprint

Research overview

3works

5topics

4close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2022arXiv

Bilinear integral operator on Morrey-Banach spaces and its application

In this paper, we give the definability of bilinear singular and fractional integral operators on Morrey-Banach space, as well as their commutators and we prove the boundedness of such operators on Morrey-Banach spaces. Moreover, the necessary condition for BMO via the bounedness of bilinear commutators on Morrey-Banach space is also given. As a application of our main results, we get the necessary conditions for BMO via the bounedness of bilinear integral operators on weighted Morrey space and Morrey space with variable exponents. Finally, we obtain the boundedness of bilinear C-Z operator on Morrey space with variable exponents.

preprint2020arXiv

Unbiased Deep Reinforcement Learning: A General Training Framework for Existing and Future Algorithms

In recent years deep neural networks have been successfully applied to the domains of reinforcement learning \cite{bengio2009learning,krizhevsky2012imagenet,hinton2006reducing}. Deep reinforcement learning \cite{mnih2015human} is reported to have the advantage of learning effective policies directly from high-dimensional sensory inputs over traditional agents. However, within the scope of the literature, there is no fundamental change or improvement on the existing training framework. Here we propose a novel training framework that is conceptually comprehensible and potentially easy to be generalized to all feasible algorithms for reinforcement learning. We employ Monte-carlo sampling to achieve raw data inputs, and train them in batch to achieve Markov decision process sequences and synchronously update the network parameters instead of experience replay. This training framework proves to optimize the unbiased approximation of loss function whose estimation exactly matches the real probability distribution data inputs follow, and thus have overwhelming advantages of sample efficiency and convergence rate over existing deep reinforcement learning after evaluating it on both discrete action spaces and continuous control problems. Besides, we propose several algorithms embedded with our new framework to deal with typical discrete and continuous scenarios. These algorithms prove to be far more efficient than their original versions under the framework of deep reinforcement learning, and provide examples for existing and future algorithms to generalize to our new framework.

preprint2012arXiv

On the spectral moment of graphs with $k$ cut edges

Let $A(G)$ be the adjacency matrix of a graph $G$ with $λ_{1}(G)$ , $λ_{2}(G)$ , ..., $λ_{n}(G)$ being its eigenvalues in non-increasing order. Call the number $S_k(G):=\sum_{i=1}^{n}λ_{i}^k(G) (k=0,1,...,n-1)$ the $k$ th spectral moment of $G$ . Let $S(G)=(S_0(G),S_1(G),...,S_{n-1}(G))$ be the sequence of spectral moments of $G$ . For two graphs $G_1$ and $G_2$ , we have $G_1\prec_sG_2$ if $S_i(G_1)=S_i(G_2) (i=0,1,...,k-1)$ and $S_k(G_1)<S_k(G_2)$ for some $k\in {1,2,...,n-1}$ . Denote by $\mathscr{G}_n^k$ the set of connected $n$ -vertex graphs with $k$ cut edges. In this paper, we determine the first, the second, the last and the second last graphs, in an $S$ -order, among $\mathscr{G}_n^k$ , respectively.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Huihui Zhang

Research overview

Is this your work?

3 publications

Bilinear integral operator on Morrey-Banach spaces and its application

Unbiased Deep Reinforcement Learning: A General Training Framework for Existing and Future Algorithms

On the spectral moment of graphs with $k$ cut edges

See the researcher in context

Building this map preview

Huihui Zhang

Research overview

Is this your work?

3 publications

Bilinear integral operator on Morrey-Banach spaces and its application

Unbiased Deep Reinforcement Learning: A General Training Framework for Existing and Future Algorithms

On the spectral moment of graphs with kkk cut edges

See the researcher in context

Building this map preview

On the spectral moment of graphs with $k$ cut edges