Source author record

Huihui Zhang

Huihui Zhang appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Artificial Intelligence Machine Learning math.CA math.CO math.FA

Catalog footprint

What is connected

3works

5topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2022arXiv

Bilinear integral operator on Morrey-Banach spaces and its application

In this paper, we give the definability of bilinear singular and fractional integral operators on Morrey-Banach space, as well as their commutators and we prove the boundedness of such operators on Morrey-Banach spaces. Moreover, the necessary condition for BMO via the bounedness of bilinear commutators on Morrey-Banach space is also given. As a application of our main results, we get the necessary conditions for BMO via the bounedness of bilinear integral operators on weighted Morrey space and Morrey space with variable exponents. Finally, we obtain the boundedness of bilinear C-Z operator on Morrey space with variable exponents.

preprint2020arXiv

Unbiased Deep Reinforcement Learning: A General Training Framework for Existing and Future Algorithms

In recent years deep neural networks have been successfully applied to the domains of reinforcement learning \cite{bengio2009learning,krizhevsky2012imagenet,hinton2006reducing}. Deep reinforcement learning \cite{mnih2015human} is reported to have the advantage of learning effective policies directly from high-dimensional sensory inputs over traditional agents. However, within the scope of the literature, there is no fundamental change or improvement on the existing training framework. Here we propose a novel training framework that is conceptually comprehensible and potentially easy to be generalized to all feasible algorithms for reinforcement learning. We employ Monte-carlo sampling to achieve raw data inputs, and train them in batch to achieve Markov decision process sequences and synchronously update the network parameters instead of experience replay. This training framework proves to optimize the unbiased approximation of loss function whose estimation exactly matches the real probability distribution data inputs follow, and thus have overwhelming advantages of sample efficiency and convergence rate over existing deep reinforcement learning after evaluating it on both discrete action spaces and continuous control problems. Besides, we propose several algorithms embedded with our new framework to deal with typical discrete and continuous scenarios. These algorithms prove to be far more efficient than their original versions under the framework of deep reinforcement learning, and provide examples for existing and future algorithms to generalize to our new framework.

preprint2012arXiv

On the spectral moment of graphs with $k$ cut edges

Let $A(G)$ be the adjacency matrix of a graph $G$ with $λ_{1}(G)$, $λ_{2}(G)$, ..., $λ_{n}(G)$ being its eigenvalues in non-increasing order. Call the number $S_k(G):=\sum_{i=1}^{n}λ_{i}^k(G) (k=0,1,...,n-1)$ the $k$th spectral moment of $G$. Let $S(G)=(S_0(G),S_1(G),...,S_{n-1}(G))$ be the sequence of spectral moments of $G$. For two graphs $G_1$ and $G_2$, we have $G_1\prec_sG_2$ if $S_i(G_1)=S_i(G_2) (i=0,1,...,k-1)$ and $S_k(G_1)<S_k(G_2)$ for some $k\in {1,2,...,n-1}$. Denote by $\mathscr{G}_n^k$ the set of connected $n$-vertex graphs with $k$ cut edges. In this paper, we determine the first, the second, the last and the second last graphs, in an $S$-order, among $\mathscr{G}_n^k$, respectively.