Source author record

Hongli Sun

Hongli Sun appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

2works
4topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

2 published item(s)

preprint2022arXiv

Designer magnetic topological graphene nanoribbons

The interplay of magnetism and topology lies at the heart of condensed matter physics, which offers great opportunities to design intrinsic magnetic topological materials hosting a variety of exotic topological quantum states including the quantum anomalous Hall effect (QAHE), axion insulator state, and Majorana bound states. Extending this concept to one-dimension (1D) systems offers additional rich quantum spin physics with great promise for molecular-scale spintronics. Despite recent progress in the discovery of symmetry-protected topological quantum phases in 1D graphene nanoribbons (GNRs), the rational design and realization of magnetic topological GNRs (MT-GNRs) represents a grand challenge, as one must tackle multiple dimensions of complexity including time-reversal symmetry (TRS), spatial symmetry (width, edge, end geometry) and many-electron correlations. Here, we devised a new route involving the real- and reciprocal-space descriptions by unifying the chemists and physicists perspectives, for the design of such MT-GNRs with non-trivial electronic topology and robust magnetic terminal. Classic Clar's rule offers a conceptually qualitative real-space picture to predict the transition from closed-shell to open-shell with terminal magnetism, and band gap reopening with possible non-trivial electronic topology in a series of wave-like GNRs, which are further verified by first principle calculations of band-structure topology in a momentum-space. With the advance of on-surface synthesis and careful design of molecular precursors, we have fabricated these MT-GNRs with observation of topological edge bands, whose terminal pi-magnetism can be directly captured using a single-nickelocene spin sensor. Moreover, the transition from strong anti-ferromagnetic to weak coupling (paramagnetism-like) between terminal spins can be controlled by tuning the length of MT-GNRs.

preprint2022arXiv

FL-Tuning: Layer Tuning for Feed-Forward Network in Transformer

Prompt tuning is an emerging way of adapting pre-trained language models to downstream tasks. However, the existing studies are mainly to add prompts to the input sequence. This way would not work as expected due to the intermediate multi-head self-attention and feed-forward network computation, making model optimization not very smooth. Hence, we propose a novel tuning way called layer tuning, aiming to add learnable parameters in Transformer layers. Specifically, we focus on layer tuning for feed-forward network in the Transformer, namely FL-tuning. It introduces additional units into the hidden layer of each feed-forward network. We conduct extensive experiments on the public CLUE benchmark. The results show that: 1) Our FL-tuning outperforms prompt tuning methods under both full-data and few-shot settings in almost all cases. In particular, it improves accuracy by 17.93% (full-data setting) on WSC 1.0 and F1 by 16.142% (few-shot setting) on CLUENER over P-tuning v2. 2) Our FL-tuning is more stable and converges about 1.17 times faster than P-tuning v2. 3) With only about 3% of Transformer's parameters to be trained, FL-tuning is comparable with fine-tuning on most datasets, and significantly outperforms fine-tuning (e.g., accuracy improved by 12.9% on WSC 1.1) on several datasets. The source codes are available at https://github.com/genggui001/FL-Tuning.