Researcher profile

Shilei Zhang

Shilei Zhang contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
10works
0followers
6topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

10 published item(s)

preprint2026arXiv

DisCo-Speech: Controllable Zero-Shot Speech Generation with A Disentangled Speech Codec

Codec-based language models (LMs) have revolutionized text-to-speech (TTS). However, standard codecs entangle timbre and prosody, which hinders independent control in continuation-based LMs. To tackle this challenge, we propose DisCo-Speech, a zero-shot controllable TTS framework featuring a disentangled speech codec (DisCodec) and an LM-based generator. The core component DisCodec employs a two-stage design: 1) tri-factor disentanglement to separate speech into content, prosody, and timbre subspaces via parallel encoders and hybrid losses; and 2) fusion and reconstruction that merges content and prosody into unified content-prosody tokens suitable for LM prediction, while jointly optimizing reconstruction to address the disentanglement-reconstruction trade-off. This allows the LM to perform prosodic continuation from a style prompt while the decoder injects target timbre, enabling flexible zero-shot control. Experiments demonstrate that DisCo-Speech achieves competitive voice cloning and superior zero-shot prosody control. By resolving the core entanglement at the codec level, DisCo-Speech provides a robust foundation for controllable speech synthesis.

preprint2022arXiv

A CTC Triggered Siamese Network with Spatial-Temporal Dropout for Speech Recognition

Siamese networks have shown effective results in unsupervised visual representation learning. These models are designed to learn an invariant representation of two augmentations for one input by maximizing their similarity. In this paper, we propose an effective Siamese network to improve the robustness of End-to-End automatic speech recognition (ASR). We introduce spatial-temporal dropout to support a more violent disturbance for Siamese-ASR framework. Besides, we also relax the similarity regularization to maximize the similarities of distributions on the frames that connectionist temporal classification (CTC) spikes occur rather than on all of them. The efficiency of the proposed architecture is evaluated on two benchmarks, AISHELL-1 and Librispeech, resulting in 7.13% and 6.59% relative character error rate (CER) and word error rate (WER) reductions respectively. Analysis shows that our proposed approach brings a better uniformity for the trained model and enlarges the CTC spikes obviously.

preprint2022arXiv

Harmonic gated compensation network plus for ICASSP 2022 DNS CHALLENGE

The harmonic structure of speech is resistant to noise, but the harmonics may still be partially masked by noise. Therefore, we previously proposed a harmonic gated compensation network (HGCN) to predict the full harmonic locations based on the unmasked harmonics and process the result of a coarse enhancement module to recover the masked harmonics. In addition, the auditory loudness loss function is used to train the network. For the DNS Challenge, we update HGCN with the following aspects, resulting in HGCN+. First, a high-band module is employed to help the model handle full-band signals. Second, cosine is used to model the harmonic structure more accurately. Then, the dual-path encoder and dual-path rnn (DPRNN) are introduced to take full advantage of the features. Finally, a gated residual linear structure replaces the gated convolution in the compensation module to increase the receptive field of frequency. The experimental results show that each updated module brings performance improvement to the model. HGCN+ also outperforms the referenced models on both wide-band and full-band test sets.

preprint2022arXiv

HGCN: Harmonic gated compensation network for speech enhancement

Mask processing in the time-frequency (T-F) domain through the neural network has been one of the mainstreams for single-channel speech enhancement. However, it is hard for most models to handle the situation when harmonics are partially masked by noise. To tackle this challenge, we propose a harmonic gated compensation network (HGCN). We design a high-resolution harmonic integral spectrum to improve the accuracy of harmonic locations prediction. Then we add voice activity detection (VAD) and voiced region detection (VRD) to the convolutional recurrent network (CRN) to filter harmonic locations. Finally, the harmonic gating mechanism is used to guide the compensation model to adjust the coarse results from CRN to obtain the refinedly enhanced results. Our experiments show HGCN achieves substantial gain over a number of advanced approaches in the community.

preprint2022arXiv

Meta Auxiliary Learning for Low-resource Spoken Language Understanding

Spoken language understanding (SLU) treats automatic speech recognition (ASR) and natural language understanding (NLU) as a unified task and usually suffers from data scarcity. We exploit an ASR and NLU joint training method based on meta auxiliary learning to improve the performance of low-resource SLU task by only taking advantage of abundant manual transcriptions of speech data. One obvious advantage of such method is that it provides a flexible framework to implement a low-resource SLU training task without requiring access to any further semantic annotations. In particular, a NLU model is taken as label generation network to predict intent and slot tags from texts; a multi-task network trains ASR task and SLU task synchronously from speech; and the predictions of label generation network are delivered to the multi-task network as semantic targets. The efficiency of the proposed algorithm is demonstrated with experiments on the public CATSLU dataset, which produces more suitable ASR hypotheses for the downstream NLU task.

preprint2022arXiv

Multiple Confidence Gates For Joint Training Of SE And ASR

Joint training of speech enhancement model (SE) and speech recognition model (ASR) is a common solution for robust ASR in noisy environments. SE focuses on improving the auditory quality of speech, but the enhanced feature distribution is changed, which is uncertain and detrimental to the ASR. To tackle this challenge, an approach with multiple confidence gates for jointly training of SE and ASR is proposed. A speech confidence gates prediction module is designed to replace the former SE module in joint training. The noisy speech is filtered by gates to obtain features that are easier to be fitting by the ASR network. The experimental results show that the proposed method has better performance than the traditional robust speech recognition system on test sets of clean speech, synthesized noisy speech, and real noisy speech.

preprint2022arXiv

Persistent exchange splitting in a chiral helimagnet Cr1/3NbS2

Using high-resolution angle-resolved photoemission spectroscopy (ARPES) and ab-initio calculation, we systematically investigate the electronic structure of the chiral helimagnet Cr1/3NbS2 and its temperature evolution. The comparison with NbS2 suggests that the electronic structure of Cr1/3NbS2 is strongly modified by the intercalation of Cr atoms. Our ab-initio calculation, consistent with experimental result, suggests strong hybridization between Nb- and Cr-derived states near the Fermi level. In the chiral helimagnetic state (below the Curie temperature Tc), we observe exchange splitting of the energy bands crossing EF, which follows the temperature evolution of the magnetic moment, suggesting an important role of the conduction electrons in the long-range magnetic ordering. Interestingly, the exchange splitting persists far above Tc with negligible temperature dependence, in drastic contrast to the itinerant ferromagnetism described by the Stoner model, indicating the existence of short-range magnetic order. Our results provide important insights into the microscopic mechanism of the chiral helimagnetic ordering in Cr1/3NbS2.

preprint2021arXiv

Electrical manipulation of skyrmions in a chiral magnet

Writing, erasing and computing are three fundamental operations required by any working electronic devices. Magnetic skyrmions could be basic bits in promising in emerging topological spintronic devices. In particular, skyrmions in chiral magnets have outstanding properties like compact texture, uniform size and high mobility. However, creating, deleting and driving isolated skyrmions, as prototypes of aforementioned basic operations, have been grand challenge in chiral magnets ever since the discovery of skyrmions, and achieving all these three operations in a single device is highly desirable. Here, by engineering chiral magnet Co$_8$Zn$_{10}$Mn$_2$ into the customized micro-devices for in-situ Lorentz transmission electron microscopy observations, we implement these three operations of skyrmions using nanosecond current pulses with a low a current density about $10^{10}$ A/m$^2$ at room temperature. A notched structure can create or delete magnetic skyrmions depending on the direction and magnitude of current pulses. We further show that the magnetic skyrmions can be deterministically shifted step-by-step by current pulses, allowing the establishment of the universal current-velocity relationship. These experimental results have immediate significance towards the skyrmion-based memory or logic devices.

preprint2020arXiv

Creation of a Chiral Bobber Lattice in Helimagnet-Multilayer Heterostructures

A chiral bobber is a localized three-dimensional magnetization configuration, terminated by a singularity. Chiral bobbers coexist with magnetic skyrmions in chiral magnets, lending themselves to new types of skyrmion-complementary bits of information. However, the on-demand creation of bobbers, as well as their direct observation remained elusive. Here, we introduce a new mechanism for creating a stable chiral bobber lattice state via the proximity of two skyrmion species with comparable size. This effect is experimentally demonstrated in a Cu$_2$OSeO$_3$/[Ta/CoFeB/MgO]$_4$ heterostructure in which an exotic bobber lattice state emerges in the phase diagram of Cu$_2$OSeO$_3$. To unambiguously reveal the existence of the chiral bobber lattice state, we have developed a novel characterization technique, magnetic truncation rod analysis, which is based on resonant elastic x-ray scattering.

preprint2019arXiv

Tailoring Hybrid Anomalous Hall Response in Engineered Magnetic Topological Insulator Heterostructures

Engineering the anomalous Hall effect (AHE) in the emerging magnetic topological insulators (MTIs) has great potentials for quantum information processing and spintronics applications. In this letter, we synthesize the epitaxial Bi2Te3/MnTe magnetic heterostructures and observe pronounced AHE signals from both layers combined together. The evolution of the resulting hybrid AHE intensity with the top Bi2Te3 layer thickness manifests the presence of an intrinsic ferromagnetic phase induced by the topological surface states at the heterolayer-interface. More importantly, by doping the Bi2Te3 layer with Sb, we are able to manipulate the sign of the Berry phase-associated AHE component. Our results demonstrate the un-paralleled advantages of MTI heterostructures over magnetically doped TI counterparts, in which the tunability of the AHE response can be greatly enhanced. This in turn unveils a new avenue for MTI heterostructure-based multifunctional applications.